2024-05-10T09:41:30.703 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T09:41:30.703 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi --owner scheduled_soumyakoduri@teuthology --archive /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864 --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} -- /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/orig.config.yaml 2024-05-10T09:41:30.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T09:41:30.821 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864 branch: wip-skoduri-lc-notify description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} email: null first_in_suite: false job_id: '7700864' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-skoduri-lc-notify ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 5be95034c7c2ad8a0361951b19205b782eb6be06 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5be95034c7c2ad8a0361951b19205b782eb6be06 rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-skoduri-lc-notify sha1: 5be95034c7c2ad8a0361951b19205b782eb6be06 owner: scheduled_soumyakoduri@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 5be95034c7c2ad8a0361951b19205b782eb6be06 sleep_before_teardown: 0 suite: rgw suite_branch: wip-skoduri-lc-notify suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_5be95034c7c2ad8a0361951b19205b782eb6be06/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 5be95034c7c2ad8a0361951b19205b782eb6be06 targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLnV3J6+uye8B13rgu2lMBBbDkdiZePrQX0qSfKJ9J/z3rqHnBUkyc5FAdzebjZNCJSSpoESdDGVHXDEvAx9fo= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIgk19yC/Wj8hWKRvJ900Mtp2l0CJ6PvB+IS59+5/qUPHmX2JHaFQVqMzSU6AyPI/5LuU1mcdsD3yBYBB3uoCLc= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_multipart_upload.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_06:25:19 tube: smithi user: soumyakoduri verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T09:41:30.821 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_5be95034c7c2ad8a0361951b19205b782eb6be06/qa; will attempt to use it 2024-05-10T09:41:30.822 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_5be95034c7c2ad8a0361951b19205b782eb6be06/qa/tasks 2024-05-10T09:41:30.822 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T09:41:30.823 INFO:teuthology.task.internal:Checking packages... 2024-05-10T09:41:30.845 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '5be95034c7c2ad8a0361951b19205b782eb6be06' 2024-05-10T09:41:30.845 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T09:41:30.845 INFO:teuthology.packaging:ref: None 2024-05-10T09:41:30.845 INFO:teuthology.packaging:tag: None 2024-05-10T09:41:30.845 INFO:teuthology.packaging:branch: wip-skoduri-lc-notify 2024-05-10T09:41:30.845 INFO:teuthology.packaging:sha1: 5be95034c7c2ad8a0361951b19205b782eb6be06 2024-05-10T09:41:30.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-skoduri-lc-notify 2024-05-10T09:41:30.984 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3457-g5be95034-1jammy 2024-05-10T09:41:30.985 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T09:41:30.992 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T09:41:30.993 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T09:41:31.030 INFO:teuthology.task.internal:Saving configuration 2024-05-10T09:41:31.042 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T09:41:31.049 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T09:41:31.075 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 09:35:18.998463', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOFrLUKCgbbWwR1wuVoBHcTYwC/TBaOSwEa+An8TIUNB'} 2024-05-10T09:41:31.096 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 09:35:18.999791', 'locked_by': 'scheduled_soumyakoduri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINar4YIX+jkCMcV6RINo63Nvij6wDsi3Sy7ezZ64Tcpi'} 2024-05-10T09:41:31.096 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T09:41:31.103 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-05-10T09:41:31.103 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-10T09:41:31.103 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T09:41:31.169 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fadfbdab4c0>, signals=[15]) 2024-05-10T09:41:31.171 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T09:41:31.177 INFO:teuthology.task.internal:Opening connections... 2024-05-10T09:41:31.177 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:41:31.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:41:31.262 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:41:31.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:41:31.337 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T09:41:31.345 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-05-10T09:41:31.350 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-05-10T09:41:31.351 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-05-10T09:41:31.402 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu" 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="22.04" 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=jammy 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-10T09:41:31.403 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=jammy 2024-05-10T09:41:31.404 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-05-10T09:41:31.424 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-05-10T09:41:31.429 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-05-10T09:41:31.430 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-05-10T09:41:31.476 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-10T09:41:31.476 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu" 2024-05-10T09:41:31.476 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04" 2024-05-10T09:41:31.476 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-10T09:41:31.476 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy 2024-05-10T09:41:31.476 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu 2024-05-10T09:41:31.476 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian 2024-05-10T09:41:31.477 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-10T09:41:31.477 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-10T09:41:31.477 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-10T09:41:31.477 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-10T09:41:31.477 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy 2024-05-10T09:41:31.477 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-05-10T09:41:31.499 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T09:41:31.509 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T09:41:31.515 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T09:41:31.515 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-05-10T09:41:31.518 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-05-10T09:41:31.524 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T09:41:31.564 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T09:41:31.565 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-05-10T09:41:31.567 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-05-10T09:41:31.581 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T09:41:31.635 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T09:41:31.649 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-10T09:41:31.649 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-10T09:41:31.650 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T09:41:31.650 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T09:41:31.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:41:31.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:41:31.656 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-05-10T09:41:31.656 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-05-10T09:41:31.703 INFO:teuthology.orchestra.run.smithi042.stdout:5.15.0-56-generic 2024-05-10T09:41:31.703 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.15.0-56-generic 2024-05-10T09:41:31.703 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get clean 2024-05-10T09:41:31.704 INFO:teuthology.orchestra.run.smithi181.stdout:5.15.0-56-generic 2024-05-10T09:41:31.705 INFO:teuthology.task.kernel:Running kernel on smithi181: 5.15.0-56-generic 2024-05-10T09:41:31.705 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get clean 2024-05-10T09:41:31.820 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get update 2024-05-10T09:41:31.833 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get update 2024-05-10T09:41:31.965 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T09:41:31.977 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-10T09:41:31.993 INFO:teuthology.orchestra.run.smithi181.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-10T09:41:32.053 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-10T09:41:32.070 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-10T09:41:32.094 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T09:41:32.176 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-10T09:41:32.198 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-10T09:41:32.222 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [462 kB] 2024-05-10T09:41:32.288 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-10T09:41:32.306 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,427 kB] 2024-05-10T09:41:32.330 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-10T09:41:32.337 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-10T09:41:32.337 INFO:teuthology.orchestra.run.smithi042.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-10T09:41:32.339 INFO:teuthology.orchestra.run.smithi042.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-10T09:41:32.363 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [247 kB] 2024-05-10T09:41:32.365 INFO:teuthology.orchestra.run.smithi042.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-10T09:41:32.369 INFO:teuthology.orchestra.run.smithi042.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-10T09:41:32.369 INFO:teuthology.orchestra.run.smithi042.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-05-10T09:41:32.370 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-10T09:41:32.370 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-10T09:41:32.380 INFO:teuthology.orchestra.run.smithi042.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-10T09:41:32.410 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-10T09:41:32.411 INFO:teuthology.orchestra.run.smithi181.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-10T09:41:32.416 INFO:teuthology.orchestra.run.smithi181.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-10T09:41:32.416 INFO:teuthology.orchestra.run.smithi181.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-10T09:41:32.425 INFO:teuthology.orchestra.run.smithi181.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-10T09:41:32.429 INFO:teuthology.orchestra.run.smithi042.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-10T09:41:32.431 INFO:teuthology.orchestra.run.smithi042.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-10T09:41:32.431 INFO:teuthology.orchestra.run.smithi042.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-10T09:41:32.431 INFO:teuthology.orchestra.run.smithi042.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-10T09:41:32.432 INFO:teuthology.orchestra.run.smithi042.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-10T09:41:32.432 INFO:teuthology.orchestra.run.smithi042.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-10T09:41:32.432 INFO:teuthology.orchestra.run.smithi042.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-10T09:41:32.433 INFO:teuthology.orchestra.run.smithi042.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-10T09:41:32.433 INFO:teuthology.orchestra.run.smithi042.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-10T09:41:32.434 INFO:teuthology.orchestra.run.smithi181.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-10T09:41:32.436 INFO:teuthology.orchestra.run.smithi181.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-10T09:41:32.436 INFO:teuthology.orchestra.run.smithi181.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-10T09:41:32.436 INFO:teuthology.orchestra.run.smithi181.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-10T09:41:32.450 INFO:teuthology.orchestra.run.smithi042.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-10T09:41:32.470 INFO:teuthology.orchestra.run.smithi042.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-10T09:41:32.471 INFO:teuthology.orchestra.run.smithi042.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-10T09:41:32.471 INFO:teuthology.orchestra.run.smithi042.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-10T09:41:32.471 INFO:teuthology.orchestra.run.smithi042.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-10T09:41:32.472 INFO:teuthology.orchestra.run.smithi181.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-10T09:41:32.473 INFO:teuthology.orchestra.run.smithi181.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-10T09:41:32.525 INFO:teuthology.orchestra.run.smithi042.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,427 kB] 2024-05-10T09:41:32.529 INFO:teuthology.orchestra.run.smithi181.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-10T09:41:32.668 INFO:teuthology.orchestra.run.smithi181.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-10T09:41:32.870 INFO:teuthology.orchestra.run.smithi181.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-10T09:41:33.021 INFO:teuthology.orchestra.run.smithi181.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-10T09:41:33.036 INFO:teuthology.orchestra.run.smithi181.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-10T09:41:33.036 INFO:teuthology.orchestra.run.smithi181.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-10T09:41:33.050 INFO:teuthology.orchestra.run.smithi042.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [462 kB] 2024-05-10T09:41:33.072 INFO:teuthology.orchestra.run.smithi042.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [247 kB] 2024-05-10T09:41:33.084 INFO:teuthology.orchestra.run.smithi042.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-10T09:41:33.084 INFO:teuthology.orchestra.run.smithi042.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-10T09:41:33.098 INFO:teuthology.orchestra.run.smithi181.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-10T09:41:33.100 INFO:teuthology.orchestra.run.smithi181.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-10T09:41:33.107 INFO:teuthology.orchestra.run.smithi181.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-10T09:41:33.195 INFO:teuthology.orchestra.run.smithi042.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-10T09:41:33.197 INFO:teuthology.orchestra.run.smithi042.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-10T09:41:33.249 INFO:teuthology.orchestra.run.smithi042.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-10T09:41:33.250 INFO:teuthology.orchestra.run.smithi042.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-10T09:41:33.272 INFO:teuthology.orchestra.run.smithi181.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-05-10T09:41:33.301 INFO:teuthology.orchestra.run.smithi042.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-10T09:41:33.486 INFO:teuthology.orchestra.run.smithi042.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-10T09:41:33.906 INFO:teuthology.orchestra.run.smithi042.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-10T09:41:33.907 INFO:teuthology.orchestra.run.smithi181.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-10T09:41:33.912 INFO:teuthology.orchestra.run.smithi042.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-10T09:41:33.927 INFO:teuthology.orchestra.run.smithi042.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-10T09:41:33.927 INFO:teuthology.orchestra.run.smithi042.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-10T09:41:33.931 INFO:teuthology.orchestra.run.smithi042.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-10T09:41:33.944 INFO:teuthology.orchestra.run.smithi181.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-10T09:41:33.957 INFO:teuthology.orchestra.run.smithi181.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-10T09:41:33.958 INFO:teuthology.orchestra.run.smithi181.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-10T09:41:33.959 INFO:teuthology.orchestra.run.smithi181.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-10T09:41:33.961 INFO:teuthology.orchestra.run.smithi181.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-10T09:41:33.962 INFO:teuthology.orchestra.run.smithi181.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-10T09:41:33.962 INFO:teuthology.orchestra.run.smithi181.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-10T09:41:33.989 INFO:teuthology.orchestra.run.smithi181.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-10T09:41:33.992 INFO:teuthology.orchestra.run.smithi181.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-10T09:41:34.158 INFO:teuthology.orchestra.run.smithi181.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-10T09:41:34.240 INFO:teuthology.orchestra.run.smithi181.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-10T09:41:34.322 INFO:teuthology.orchestra.run.smithi181.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-10T09:41:34.403 INFO:teuthology.orchestra.run.smithi181.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-10T09:41:34.434 INFO:teuthology.orchestra.run.smithi181.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-10T09:41:38.418 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 13.4 MB in 2s (6,549 kB/s) 2024-05-10T09:41:38.858 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 13.4 MB in 3s (5,307 kB/s) 2024-05-10T09:41:39.839 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-05-10T09:41:39.858 DEBUG:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-10T09:41:39.923 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-05-10T09:41:40.136 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2024-05-10T09:41:40.137 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2024-05-10T09:41:40.324 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T09:41:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T09:41:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T09:41:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T09:41:40.324 INFO:teuthology.orchestra.run.smithi042.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-10T09:41:40.325 INFO:teuthology.orchestra.run.smithi042.stdout: python2.7-minimal 2024-05-10T09:41:40.325 INFO:teuthology.orchestra.run.smithi042.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T09:41:40.326 INFO:teuthology.orchestra.run.smithi042.stdout:The following additional packages will be installed: 2024-05-10T09:41:40.326 INFO:teuthology.orchestra.run.smithi042.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-10T09:41:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-10T09:41:40.327 INFO:teuthology.orchestra.run.smithi042.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-10T09:41:40.328 INFO:teuthology.orchestra.run.smithi042.stdout:Suggested packages: 2024-05-10T09:41:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-10T09:41:40.329 INFO:teuthology.orchestra.run.smithi042.stdout:Recommended packages: 2024-05-10T09:41:40.329 INFO:teuthology.orchestra.run.smithi042.stdout: thermald 2024-05-10T09:41:40.368 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-05-10T09:41:40.381 INFO:teuthology.orchestra.run.smithi042.stdout:The following NEW packages will be installed: 2024-05-10T09:41:40.381 INFO:teuthology.orchestra.run.smithi042.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-10T09:41:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-10T09:41:40.382 INFO:teuthology.orchestra.run.smithi042.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-10T09:41:40.383 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages will be upgraded: 2024-05-10T09:41:40.383 INFO:teuthology.orchestra.run.smithi042.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-10T09:41:40.387 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-10T09:41:40.442 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-05-10T09:41:40.566 INFO:teuthology.orchestra.run.smithi042.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-10T09:41:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:Need to get 113 MB of archives. 2024-05-10T09:41:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-10T09:41:40.599 INFO:teuthology.orchestra.run.smithi042.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-10T09:41:40.642 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-05-10T09:41:40.643 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-05-10T09:41:40.801 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T09:41:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T09:41:40.801 INFO:teuthology.orchestra.run.smithi181.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T09:41:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T09:41:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-10T09:41:40.802 INFO:teuthology.orchestra.run.smithi181.stdout: python2.7-minimal 2024-05-10T09:41:40.802 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T09:41:40.803 INFO:teuthology.orchestra.run.smithi181.stdout:The following additional packages will be installed: 2024-05-10T09:41:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-10T09:41:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-10T09:41:40.803 INFO:teuthology.orchestra.run.smithi181.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-10T09:41:40.804 INFO:teuthology.orchestra.run.smithi181.stdout:Suggested packages: 2024-05-10T09:41:40.804 INFO:teuthology.orchestra.run.smithi181.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-10T09:41:40.805 INFO:teuthology.orchestra.run.smithi181.stdout:Recommended packages: 2024-05-10T09:41:40.805 INFO:teuthology.orchestra.run.smithi181.stdout: thermald 2024-05-10T09:41:40.858 INFO:teuthology.orchestra.run.smithi181.stdout:The following NEW packages will be installed: 2024-05-10T09:41:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-10T09:41:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-10T09:41:40.858 INFO:teuthology.orchestra.run.smithi181.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-10T09:41:40.859 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages will be upgraded: 2024-05-10T09:41:40.860 INFO:teuthology.orchestra.run.smithi181.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-10T09:41:40.917 INFO:teuthology.orchestra.run.smithi181.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-10T09:41:40.917 INFO:teuthology.orchestra.run.smithi181.stdout:Need to get 113 MB of archives. 2024-05-10T09:41:40.917 INFO:teuthology.orchestra.run.smithi181.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-10T09:41:40.917 INFO:teuthology.orchestra.run.smithi181.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-10T09:41:41.381 INFO:teuthology.orchestra.run.smithi181.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-10T09:41:41.499 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-10T09:41:41.983 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-10T09:41:42.318 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-10T09:41:42.392 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-10T09:41:42.392 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-10T09:41:42.392 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-10T09:41:43.220 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-10T09:41:43.282 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-10T09:41:43.659 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 113 MB in 2s (46.9 MB/s) 2024-05-10T09:41:43.859 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-10T09:41:44.522 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-10T09:41:44.522 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-10T09:41:44.523 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-10T09:41:45.512 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-10T09:41:45.611 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-10T09:41:45.870 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-10T09:41:45.874 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T09:41:46.040 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:41:46.043 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 113 MB in 5s (21.7 MB/s) 2024-05-10T09:41:46.218 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-10T09:41:48.176 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-10T09:41:48.197 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T09:41:48.209 INFO:teuthology.orchestra.run.smithi042.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-10T09:41:48.215 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T09:41:48.307 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:41:48.309 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:41:48.812 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-10T09:41:48.832 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T09:41:48.861 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:41:50.842 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-10T09:41:50.863 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T09:41:50.948 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:41:51.370 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-10T09:41:51.391 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T09:41:51.428 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:41:56.012 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T09:41:56.139 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T09:41:56.488 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T09:41:56.617 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T09:41:56.920 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-10T09:41:56.943 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-10T09:41:56.987 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-10T09:41:57.745 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T09:41:57.863 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T09:41:58.213 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T09:41:58.341 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T09:41:58.627 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-10T09:41:58.638 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-10T09:41:58.669 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-10T09:42:02.840 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-10T09:42:02.877 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T09:42:02.915 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:04.222 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-10T09:42:04.260 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-10T09:42:04.289 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:06.287 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T09:42:06.435 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T09:42:06.792 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-10T09:42:06.931 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:07.057 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-10T09:42:07.202 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:07.625 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-10T09:42:08.317 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-10T09:42:08.515 INFO:teuthology.orchestra.run.smithi181.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-10T09:42:08.515 INFO:teuthology.orchestra.run.smithi181.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-10T09:42:08.516 INFO:teuthology.orchestra.run.smithi181.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-10T09:42:08.516 INFO:teuthology.orchestra.run.smithi181.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-10T09:42:08.668 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-10T09:42:08.671 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:08.789 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:08.934 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-10T09:42:09.060 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:10.072 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:10.419 INFO:teuthology.orchestra.run.smithi042.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-10T09:42:10.419 INFO:teuthology.orchestra.run.smithi042.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-10T09:42:10.419 INFO:teuthology.orchestra.run.smithi042.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-10T09:42:10.419 INFO:teuthology.orchestra.run.smithi042.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-10T09:42:10.579 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:11.491 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-10T09:42:11.642 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-10T09:42:11.768 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:11.857 INFO:teuthology.orchestra.run.smithi181.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-10T09:42:11.857 INFO:teuthology.orchestra.run.smithi181.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-10T09:42:12.005 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:14.083 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-10T09:42:14.208 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-10T09:42:14.334 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-10T09:42:14.390 INFO:teuthology.orchestra.run.smithi042.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-10T09:42:14.390 INFO:teuthology.orchestra.run.smithi042.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-10T09:42:25.996 INFO:teuthology.orchestra.run.smithi181.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-10T09:42:25.996 INFO:teuthology.orchestra.run.smithi181.stdout:Sourcing file `/etc/default/grub' 2024-05-10T09:42:26.023 INFO:teuthology.orchestra.run.smithi181.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-10T09:42:26.050 INFO:teuthology.orchestra.run.smithi181.stdout:Generating grub configuration file ... 2024-05-10T09:42:26.374 INFO:teuthology.orchestra.run.smithi181.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-10T09:42:26.393 INFO:teuthology.orchestra.run.smithi181.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-10T09:42:26.740 INFO:teuthology.orchestra.run.smithi181.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-10T09:42:26.745 INFO:teuthology.orchestra.run.smithi181.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-10T09:42:26.804 INFO:teuthology.orchestra.run.smithi181.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-10T09:42:26.809 INFO:teuthology.orchestra.run.smithi181.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-10T09:42:26.971 INFO:teuthology.orchestra.run.smithi181.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-10T09:42:26.971 INFO:teuthology.orchestra.run.smithi181.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-10T09:42:26.971 INFO:teuthology.orchestra.run.smithi181.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-10T09:42:27.002 INFO:teuthology.orchestra.run.smithi181.stdout:done 2024-05-10T09:42:27.519 DEBUG:teuthology.orchestra.run.smithi181:> dpkg -s linux-image-generic 2024-05-10T09:42:27.542 INFO:teuthology.orchestra.run.smithi181.stdout:Package: linux-image-generic 2024-05-10T09:42:27.542 INFO:teuthology.orchestra.run.smithi181.stdout:Status: install ok installed 2024-05-10T09:42:27.542 INFO:teuthology.orchestra.run.smithi181.stdout:Priority: optional 2024-05-10T09:42:27.542 INFO:teuthology.orchestra.run.smithi181.stdout:Section: kernel 2024-05-10T09:42:27.542 INFO:teuthology.orchestra.run.smithi181.stdout:Installed-Size: 21 2024-05-10T09:42:27.542 INFO:teuthology.orchestra.run.smithi181.stdout:Maintainer: Ubuntu Kernel Team 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: amd64 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout:Source: linux-meta 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout:Version: 5.15.0.106.106 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout:Recommends: thermald 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout:Description: Generic Linux kernel image 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: This package will always depend on the latest generic kernel image 2024-05-10T09:42:27.543 INFO:teuthology.orchestra.run.smithi181.stdout: available. 2024-05-10T09:42:27.544 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-10T09:42:27.544 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T09:42:27.544 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T09:42:27.544 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-10T09:42:27.544 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi181.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T09:42:27.544 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get clean 2024-05-10T09:42:27.713 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get update 2024-05-10T09:42:27.893 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T09:42:27.913 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-10T09:42:27.943 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-10T09:42:27.945 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-10T09:42:28.865 INFO:teuthology.orchestra.run.smithi042.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-10T09:42:28.865 INFO:teuthology.orchestra.run.smithi042.stdout:Sourcing file `/etc/default/grub' 2024-05-10T09:42:28.884 INFO:teuthology.orchestra.run.smithi042.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-10T09:42:28.904 INFO:teuthology.orchestra.run.smithi042.stdout:Generating grub configuration file ... 2024-05-10T09:42:29.178 INFO:teuthology.orchestra.run.smithi042.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-10T09:42:29.194 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-05-10T09:42:29.198 INFO:teuthology.orchestra.run.smithi042.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-10T09:42:29.212 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-10T09:42:29.271 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-05-10T09:42:29.479 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-05-10T09:42:29.480 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-05-10T09:42:29.495 INFO:teuthology.orchestra.run.smithi042.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-10T09:42:29.501 INFO:teuthology.orchestra.run.smithi042.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-10T09:42:29.567 INFO:teuthology.orchestra.run.smithi042.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-10T09:42:29.572 INFO:teuthology.orchestra.run.smithi042.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-10T09:42:29.654 INFO:teuthology.orchestra.run.smithi181.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-10T09:42:29.654 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T09:42:29.654 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T09:42:29.655 INFO:teuthology.orchestra.run.smithi181.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T09:42:29.655 INFO:teuthology.orchestra.run.smithi181.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T09:42:29.655 INFO:teuthology.orchestra.run.smithi181.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-10T09:42:29.655 INFO:teuthology.orchestra.run.smithi181.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-10T09:42:29.655 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T09:42:29.696 INFO:teuthology.orchestra.run.smithi181.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-10T09:42:29.699 DEBUG:teuthology.orchestra.run.smithi181:> dpkg -s linux-image-generic 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Package: linux-image-generic 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Status: install ok installed 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Priority: optional 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Section: kernel 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Installed-Size: 21 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Maintainer: Ubuntu Kernel Team 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Architecture: amd64 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Source: linux-meta 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Version: 5.15.0.106.106 2024-05-10T09:42:29.714 INFO:teuthology.orchestra.run.smithi181.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-10T09:42:29.715 INFO:teuthology.orchestra.run.smithi181.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-10T09:42:29.715 INFO:teuthology.orchestra.run.smithi181.stdout:Recommends: thermald 2024-05-10T09:42:29.715 INFO:teuthology.orchestra.run.smithi181.stdout:Description: Generic Linux kernel image 2024-05-10T09:42:29.715 INFO:teuthology.orchestra.run.smithi181.stdout: This package will always depend on the latest generic kernel image 2024-05-10T09:42:29.715 INFO:teuthology.orchestra.run.smithi181.stdout: available. 2024-05-10T09:42:29.715 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-05-10T09:42:29.741 INFO:teuthology.orchestra.run.smithi042.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-10T09:42:29.741 INFO:teuthology.orchestra.run.smithi042.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-10T09:42:29.741 INFO:teuthology.orchestra.run.smithi042.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-10T09:42:29.759 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.fPnYue2DQN 2024-05-10T09:42:29.760 DEBUG:teuthology.orchestra.run.smithi181:> sudo cp /boot/grub/grub.cfg /tmp/tmp.fPnYue2DQN 2024-05-10T09:42:29.781 INFO:teuthology.orchestra.run.smithi042.stdout:done 2024-05-10T09:42:29.816 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.fPnYue2DQN 2024-05-10T09:42:29.932 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.fPnYue2DQN is 10KB 2024-05-10T09:42:29.944 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.fPnYue2DQN 2024-05-10T09:42:29.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-10T09:42:30.003 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:42:30.004 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-10T09:42:30.004 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-10T09:42:30.090 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-10T09:42:30.090 DEBUG:teuthology.orchestra.run.smithi181:> sudo update-grub 2024-05-10T09:42:30.255 DEBUG:teuthology.orchestra.run.smithi042:> dpkg -s linux-image-generic 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Package: linux-image-generic 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Status: install ok installed 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Priority: optional 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Section: kernel 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Installed-Size: 21 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Maintainer: Ubuntu Kernel Team 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: amd64 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Source: linux-meta 2024-05-10T09:42:30.278 INFO:teuthology.orchestra.run.smithi042.stdout:Version: 5.15.0.106.106 2024-05-10T09:42:30.279 INFO:teuthology.orchestra.run.smithi042.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-10T09:42:30.279 INFO:teuthology.orchestra.run.smithi042.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-10T09:42:30.279 INFO:teuthology.orchestra.run.smithi042.stdout:Recommends: thermald 2024-05-10T09:42:30.279 INFO:teuthology.orchestra.run.smithi042.stdout:Description: Generic Linux kernel image 2024-05-10T09:42:30.279 INFO:teuthology.orchestra.run.smithi042.stdout: This package will always depend on the latest generic kernel image 2024-05-10T09:42:30.279 INFO:teuthology.orchestra.run.smithi042.stdout: available. 2024-05-10T09:42:30.279 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-10T09:42:30.279 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-10T09:42:30.279 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-10T09:42:30.279 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-10T09:42:30.280 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-05-10T09:42:30.280 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get clean 2024-05-10T09:42:30.440 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get update 2024-05-10T09:42:30.589 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-10T09:42:30.590 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T09:42:30.601 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-10T09:42:30.622 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-10T09:42:31.384 INFO:teuthology.orchestra.run.smithi181.stderr:Sourcing file `/etc/default/grub' 2024-05-10T09:42:31.385 INFO:teuthology.orchestra.run.smithi181.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-10T09:42:31.388 INFO:teuthology.orchestra.run.smithi181.stderr:Generating grub configuration file ... 2024-05-10T09:42:31.618 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-10T09:42:31.624 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-10T09:42:31.891 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-10T09:42:31.896 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-10T09:42:31.937 INFO:teuthology.orchestra.run.smithi181.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-10T09:42:31.942 INFO:teuthology.orchestra.run.smithi181.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-10T09:42:31.982 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-05-10T09:42:32.001 DEBUG:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-10T09:42:32.067 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-05-10T09:42:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-10T09:42:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-10T09:42:32.105 INFO:teuthology.orchestra.run.smithi181.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-10T09:42:32.121 INFO:teuthology.orchestra.run.smithi181.stderr:done 2024-05-10T09:42:32.124 DEBUG:teuthology.orchestra.run.smithi181:> sudo shutdown -r now 2024-05-10T09:42:32.270 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2024-05-10T09:42:32.270 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2024-05-10T09:42:32.456 INFO:teuthology.orchestra.run.smithi042.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-10T09:42:32.456 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T09:42:32.456 INFO:teuthology.orchestra.run.smithi042.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T09:42:32.456 INFO:teuthology.orchestra.run.smithi042.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T09:42:32.456 INFO:teuthology.orchestra.run.smithi042.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T09:42:32.457 INFO:teuthology.orchestra.run.smithi042.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-10T09:42:32.457 INFO:teuthology.orchestra.run.smithi042.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-10T09:42:32.457 INFO:teuthology.orchestra.run.smithi042.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T09:42:32.501 INFO:teuthology.orchestra.run.smithi042.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-10T09:42:32.503 DEBUG:teuthology.orchestra.run.smithi042:> dpkg -s linux-image-generic 2024-05-10T09:42:32.519 INFO:teuthology.orchestra.run.smithi042.stdout:Package: linux-image-generic 2024-05-10T09:42:32.519 INFO:teuthology.orchestra.run.smithi042.stdout:Status: install ok installed 2024-05-10T09:42:32.519 INFO:teuthology.orchestra.run.smithi042.stdout:Priority: optional 2024-05-10T09:42:32.519 INFO:teuthology.orchestra.run.smithi042.stdout:Section: kernel 2024-05-10T09:42:32.519 INFO:teuthology.orchestra.run.smithi042.stdout:Installed-Size: 21 2024-05-10T09:42:32.519 INFO:teuthology.orchestra.run.smithi042.stdout:Maintainer: Ubuntu Kernel Team 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: amd64 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout:Source: linux-meta 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout:Version: 5.15.0.106.106 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout:Recommends: thermald 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout:Description: Generic Linux kernel image 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: This package will always depend on the latest generic kernel image 2024-05-10T09:42:32.520 INFO:teuthology.orchestra.run.smithi042.stdout: available. 2024-05-10T09:42:32.520 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-05-10T09:42:32.567 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.EzAOkb09xd 2024-05-10T09:42:32.568 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub/grub.cfg /tmp/tmp.EzAOkb09xd 2024-05-10T09:42:32.623 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.EzAOkb09xd 2024-05-10T09:42:32.748 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.EzAOkb09xd is 10KB 2024-05-10T09:42:32.761 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.EzAOkb09xd 2024-05-10T09:42:32.766 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-10T09:42:32.823 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:42:32.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-10T09:42:32.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-10T09:42:32.891 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-10T09:42:32.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo update-grub 2024-05-10T09:42:34.025 INFO:teuthology.orchestra.run.smithi042.stderr:Sourcing file `/etc/default/grub' 2024-05-10T09:42:34.026 INFO:teuthology.orchestra.run.smithi042.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-10T09:42:34.028 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-05-10T09:42:34.209 INFO:teuthology.orchestra.run.smithi042.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-10T09:42:34.215 INFO:teuthology.orchestra.run.smithi042.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-10T09:42:34.491 INFO:teuthology.orchestra.run.smithi042.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-10T09:42:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-10T09:42:34.542 INFO:teuthology.orchestra.run.smithi042.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-10T09:42:34.548 INFO:teuthology.orchestra.run.smithi042.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-10T09:42:34.718 INFO:teuthology.orchestra.run.smithi042.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-10T09:42:34.718 INFO:teuthology.orchestra.run.smithi042.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-10T09:42:34.718 INFO:teuthology.orchestra.run.smithi042.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-10T09:42:34.735 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-05-10T09:42:34.737 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-05-10T09:43:02.154 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-10T09:43:02.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-10T09:43:02.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:43:04.742 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-10T09:43:04.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-10T09:43:04.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:43:23.167 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-05-10T09:43:32.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-10T09:43:32.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:43:35.230 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-05-10T09:43:36.734 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-05-10T09:43:45.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-10T09:43:45.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:43:47.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-10T09:43:47.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:44:04.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.181 2024-05-10T09:44:16.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-10T09:44:16.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:44:16.616 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-05-10T09:44:17.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-10T09:44:17.696 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-10T09:44:17.697 DEBUG:teuthology.orchestra.run.smithi181:> uname -r 2024-05-10T09:44:17.744 INFO:teuthology.orchestra.run.smithi181.stdout:5.15.0-106-generic 2024-05-10T09:44:17.744 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-10T09:44:17.744 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T09:44:17.744 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-10T09:44:18.802 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-10T09:44:18.802 DEBUG:teuthology.orchestra.run.smithi181:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-10T09:44:18.962 INFO:teuthology.orchestra.run.smithi181.stdout:ttyS1 2024-05-10T09:44:18.982 DEBUG:teuthology.parallel:result is None 2024-05-10T09:44:19.798 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-05-10T09:44:20.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-10T09:44:20.939 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-10T09:44:20.940 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-05-10T09:44:20.986 INFO:teuthology.orchestra.run.smithi042.stdout:5.15.0-106-generic 2024-05-10T09:44:20.986 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-10T09:44:20.986 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T09:44:20.986 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-10T09:44:21.987 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-10T09:44:21.988 DEBUG:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-10T09:44:22.178 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2024-05-10T09:44:22.203 DEBUG:teuthology.parallel:result is None 2024-05-10T09:44:22.204 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T09:44:22.213 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T09:44:22.213 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T09:44:22.215 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T09:44:22.221 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T09:44:22.245 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T09:44:22.265 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T09:44:22.266 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T09:44:22.268 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T09:44:22.467 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T09:44:22.473 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T09:44:22.473 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T09:44:22.476 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T09:44:22.499 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T09:44:22.508 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T09:44:22.515 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T09:44:22.521 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T09:44:22.523 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T09:44:22.530 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T09:44:22.530 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T09:44:22.571 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T09:44:22.586 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T09:44:22.596 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T09:44:22.597 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T09:44:22.623 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T09:44:22.632 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T09:44:22.675 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T09:44:22.727 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:44:22.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T09:44:22.819 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T09:44:22.825 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T09:44:22.872 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:44:22.872 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T09:44:22.944 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-05-10T09:44:22.947 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-05-10T09:44:23.035 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T09:44:23.043 INFO:teuthology.task.internal:Starting timer... 2024-05-10T09:44:23.043 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T09:44:23.131 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T09:44:23.176 DEBUG:teuthology.task.selinux:Excluding smithi042: OS 'ubuntu' does not support SELinux 2024-05-10T09:44:23.176 DEBUG:teuthology.task.selinux:Excluding smithi181: OS 'ubuntu' does not support SELinux 2024-05-10T09:44:23.176 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T09:44:23.176 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-10T09:44:23.176 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T09:44:23.176 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T09:44:23.252 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T09:44:23.270 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T09:44:23.272 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T09:51:29.685 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-05-10T09:51:29.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-10T09:51:29.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:51:29.770 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-05-10T09:51:29.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-10T09:51:29.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-10T09:51:29.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T09:51:29.927 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-05-10T09:51:30.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-05-10T09:51:30.002 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T09:51:30.013 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T09:51:30.013 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T09:51:30.014 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T09:51:30.016 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T09:51:30.016 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T09:51:30.040 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-10T09:51:30.040 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Command line: ntpd -gq 2024-05-10T09:51:30.040 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: ---------------------------------------------------- 2024-05-10T09:51:30.040 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: ntp-4 is maintained by Network Time Foundation, 2024-05-10T09:51:30.040 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-10T09:51:30.040 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: corporation. Support and training for ntp-4 are 2024-05-10T09:51:30.041 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: available at https://www.nwtime.org/support 2024-05-10T09:51:30.041 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: ---------------------------------------------------- 2024-05-10T09:51:30.041 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: proto: precision = 0.045 usec (-24) 2024-05-10T09:51:30.041 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: basedate set to 2022-02-04 2024-05-10T09:51:30.041 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: gps base set to 2022-02-06 (week 2196) 2024-05-10T09:51:30.041 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-10T09:51:30.042 INFO:teuthology.orchestra.run.smithi042.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-10T09:51:30.042 INFO:teuthology.orchestra.run.smithi042.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-10T09:51:30.044 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: restrict ::: KOD does nothing without LIMITED. 2024-05-10T09:51:30.044 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Listen and drop on 0 v6wildcard [::]:123 2024-05-10T09:51:30.044 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-10T09:51:30.044 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Listen normally on 2 lo 127.0.0.1:123 2024-05-10T09:51:30.044 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Listen normally on 3 ens1f0 172.21.15.42:123 2024-05-10T09:51:30.044 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Listen normally on 4 lo [::1]:123 2024-05-10T09:51:30.044 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1440%3]:123 2024-05-10T09:51:30.044 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:30 ntpd[17138]: Listening on routing socket on fd #22 for interface updates 2024-05-10T09:51:30.073 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-10T09:51:30.073 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Command line: ntpd -gq 2024-05-10T09:51:30.073 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: ---------------------------------------------------- 2024-05-10T09:51:30.073 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: ntp-4 is maintained by Network Time Foundation, 2024-05-10T09:51:30.073 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-10T09:51:30.073 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: corporation. Support and training for ntp-4 are 2024-05-10T09:51:30.074 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: available at https://www.nwtime.org/support 2024-05-10T09:51:30.074 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: ---------------------------------------------------- 2024-05-10T09:51:30.074 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: proto: precision = 0.065 usec (-24) 2024-05-10T09:51:30.074 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: basedate set to 2022-02-04 2024-05-10T09:51:30.075 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: gps base set to 2022-02-06 (week 2196) 2024-05-10T09:51:30.075 INFO:teuthology.orchestra.run.smithi181.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-10T09:51:30.075 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-10T09:51:30.075 INFO:teuthology.orchestra.run.smithi181.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-10T09:51:30.076 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: restrict ::: KOD does nothing without LIMITED. 2024-05-10T09:51:30.076 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Listen and drop on 0 v6wildcard [::]:123 2024-05-10T09:51:30.077 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-10T09:51:30.077 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Listen normally on 2 lo 127.0.0.1:123 2024-05-10T09:51:30.077 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Listen normally on 3 enp3s0f1 172.21.15.181:123 2024-05-10T09:51:30.077 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Listen normally on 4 lo [::1]:123 2024-05-10T09:51:30.077 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b9d%5]:123 2024-05-10T09:51:30.077 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:30 ntpd[17239]: Listening on routing socket on fd #22 for interface updates 2024-05-10T09:51:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:31 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:31.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:31 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:31.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:31 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:31.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:31 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:31.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:31 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:31.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:31 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:31.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:31 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:31.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:31 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:32 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:32 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:32 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:32 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:32 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:32.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:32 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:33 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:33 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:33 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:33 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:33 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:33.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:33 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:33.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:33.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:33.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:33.074 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:33.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:33.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:33.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:33.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:33.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:33.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:33.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:33.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:33 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:34.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:34.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:34.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:34.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:34.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:34.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:34.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:34.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:34.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:34.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:34.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:34.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:34 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:34.073 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:34 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:34.073 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:34 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:35 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:35.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:35 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:35 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:35.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:35 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:35 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:35.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:35 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:35.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:35.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:35.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:35.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:35.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:35 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:36.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:36.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:36 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:37.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:37 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:37.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:37 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:37.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:37 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:37.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:37 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:37.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:37 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:37.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:37 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:37.075 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stdout:10 May 09:51:37 ntpd[17239]: ntpd: time slew -0.001374 s 2024-05-10T09:51:37.076 INFO:teuthology.orchestra.run.smithi181.stdout:ntpd: time slew -0.001374s 2024-05-10T09:51:37.077 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-10T09:51:37.077 INFO:teuthology.orchestra.run.smithi181.stderr:10 May 09:51:37 ntpd[17239]: can't open /var/log/ntpstats/loopstats.20240510: Permission denied 2024-05-10T09:51:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: remote refid st t when poll reach delay offset jitter 2024-05-10T09:51:37.126 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================== 2024-05-10T09:51:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:51:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:51:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:51:37.126 INFO:teuthology.orchestra.run.smithi181.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:51:38.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:38.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:38.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:38.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:38.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-10T09:51:38.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: can't open /var/log/ntpstats/rawstats.20240510: Permission denied 2024-05-10T09:51:38.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-10T09:51:38.041 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: can't open /var/log/ntpstats/peerstats.20240510: Permission denied 2024-05-10T09:51:38.042 INFO:teuthology.orchestra.run.smithi042.stdout:10 May 09:51:38 ntpd[17138]: ntpd: time slew +0.002068 s 2024-05-10T09:51:38.042 INFO:teuthology.orchestra.run.smithi042.stdout:ntpd: time slew +0.002068s 2024-05-10T09:51:38.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-10T09:51:38.042 INFO:teuthology.orchestra.run.smithi042.stderr:10 May 09:51:38 ntpd[17138]: can't open /var/log/ntpstats/loopstats.20240510: Permission denied 2024-05-10T09:51:38.170 INFO:teuthology.orchestra.run.smithi042.stdout: remote refid st t when poll reach delay offset jitter 2024-05-10T09:51:38.171 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================== 2024-05-10T09:51:38.171 INFO:teuthology.orchestra.run.smithi042.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:51:38.171 INFO:teuthology.orchestra.run.smithi042.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:51:38.171 INFO:teuthology.orchestra.run.smithi042.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:51:38.171 INFO:teuthology.orchestra.run.smithi042.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:51:38.172 INFO:teuthology.run_tasks:Running task install... 2024-05-10T09:51:38.180 DEBUG:teuthology.task.install:project ceph 2024-05-10T09:51:38.181 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06'}} 2024-05-10T09:51:38.181 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06'} 2024-05-10T09:51:38.181 INFO:teuthology.task.install:Using flavor: default 2024-05-10T09:51:38.186 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T09:51:38.187 INFO:teuthology.task.install:extra packages: [] 2024-05-10T09:51:38.187 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-key list | grep Ceph 2024-05-10T09:51:38.187 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-key list | grep Ceph 2024-05-10T09:51:38.251 INFO:teuthology.orchestra.run.smithi181.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-10T09:51:38.277 INFO:teuthology.orchestra.run.smithi042.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-10T09:51:38.281 INFO:teuthology.orchestra.run.smithi181.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-10T09:51:38.281 INFO:teuthology.orchestra.run.smithi181.stdout:uid [ unknown] Ceph.com (release key) 2024-05-10T09:51:38.282 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-10T09:51:38.283 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be95034c7c2ad8a0361951b19205b782eb6be06 2024-05-10T09:51:38.307 INFO:teuthology.orchestra.run.smithi042.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-10T09:51:38.307 INFO:teuthology.orchestra.run.smithi042.stdout:uid [ unknown] Ceph.com (release key) 2024-05-10T09:51:38.308 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-10T09:51:38.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be95034c7c2ad8a0361951b19205b782eb6be06 2024-05-10T09:51:38.505 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default/ 2024-05-10T09:51:38.505 INFO:teuthology.task.install.deb:Package version is 19.0.0-3457-g5be95034-1jammy 2024-05-10T09:51:38.539 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default/ 2024-05-10T09:51:38.539 INFO:teuthology.task.install.deb:Package version is 19.0.0-3457-g5be95034-1jammy 2024-05-10T09:51:38.750 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:51:38.750 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-10T09:51:38.765 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:51:38.765 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-10T09:51:38.766 DEBUG:teuthology.orchestra.run.smithi042:> sudo apt-get update 2024-05-10T09:51:38.779 DEBUG:teuthology.orchestra.run.smithi181:> sudo apt-get update 2024-05-10T09:51:38.947 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T09:51:38.947 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-10T09:51:38.958 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-10T09:51:38.978 INFO:teuthology.orchestra.run.smithi181.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-10T09:51:39.063 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-10T09:51:39.063 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-10T09:51:39.089 INFO:teuthology.orchestra.run.smithi181.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy InRelease 2024-05-10T09:51:39.134 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-10T09:51:39.135 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-10T09:51:39.143 INFO:teuthology.orchestra.run.smithi042.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy InRelease 2024-05-10T09:51:39.180 INFO:teuthology.orchestra.run.smithi181.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-10T09:51:39.204 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-10T09:51:39.221 INFO:teuthology.orchestra.run.smithi042.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-10T09:51:39.225 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-10T09:51:39.269 INFO:teuthology.orchestra.run.smithi042.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-10T09:51:39.319 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-05-10T09:51:39.327 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-10T09:51:39.395 INFO:teuthology.orchestra.run.smithi042.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-05-10T09:51:39.398 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 29.2 kB in 0s (67.0 kB/s) 2024-05-10T09:51:39.470 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 29.2 kB in 1s (55.9 kB/s) 2024-05-10T09:51:40.364 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-05-10T09:51:40.379 DEBUG:teuthology.orchestra.run.smithi181:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3457-g5be95034-1jammy cephadm=19.0.0-3457-g5be95034-1jammy ceph-mds=19.0.0-3457-g5be95034-1jammy ceph-mgr=19.0.0-3457-g5be95034-1jammy ceph-common=19.0.0-3457-g5be95034-1jammy ceph-fuse=19.0.0-3457-g5be95034-1jammy ceph-test=19.0.0-3457-g5be95034-1jammy ceph-volume=19.0.0-3457-g5be95034-1jammy radosgw=19.0.0-3457-g5be95034-1jammy python3-rados=19.0.0-3457-g5be95034-1jammy python3-rgw=19.0.0-3457-g5be95034-1jammy python3-cephfs=19.0.0-3457-g5be95034-1jammy python3-rbd=19.0.0-3457-g5be95034-1jammy libcephfs2=19.0.0-3457-g5be95034-1jammy libcephfs-dev=19.0.0-3457-g5be95034-1jammy librados2=19.0.0-3457-g5be95034-1jammy librbd1=19.0.0-3457-g5be95034-1jammy rbd-fuse=19.0.0-3457-g5be95034-1jammy 2024-05-10T09:51:40.441 INFO:teuthology.orchestra.run.smithi181.stdout:Reading package lists... 2024-05-10T09:51:40.443 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-05-10T09:51:40.459 DEBUG:teuthology.orchestra.run.smithi042:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3457-g5be95034-1jammy cephadm=19.0.0-3457-g5be95034-1jammy ceph-mds=19.0.0-3457-g5be95034-1jammy ceph-mgr=19.0.0-3457-g5be95034-1jammy ceph-common=19.0.0-3457-g5be95034-1jammy ceph-fuse=19.0.0-3457-g5be95034-1jammy ceph-test=19.0.0-3457-g5be95034-1jammy ceph-volume=19.0.0-3457-g5be95034-1jammy radosgw=19.0.0-3457-g5be95034-1jammy python3-rados=19.0.0-3457-g5be95034-1jammy python3-rgw=19.0.0-3457-g5be95034-1jammy python3-cephfs=19.0.0-3457-g5be95034-1jammy python3-rbd=19.0.0-3457-g5be95034-1jammy libcephfs2=19.0.0-3457-g5be95034-1jammy libcephfs-dev=19.0.0-3457-g5be95034-1jammy librados2=19.0.0-3457-g5be95034-1jammy librbd1=19.0.0-3457-g5be95034-1jammy rbd-fuse=19.0.0-3457-g5be95034-1jammy 2024-05-10T09:51:40.521 INFO:teuthology.orchestra.run.smithi042.stdout:Reading package lists... 2024-05-10T09:51:40.641 INFO:teuthology.orchestra.run.smithi181.stdout:Building dependency tree... 2024-05-10T09:51:40.642 INFO:teuthology.orchestra.run.smithi181.stdout:Reading state information... 2024-05-10T09:51:40.726 INFO:teuthology.orchestra.run.smithi042.stdout:Building dependency tree... 2024-05-10T09:51:40.727 INFO:teuthology.orchestra.run.smithi042.stdout:Reading state information... 2024-05-10T09:51:40.836 INFO:teuthology.orchestra.run.smithi181.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T09:51:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T09:51:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T09:51:40.836 INFO:teuthology.orchestra.run.smithi181.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T09:51:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-10T09:51:40.837 INFO:teuthology.orchestra.run.smithi181.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-10T09:51:40.837 INFO:teuthology.orchestra.run.smithi181.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T09:51:40.838 INFO:teuthology.orchestra.run.smithi181.stdout:The following additional packages will be installed: 2024-05-10T09:51:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-10T09:51:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-10T09:51:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-10T09:51:40.838 INFO:teuthology.orchestra.run.smithi181.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-10T09:51:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-10T09:51:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-10T09:51:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-10T09:51:40.839 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-10T09:51:40.840 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet zip 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout:Suggested packages: 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-10T09:51:40.841 INFO:teuthology.orchestra.run.smithi181.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-10T09:51:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-10T09:51:40.842 INFO:teuthology.orchestra.run.smithi181.stdout:Recommended packages: 2024-05-10T09:51:40.842 INFO:teuthology.orchestra.run.smithi181.stdout: btrfs-tools 2024-05-10T09:51:40.932 INFO:teuthology.orchestra.run.smithi042.stdout:The following packages were automatically installed and are no longer required: 2024-05-10T09:51:40.932 INFO:teuthology.orchestra.run.smithi042.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-10T09:51:40.932 INFO:teuthology.orchestra.run.smithi042.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-10T09:51:40.932 INFO:teuthology.orchestra.run.smithi042.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-10T09:51:40.933 INFO:teuthology.orchestra.run.smithi042.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-10T09:51:40.933 INFO:teuthology.orchestra.run.smithi042.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-10T09:51:40.933 INFO:teuthology.orchestra.run.smithi042.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-10T09:51:40.934 INFO:teuthology.orchestra.run.smithi042.stdout:The following additional packages will be installed: 2024-05-10T09:51:40.934 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-10T09:51:40.935 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-10T09:51:40.935 INFO:teuthology.orchestra.run.smithi042.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-10T09:51:40.935 INFO:teuthology.orchestra.run.smithi042.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-10T09:51:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet zip 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout:Suggested packages: 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-10T09:51:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-10T09:51:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-10T09:51:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-10T09:51:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-10T09:51:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-10T09:51:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-10T09:51:40.938 INFO:teuthology.orchestra.run.smithi042.stdout:Recommended packages: 2024-05-10T09:51:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: btrfs-tools 2024-05-10T09:51:40.942 INFO:teuthology.orchestra.run.smithi181.stdout:The following NEW packages will be installed: 2024-05-10T09:51:40.943 INFO:teuthology.orchestra.run.smithi181.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-10T09:51:40.943 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-10T09:51:40.943 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-10T09:51:40.944 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-10T09:51:40.945 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-10T09:51:40.946 INFO:teuthology.orchestra.run.smithi181.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-10T09:51:41.043 INFO:teuthology.orchestra.run.smithi042.stdout:The following NEW packages will be installed: 2024-05-10T09:51:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-10T09:51:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-10T09:51:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-10T09:51:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-10T09:51:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-10T09:51:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-10T09:51:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-10T09:51:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-10T09:51:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-10T09:51:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-10T09:51:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-10T09:51:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-10T09:51:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-10T09:51:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-10T09:51:41.131 INFO:teuthology.orchestra.run.smithi181.stdout:0 upgraded, 118 newly installed, 0 to remove and 307 not upgraded. 2024-05-10T09:51:41.131 INFO:teuthology.orchestra.run.smithi181.stdout:Need to get 181 MB of archives. 2024-05-10T09:51:41.131 INFO:teuthology.orchestra.run.smithi181.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-10T09:51:41.132 INFO:teuthology.orchestra.run.smithi181.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-10T09:51:41.229 INFO:teuthology.orchestra.run.smithi042.stdout:0 upgraded, 118 newly installed, 0 to remove and 307 not upgraded. 2024-05-10T09:51:41.229 INFO:teuthology.orchestra.run.smithi042.stdout:Need to get 181 MB of archives. 2024-05-10T09:51:41.229 INFO:teuthology.orchestra.run.smithi042.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-10T09:51:41.229 INFO:teuthology.orchestra.run.smithi042.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3457-g5be95034-1jammy [3,558 kB] 2024-05-10T09:51:41.234 INFO:teuthology.orchestra.run.smithi042.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-10T09:51:41.368 INFO:teuthology.orchestra.run.smithi181.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3457-g5be95034-1jammy [3,558 kB] 2024-05-10T09:51:41.551 INFO:teuthology.orchestra.run.smithi181.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-10T09:51:41.569 INFO:teuthology.orchestra.run.smithi181.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-10T09:51:41.648 INFO:teuthology.orchestra.run.smithi181.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-10T09:51:41.654 INFO:teuthology.orchestra.run.smithi042.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-10T09:51:41.667 INFO:teuthology.orchestra.run.smithi042.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-10T09:51:41.745 INFO:teuthology.orchestra.run.smithi042.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3457-g5be95034-1jammy [3,223 kB] 2024-05-10T09:51:41.748 INFO:teuthology.orchestra.run.smithi042.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-10T09:51:41.878 INFO:teuthology.orchestra.run.smithi181.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-10T09:51:41.889 INFO:teuthology.orchestra.run.smithi181.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-10T09:51:41.919 INFO:teuthology.orchestra.run.smithi181.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-10T09:51:41.928 INFO:teuthology.orchestra.run.smithi181.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-10T09:51:41.929 INFO:teuthology.orchestra.run.smithi181.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-10T09:51:41.931 INFO:teuthology.orchestra.run.smithi181.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-10T09:51:41.949 INFO:teuthology.orchestra.run.smithi181.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-10T09:51:41.978 INFO:teuthology.orchestra.run.smithi042.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-10T09:51:41.989 INFO:teuthology.orchestra.run.smithi042.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-10T09:51:42.019 INFO:teuthology.orchestra.run.smithi042.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-10T09:51:42.028 INFO:teuthology.orchestra.run.smithi042.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-10T09:51:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-10T09:51:42.031 INFO:teuthology.orchestra.run.smithi042.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-10T09:51:42.049 INFO:teuthology.orchestra.run.smithi042.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-10T09:51:42.053 INFO:teuthology.orchestra.run.smithi042.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3457-g5be95034-1jammy [713 kB] 2024-05-10T09:51:42.111 INFO:teuthology.orchestra.run.smithi042.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3457-g5be95034-1jammy [356 kB] 2024-05-10T09:51:42.117 INFO:teuthology.orchestra.run.smithi181.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-10T09:51:42.123 INFO:teuthology.orchestra.run.smithi042.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3457-g5be95034-1jammy [32.8 kB] 2024-05-10T09:51:42.125 INFO:teuthology.orchestra.run.smithi042.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3457-g5be95034-1jammy [180 kB] 2024-05-10T09:51:42.164 INFO:teuthology.orchestra.run.smithi042.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3457-g5be95034-1jammy [67.4 kB] 2024-05-10T09:51:42.166 INFO:teuthology.orchestra.run.smithi042.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3457-g5be95034-1jammy [330 kB] 2024-05-10T09:51:42.178 INFO:teuthology.orchestra.run.smithi042.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3457-g5be95034-1jammy [6,896 kB] 2024-05-10T09:51:42.221 INFO:teuthology.orchestra.run.smithi042.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-10T09:51:42.527 INFO:teuthology.orchestra.run.smithi181.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-10T09:51:42.560 INFO:teuthology.orchestra.run.smithi181.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-10T09:51:42.562 INFO:teuthology.orchestra.run.smithi181.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-10T09:51:42.638 INFO:teuthology.orchestra.run.smithi042.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-10T09:51:42.643 INFO:teuthology.orchestra.run.smithi181.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-10T09:51:42.673 INFO:teuthology.orchestra.run.smithi042.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-10T09:51:42.675 INFO:teuthology.orchestra.run.smithi042.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-10T09:51:42.693 INFO:teuthology.orchestra.run.smithi181.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-10T09:51:42.704 INFO:teuthology.orchestra.run.smithi042.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3457-g5be95034-1jammy [112 kB] 2024-05-10T09:51:42.707 INFO:teuthology.orchestra.run.smithi042.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3457-g5be95034-1jammy [466 kB] 2024-05-10T09:51:42.715 INFO:teuthology.orchestra.run.smithi181.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-10T09:51:42.722 INFO:teuthology.orchestra.run.smithi181.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-10T09:51:42.723 INFO:teuthology.orchestra.run.smithi181.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-10T09:51:42.735 INFO:teuthology.orchestra.run.smithi181.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-10T09:51:42.735 INFO:teuthology.orchestra.run.smithi181.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-10T09:51:42.756 INFO:teuthology.orchestra.run.smithi042.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-10T09:51:42.759 INFO:teuthology.orchestra.run.smithi042.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3457-g5be95034-1jammy [25.8 MB] 2024-05-10T09:51:42.806 INFO:teuthology.orchestra.run.smithi042.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-10T09:51:42.828 INFO:teuthology.orchestra.run.smithi042.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-10T09:51:42.834 INFO:teuthology.orchestra.run.smithi042.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-10T09:51:42.836 INFO:teuthology.orchestra.run.smithi042.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-10T09:51:42.847 INFO:teuthology.orchestra.run.smithi042.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-10T09:51:42.848 INFO:teuthology.orchestra.run.smithi042.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-10T09:51:42.901 INFO:teuthology.orchestra.run.smithi181.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-10T09:51:42.953 INFO:teuthology.orchestra.run.smithi181.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3457-g5be95034-1jammy [3,223 kB] 2024-05-10T09:51:42.984 INFO:teuthology.orchestra.run.smithi181.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-10T09:51:43.012 INFO:teuthology.orchestra.run.smithi181.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-10T09:51:43.014 INFO:teuthology.orchestra.run.smithi042.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-10T09:51:43.029 INFO:teuthology.orchestra.run.smithi181.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-10T09:51:43.074 INFO:teuthology.orchestra.run.smithi181.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-10T09:51:43.097 INFO:teuthology.orchestra.run.smithi042.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-10T09:51:43.126 INFO:teuthology.orchestra.run.smithi042.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-10T09:51:43.143 INFO:teuthology.orchestra.run.smithi042.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-10T09:51:43.187 INFO:teuthology.orchestra.run.smithi042.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-10T09:51:43.285 INFO:teuthology.orchestra.run.smithi181.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-10T09:51:43.300 INFO:teuthology.orchestra.run.smithi181.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-10T09:51:43.308 INFO:teuthology.orchestra.run.smithi181.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-10T09:51:43.312 INFO:teuthology.orchestra.run.smithi181.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-10T09:51:43.333 INFO:teuthology.orchestra.run.smithi181.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-10T09:51:43.337 INFO:teuthology.orchestra.run.smithi181.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-10T09:51:43.398 INFO:teuthology.orchestra.run.smithi042.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-10T09:51:43.413 INFO:teuthology.orchestra.run.smithi042.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-10T09:51:43.421 INFO:teuthology.orchestra.run.smithi042.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-10T09:51:43.426 INFO:teuthology.orchestra.run.smithi042.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-10T09:51:43.447 INFO:teuthology.orchestra.run.smithi042.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-10T09:51:43.450 INFO:teuthology.orchestra.run.smithi042.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-10T09:51:43.503 INFO:teuthology.orchestra.run.smithi181.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-10T09:51:43.617 INFO:teuthology.orchestra.run.smithi042.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-10T09:51:43.834 INFO:teuthology.orchestra.run.smithi181.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-10T09:51:43.873 INFO:teuthology.orchestra.run.smithi181.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-10T09:51:43.886 INFO:teuthology.orchestra.run.smithi181.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-10T09:51:43.915 INFO:teuthology.orchestra.run.smithi181.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3457-g5be95034-1jammy [713 kB] 2024-05-10T09:51:43.950 INFO:teuthology.orchestra.run.smithi042.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-10T09:51:43.982 INFO:teuthology.orchestra.run.smithi042.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-10T09:51:43.993 INFO:teuthology.orchestra.run.smithi042.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-10T09:51:44.093 INFO:teuthology.orchestra.run.smithi181.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-10T09:51:44.094 INFO:teuthology.orchestra.run.smithi181.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-10T09:51:44.100 INFO:teuthology.orchestra.run.smithi181.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-10T09:51:44.105 INFO:teuthology.orchestra.run.smithi181.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-10T09:51:44.120 INFO:teuthology.orchestra.run.smithi181.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-10T09:51:44.141 INFO:teuthology.orchestra.run.smithi181.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-10T09:51:44.147 INFO:teuthology.orchestra.run.smithi181.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-10T09:51:44.158 INFO:teuthology.orchestra.run.smithi181.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3457-g5be95034-1jammy [356 kB] 2024-05-10T09:51:44.194 INFO:teuthology.orchestra.run.smithi042.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-10T09:51:44.196 INFO:teuthology.orchestra.run.smithi042.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-10T09:51:44.202 INFO:teuthology.orchestra.run.smithi042.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-10T09:51:44.208 INFO:teuthology.orchestra.run.smithi042.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-10T09:51:44.222 INFO:teuthology.orchestra.run.smithi042.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-10T09:51:44.244 INFO:teuthology.orchestra.run.smithi042.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-10T09:51:44.245 INFO:teuthology.orchestra.run.smithi181.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3457-g5be95034-1jammy [32.8 kB] 2024-05-10T09:51:44.246 INFO:teuthology.orchestra.run.smithi181.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3457-g5be95034-1jammy [180 kB] 2024-05-10T09:51:44.250 INFO:teuthology.orchestra.run.smithi042.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-10T09:51:44.313 INFO:teuthology.orchestra.run.smithi181.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3457-g5be95034-1jammy [67.4 kB] 2024-05-10T09:51:44.315 INFO:teuthology.orchestra.run.smithi181.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3457-g5be95034-1jammy [330 kB] 2024-05-10T09:51:44.322 INFO:teuthology.orchestra.run.smithi181.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-10T09:51:44.425 INFO:teuthology.orchestra.run.smithi042.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-10T09:51:44.446 INFO:teuthology.orchestra.run.smithi181.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3457-g5be95034-1jammy [6,896 kB] 2024-05-10T09:51:44.586 INFO:teuthology.orchestra.run.smithi181.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-10T09:51:44.603 INFO:teuthology.orchestra.run.smithi042.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3457-g5be95034-1jammy [5,093 kB] 2024-05-10T09:51:44.689 INFO:teuthology.orchestra.run.smithi042.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-10T09:51:44.763 INFO:teuthology.orchestra.run.smithi181.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-10T09:51:44.777 INFO:teuthology.orchestra.run.smithi181.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-10T09:51:44.797 INFO:teuthology.orchestra.run.smithi181.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-10T09:51:44.841 INFO:teuthology.orchestra.run.smithi042.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3457-g5be95034-1jammy [244 kB] 2024-05-10T09:51:44.860 INFO:teuthology.orchestra.run.smithi181.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-10T09:51:44.866 INFO:teuthology.orchestra.run.smithi042.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-10T09:51:44.868 INFO:teuthology.orchestra.run.smithi042.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3457-g5be95034-1jammy [124 kB] 2024-05-10T09:51:44.873 INFO:teuthology.orchestra.run.smithi042.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3457-g5be95034-1jammy [1,544 kB] 2024-05-10T09:51:44.880 INFO:teuthology.orchestra.run.smithi042.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-10T09:51:44.900 INFO:teuthology.orchestra.run.smithi042.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-10T09:51:44.964 INFO:teuthology.orchestra.run.smithi042.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-10T09:51:44.976 INFO:teuthology.orchestra.run.smithi042.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3457-g5be95034-1jammy [6,258 kB] 2024-05-10T09:51:45.148 INFO:teuthology.orchestra.run.smithi181.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-10T09:51:45.150 INFO:teuthology.orchestra.run.smithi181.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-10T09:51:45.153 INFO:teuthology.orchestra.run.smithi181.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-10T09:51:45.153 INFO:teuthology.orchestra.run.smithi181.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-10T09:51:45.156 INFO:teuthology.orchestra.run.smithi181.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-10T09:51:45.252 INFO:teuthology.orchestra.run.smithi042.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-10T09:51:45.253 INFO:teuthology.orchestra.run.smithi042.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-10T09:51:45.259 INFO:teuthology.orchestra.run.smithi042.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-10T09:51:45.276 INFO:teuthology.orchestra.run.smithi042.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-10T09:51:45.277 INFO:teuthology.orchestra.run.smithi042.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-10T09:51:45.387 INFO:teuthology.orchestra.run.smithi181.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-10T09:51:45.393 INFO:teuthology.orchestra.run.smithi042.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3457-g5be95034-1jammy [22.8 MB] 2024-05-10T09:51:45.482 INFO:teuthology.orchestra.run.smithi042.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-10T09:51:45.824 INFO:teuthology.orchestra.run.smithi181.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-10T09:51:45.831 INFO:teuthology.orchestra.run.smithi181.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-10T09:51:45.912 INFO:teuthology.orchestra.run.smithi042.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-10T09:51:45.918 INFO:teuthology.orchestra.run.smithi042.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-10T09:51:46.121 INFO:teuthology.orchestra.run.smithi181.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-10T09:51:46.121 INFO:teuthology.orchestra.run.smithi181.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-10T09:51:46.124 INFO:teuthology.orchestra.run.smithi181.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-10T09:51:46.126 INFO:teuthology.orchestra.run.smithi181.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-10T09:51:46.127 INFO:teuthology.orchestra.run.smithi181.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-10T09:51:46.129 INFO:teuthology.orchestra.run.smithi181.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-10T09:51:46.130 INFO:teuthology.orchestra.run.smithi181.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-10T09:51:46.132 INFO:teuthology.orchestra.run.smithi181.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-10T09:51:46.208 INFO:teuthology.orchestra.run.smithi042.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-10T09:51:46.208 INFO:teuthology.orchestra.run.smithi042.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-10T09:51:46.210 INFO:teuthology.orchestra.run.smithi042.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-10T09:51:46.212 INFO:teuthology.orchestra.run.smithi042.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-10T09:51:46.213 INFO:teuthology.orchestra.run.smithi042.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-10T09:51:46.215 INFO:teuthology.orchestra.run.smithi042.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-10T09:51:46.221 INFO:teuthology.orchestra.run.smithi042.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-10T09:51:46.222 INFO:teuthology.orchestra.run.smithi042.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-10T09:51:46.313 INFO:teuthology.orchestra.run.smithi181.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-10T09:51:46.400 INFO:teuthology.orchestra.run.smithi042.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-10T09:51:46.519 INFO:teuthology.orchestra.run.smithi181.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3457-g5be95034-1jammy [112 kB] 2024-05-10T09:51:46.522 INFO:teuthology.orchestra.run.smithi181.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3457-g5be95034-1jammy [466 kB] 2024-05-10T09:51:46.678 INFO:teuthology.orchestra.run.smithi181.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3457-g5be95034-1jammy [25.8 MB] 2024-05-10T09:51:46.728 INFO:teuthology.orchestra.run.smithi181.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-10T09:51:46.776 INFO:teuthology.orchestra.run.smithi181.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-10T09:51:46.810 INFO:teuthology.orchestra.run.smithi181.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-10T09:51:46.814 INFO:teuthology.orchestra.run.smithi042.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-10T09:51:46.860 INFO:teuthology.orchestra.run.smithi042.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-10T09:51:46.897 INFO:teuthology.orchestra.run.smithi042.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-10T09:51:46.907 INFO:teuthology.orchestra.run.smithi181.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-10T09:51:46.947 INFO:teuthology.orchestra.run.smithi181.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-10T09:51:46.958 INFO:teuthology.orchestra.run.smithi181.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-10T09:51:46.965 INFO:teuthology.orchestra.run.smithi181.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-10T09:51:46.996 INFO:teuthology.orchestra.run.smithi042.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-10T09:51:46.998 INFO:teuthology.orchestra.run.smithi042.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3457-g5be95034-1jammy [14.0 kB] 2024-05-10T09:51:46.998 INFO:teuthology.orchestra.run.smithi042.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3457-g5be95034-1jammy [870 kB] 2024-05-10T09:51:47.011 INFO:teuthology.orchestra.run.smithi181.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-10T09:51:47.014 INFO:teuthology.orchestra.run.smithi181.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-10T09:51:47.016 INFO:teuthology.orchestra.run.smithi042.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3457-g5be95034-1jammy [2,439 kB] 2024-05-10T09:51:47.032 INFO:teuthology.orchestra.run.smithi042.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-10T09:51:47.035 INFO:teuthology.orchestra.run.smithi181.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-10T09:51:47.043 INFO:teuthology.orchestra.run.smithi042.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-10T09:51:47.049 INFO:teuthology.orchestra.run.smithi042.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-10T09:51:47.096 INFO:teuthology.orchestra.run.smithi042.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-10T09:51:47.099 INFO:teuthology.orchestra.run.smithi042.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-10T09:51:47.120 INFO:teuthology.orchestra.run.smithi042.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-10T09:51:47.125 INFO:teuthology.orchestra.run.smithi042.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3457-g5be95034-1jammy [792 kB] 2024-05-10T09:51:47.164 INFO:teuthology.orchestra.run.smithi042.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3457-g5be95034-1jammy [148 kB] 2024-05-10T09:51:47.168 INFO:teuthology.orchestra.run.smithi042.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3457-g5be95034-1jammy [2,297 kB] 2024-05-10T09:51:47.201 INFO:teuthology.orchestra.run.smithi181.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-10T09:51:47.285 INFO:teuthology.orchestra.run.smithi042.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-10T09:51:47.311 INFO:teuthology.orchestra.run.smithi042.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3457-g5be95034-1jammy [8,625 kB] 2024-05-10T09:51:47.466 INFO:teuthology.orchestra.run.smithi181.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-10T09:51:47.485 INFO:teuthology.orchestra.run.smithi181.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-10T09:51:47.559 INFO:teuthology.orchestra.run.smithi042.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-10T09:51:47.577 INFO:teuthology.orchestra.run.smithi042.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-10T09:51:47.637 INFO:teuthology.orchestra.run.smithi181.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-10T09:51:47.665 INFO:teuthology.orchestra.run.smithi181.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-10T09:51:47.732 INFO:teuthology.orchestra.run.smithi042.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-10T09:51:47.761 INFO:teuthology.orchestra.run.smithi042.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-10T09:51:47.813 INFO:teuthology.orchestra.run.smithi042.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3457-g5be95034-1jammy [14.2 kB] 2024-05-10T09:51:47.814 INFO:teuthology.orchestra.run.smithi042.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3457-g5be95034-1jammy [51.7 MB] 2024-05-10T09:51:47.823 INFO:teuthology.orchestra.run.smithi181.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-10T09:51:47.825 INFO:teuthology.orchestra.run.smithi181.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-10T09:51:47.827 INFO:teuthology.orchestra.run.smithi181.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-10T09:51:47.849 INFO:teuthology.orchestra.run.smithi181.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-10T09:51:47.854 INFO:teuthology.orchestra.run.smithi181.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-10T09:51:47.918 INFO:teuthology.orchestra.run.smithi042.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-10T09:51:47.922 INFO:teuthology.orchestra.run.smithi042.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-10T09:51:47.923 INFO:teuthology.orchestra.run.smithi042.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-10T09:51:47.946 INFO:teuthology.orchestra.run.smithi042.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-10T09:51:47.951 INFO:teuthology.orchestra.run.smithi042.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-10T09:51:50.973 INFO:teuthology.orchestra.run.smithi042.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3457-g5be95034-1jammy [124 kB] 2024-05-10T09:51:50.975 INFO:teuthology.orchestra.run.smithi042.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3457-g5be95034-1jammy [38.9 kB] 2024-05-10T09:51:50.976 INFO:teuthology.orchestra.run.smithi042.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3457-g5be95034-1jammy [13.6 MB] 2024-05-10T09:51:51.477 INFO:teuthology.orchestra.run.smithi042.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3457-g5be95034-1jammy [91.4 kB] 2024-05-10T09:51:52.066 INFO:teuthology.orchestra.run.smithi042.stdout:Fetched 181 MB in 10s (17.4 MB/s) 2024-05-10T09:51:52.209 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-10T09:51:52.311 INFO:teuthology.orchestra.run.smithi042.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-10T09:51:52.318 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-10T09:51:52.399 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-10T09:51:52.509 INFO:teuthology.orchestra.run.smithi181.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3457-g5be95034-1jammy [5,093 kB] 2024-05-10T09:51:52.803 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-10T09:51:52.829 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-10T09:51:52.861 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-10T09:51:52.868 INFO:teuthology.orchestra.run.smithi181.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3457-g5be95034-1jammy [244 kB] 2024-05-10T09:51:52.888 INFO:teuthology.orchestra.run.smithi181.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3457-g5be95034-1jammy [124 kB] 2024-05-10T09:51:52.905 INFO:teuthology.orchestra.run.smithi181.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3457-g5be95034-1jammy [1,544 kB] 2024-05-10T09:51:53.022 INFO:teuthology.orchestra.run.smithi181.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3457-g5be95034-1jammy [6,258 kB] 2024-05-10T09:51:53.197 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-10T09:51:53.224 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-10T09:51:53.264 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-10T09:51:53.502 INFO:teuthology.orchestra.run.smithi181.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3457-g5be95034-1jammy [22.8 MB] 2024-05-10T09:51:54.118 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-10T09:51:54.145 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T09:51:54.193 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:51:54.554 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-10T09:51:54.581 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T09:51:54.621 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:51:54.983 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-10T09:51:55.009 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T09:51:55.058 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:51:55.083 INFO:teuthology.orchestra.run.smithi181.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3457-g5be95034-1jammy [14.0 kB] 2024-05-10T09:51:55.083 INFO:teuthology.orchestra.run.smithi181.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3457-g5be95034-1jammy [870 kB] 2024-05-10T09:51:55.106 INFO:teuthology.orchestra.run.smithi181.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3457-g5be95034-1jammy [2,439 kB] 2024-05-10T09:51:55.250 INFO:teuthology.orchestra.run.smithi181.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3457-g5be95034-1jammy [792 kB] 2024-05-10T09:51:55.292 INFO:teuthology.orchestra.run.smithi181.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3457-g5be95034-1jammy [148 kB] 2024-05-10T09:51:55.306 INFO:teuthology.orchestra.run.smithi181.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3457-g5be95034-1jammy [2,297 kB] 2024-05-10T09:51:55.369 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-10T09:51:55.385 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-10T09:51:55.419 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-10T09:51:55.435 INFO:teuthology.orchestra.run.smithi181.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3457-g5be95034-1jammy [8,625 kB] 2024-05-10T09:51:55.731 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package librados2. 2024-05-10T09:51:55.757 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../007-librados2_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:51:55.797 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librados2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:51:55.918 INFO:teuthology.orchestra.run.smithi181.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3457-g5be95034-1jammy [14.2 kB] 2024-05-10T09:51:55.918 INFO:teuthology.orchestra.run.smithi181.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3457-g5be95034-1jammy [51.7 MB] 2024-05-10T09:51:56.259 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package librbd1. 2024-05-10T09:51:56.285 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../008-librbd1_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:51:56.325 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librbd1 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:51:56.737 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libcephfs2. 2024-05-10T09:51:56.763 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:51:56.803 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libcephfs2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:51:57.056 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rados. 2024-05-10T09:51:57.082 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:51:57.122 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rados (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:51:57.459 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-10T09:51:57.486 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:51:57.525 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-ceph-argparse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:51:57.795 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cephfs. 2024-05-10T09:51:57.822 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:51:57.861 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cephfs (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:51:58.156 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-10T09:51:58.183 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:51:58.214 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-ceph-common (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:51:58.551 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-10T09:51:58.578 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-10T09:51:58.618 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-10T09:51:58.681 INFO:teuthology.orchestra.run.smithi181.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3457-g5be95034-1jammy [124 kB] 2024-05-10T09:51:58.684 INFO:teuthology.orchestra.run.smithi181.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3457-g5be95034-1jammy [38.9 kB] 2024-05-10T09:51:58.685 INFO:teuthology.orchestra.run.smithi181.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3457-g5be95034-1jammy [13.6 MB] 2024-05-10T09:51:58.937 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-prettytable. 2024-05-10T09:51:58.964 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-10T09:51:59.054 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-10T09:51:59.259 INFO:teuthology.orchestra.run.smithi181.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-skoduri-lc-notify/5be95034c7c2ad8a0361951b19205b782eb6be06/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3457-g5be95034-1jammy [91.4 kB] 2024-05-10T09:51:59.315 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rbd. 2024-05-10T09:51:59.331 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:51:59.373 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rbd (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:51:59.693 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-10T09:51:59.709 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-10T09:51:59.743 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-10T09:51:59.818 INFO:teuthology.orchestra.run.smithi181.stdout:Fetched 181 MB in 18s (9,894 kB/s) 2024-05-10T09:51:59.953 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-10T09:52:00.013 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-10T09:52:00.028 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-10T09:52:00.040 INFO:teuthology.orchestra.run.smithi181.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-10T09:52:00.046 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-10T09:52:00.071 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-10T09:52:00.109 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-10T09:52:00.384 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-10T09:52:00.460 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-10T09:52:00.460 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-10T09:52:00.461 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-10T09:52:00.461 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-10T09:52:00.481 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-10T09:52:00.769 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package lua5.1. 2024-05-10T09:52:00.796 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-10T09:52:00.808 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-10T09:52:00.827 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-10T09:52:00.834 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-10T09:52:00.874 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-10T09:52:01.139 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package lua-any. 2024-05-10T09:52:01.155 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-10T09:52:01.197 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-10T09:52:01.261 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-10T09:52:01.287 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T09:52:01.326 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:52:01.433 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package zip. 2024-05-10T09:52:01.460 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-10T09:52:01.508 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking zip (3.0-12build2) ... 2024-05-10T09:52:01.722 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-10T09:52:01.748 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T09:52:01.789 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:52:01.837 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package unzip. 2024-05-10T09:52:01.863 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-10T09:52:01.903 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-10T09:52:02.126 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-10T09:52:02.152 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-10T09:52:02.192 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:52:02.266 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package luarocks. 2024-05-10T09:52:02.292 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-10T09:52:02.332 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-10T09:52:02.520 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-10T09:52:02.546 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-10T09:52:02.578 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-10T09:52:02.707 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package librgw2. 2024-05-10T09:52:02.734 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../025-librgw2_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:02.774 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking librgw2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:02.881 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librados2. 2024-05-10T09:52:02.907 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../007-librados2_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:02.947 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librados2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:03.318 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rgw. 2024-05-10T09:52:03.334 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:03.401 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rgw (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:03.634 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librbd1. 2024-05-10T09:52:03.660 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../008-librbd1_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:03.700 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librbd1 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:03.746 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-10T09:52:03.773 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-10T09:52:03.812 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-10T09:52:04.107 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libradosstriper1. 2024-05-10T09:52:04.134 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:04.153 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcephfs2. 2024-05-10T09:52:04.174 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libradosstriper1 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:04.179 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:04.220 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcephfs2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:04.464 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rados. 2024-05-10T09:52:04.479 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:04.514 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rados (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:04.544 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-common. 2024-05-10T09:52:04.571 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:04.602 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-common (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:04.817 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-10T09:52:04.843 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:04.883 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-ceph-argparse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:05.161 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cephfs. 2024-05-10T09:52:05.187 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:05.227 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cephfs (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:05.539 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-10T09:52:05.565 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:05.605 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-ceph-common (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:05.942 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-10T09:52:05.968 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-10T09:52:06.000 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-10T09:52:06.066 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-base. 2024-05-10T09:52:06.093 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:06.143 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-base (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:06.269 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-prettytable. 2024-05-10T09:52:06.295 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-10T09:52:06.335 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-10T09:52:06.597 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rbd. 2024-05-10T09:52:06.612 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:06.655 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rbd (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:06.738 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-10T09:52:06.764 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-10T09:52:06.804 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-10T09:52:06.991 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-10T09:52:07.018 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-10T09:52:07.058 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-10T09:52:07.090 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cheroot. 2024-05-10T09:52:07.117 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-10T09:52:07.157 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-10T09:52:07.335 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-10T09:52:07.350 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-10T09:52:07.393 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-10T09:52:07.494 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-10T09:52:07.520 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-10T09:52:07.560 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-10T09:52:07.680 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-10T09:52:07.706 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-10T09:52:07.738 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-10T09:52:07.830 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-10T09:52:07.857 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-10T09:52:07.888 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-10T09:52:08.067 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package lua5.1. 2024-05-10T09:52:08.093 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-10T09:52:08.133 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-10T09:52:08.191 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-10T09:52:08.218 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-10T09:52:08.257 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-10T09:52:08.561 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-tempora. 2024-05-10T09:52:08.588 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-10T09:52:08.627 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-10T09:52:08.627 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package lua-any. 2024-05-10T09:52:08.643 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-10T09:52:08.708 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-10T09:52:08.930 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-portend. 2024-05-10T09:52:08.938 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package zip. 2024-05-10T09:52:08.946 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-10T09:52:08.954 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-10T09:52:08.980 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-10T09:52:08.989 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking zip (3.0-12build2) ... 2024-05-10T09:52:09.275 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package unzip. 2024-05-10T09:52:09.301 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-10T09:52:09.341 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-10T09:52:09.533 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-10T09:52:09.560 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-10T09:52:09.600 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-10T09:52:09.729 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package luarocks. 2024-05-10T09:52:09.755 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-10T09:52:09.795 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-10T09:52:09.886 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-10T09:52:09.913 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-10T09:52:09.953 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-10T09:52:10.186 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package librgw2. 2024-05-10T09:52:10.213 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../025-librgw2_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:10.253 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking librgw2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:10.307 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-natsort. 2024-05-10T09:52:10.334 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-10T09:52:10.373 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-10T09:52:10.660 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-logutils. 2024-05-10T09:52:10.676 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-10T09:52:10.710 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-10T09:52:10.780 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rgw. 2024-05-10T09:52:10.795 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:10.830 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rgw (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:10.980 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-10T09:52:11.006 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-10T09:52:11.046 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-10T09:52:11.150 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-10T09:52:11.176 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-10T09:52:11.216 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-10T09:52:11.349 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-mako. 2024-05-10T09:52:11.376 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-10T09:52:11.416 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-10T09:52:11.553 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libradosstriper1. 2024-05-10T09:52:11.579 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:11.619 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libradosstriper1 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:11.753 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-10T09:52:11.779 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-10T09:52:11.819 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-10T09:52:11.981 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-common. 2024-05-10T09:52:12.007 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:12.047 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-common (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:12.097 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-10T09:52:12.113 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-10T09:52:12.148 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-10T09:52:12.416 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-webob. 2024-05-10T09:52:12.443 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-10T09:52:12.483 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-10T09:52:12.845 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-waitress. 2024-05-10T09:52:12.874 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-10T09:52:12.914 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-10T09:52:13.240 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-tempita. 2024-05-10T09:52:13.266 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-10T09:52:13.306 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-10T09:52:13.634 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-paste. 2024-05-10T09:52:13.661 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-10T09:52:13.700 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-10T09:52:14.022 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-10T09:52:14.038 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-10T09:52:14.262 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-base. 2024-05-10T09:52:14.288 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:14.338 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-base (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:14.356 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-10T09:52:14.925 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-10T09:52:14.950 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-10T09:52:14.990 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-10T09:52:15.226 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-10T09:52:15.250 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-10T09:52:15.277 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cheroot. 2024-05-10T09:52:15.284 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-10T09:52:15.303 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-10T09:52:15.343 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-10T09:52:15.546 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-webtest. 2024-05-10T09:52:15.573 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-10T09:52:15.612 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-10T09:52:15.647 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-10T09:52:15.673 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-10T09:52:15.713 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-10T09:52:15.923 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pecan. 2024-05-10T09:52:15.950 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-10T09:52:15.990 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-10T09:52:16.024 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-10T09:52:16.050 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-10T09:52:16.090 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-10T09:52:16.361 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-certifi. 2024-05-10T09:52:16.388 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-10T09:52:16.393 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-10T09:52:16.420 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-10T09:52:16.427 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-10T09:52:16.460 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-10T09:52:16.731 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-idna. 2024-05-10T09:52:16.758 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-10T09:52:16.762 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-tempora. 2024-05-10T09:52:16.789 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-10T09:52:16.789 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-10T09:52:16.829 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-10T09:52:17.067 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-urllib3. 2024-05-10T09:52:17.090 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-portend. 2024-05-10T09:52:17.094 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-10T09:52:17.117 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-10T09:52:17.133 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-10T09:52:17.157 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-10T09:52:17.443 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-10T09:52:17.453 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-requests. 2024-05-10T09:52:17.470 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-10T09:52:17.480 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-10T09:52:17.510 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-10T09:52:17.511 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-10T09:52:17.789 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-10T09:52:17.813 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-10T09:52:17.816 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-10T09:52:17.839 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-10T09:52:17.856 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-10T09:52:17.879 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-10T09:52:18.126 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-10T09:52:18.142 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:18.174 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-natsort. 2024-05-10T09:52:18.175 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:18.201 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-10T09:52:18.249 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-10T09:52:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-logutils. 2024-05-10T09:52:18.564 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-10T09:52:18.588 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:18.588 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-10T09:52:18.627 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-10T09:52:18.630 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:18.925 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-10T09:52:18.941 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-10T09:52:18.947 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-10T09:52:18.974 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-10T09:52:18.974 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-10T09:52:19.013 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-10T09:52:19.244 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-openssl. 2024-05-10T09:52:19.271 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-10T09:52:19.275 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-mako. 2024-05-10T09:52:19.302 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-10T09:52:19.310 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-10T09:52:19.333 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-10T09:52:19.656 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr. 2024-05-10T09:52:19.683 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:19.711 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-10T09:52:19.738 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-10T09:52:19.778 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-10T09:52:19.897 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:20.081 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-10T09:52:20.108 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-10T09:52:20.147 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-10T09:52:20.300 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mon. 2024-05-10T09:52:20.328 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:20.367 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mon (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:20.417 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-webob. 2024-05-10T09:52:20.444 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-10T09:52:20.483 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-10T09:52:20.803 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-waitress. 2024-05-10T09:52:20.830 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-10T09:52:20.873 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-10T09:52:21.070 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-osd. 2024-05-10T09:52:21.097 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:21.137 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-osd (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:21.164 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-tempita. 2024-05-10T09:52:21.191 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-10T09:52:21.230 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-10T09:52:21.542 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-paste. 2024-05-10T09:52:21.568 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-10T09:52:21.608 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-10T09:52:21.928 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-10T09:52:21.943 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-10T09:52:21.978 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-10T09:52:22.215 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph. 2024-05-10T09:52:22.231 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../066-ceph_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:22.247 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-10T09:52:22.273 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:22.274 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-10T09:52:22.314 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-10T09:52:22.576 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-fuse. 2024-05-10T09:52:22.603 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:22.625 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-webtest. 2024-05-10T09:52:22.642 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-fuse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:22.652 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-10T09:52:22.692 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-10T09:52:22.995 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mds. 2024-05-10T09:52:23.003 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pecan. 2024-05-10T09:52:23.020 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:23.030 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-10T09:52:23.054 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mds (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:23.078 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-10T09:52:23.441 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-certifi. 2024-05-10T09:52:23.465 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package cephadm. 2024-05-10T09:52:23.468 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-10T09:52:23.493 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../069-cephadm_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:23.507 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-10T09:52:23.532 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking cephadm (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:23.819 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-idna. 2024-05-10T09:52:23.845 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-10T09:52:23.851 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-10T09:52:23.877 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-10T09:52:23.878 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-10T09:52:23.917 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-10T09:52:24.254 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-10T09:52:24.281 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-10T09:52:24.313 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-urllib3. 2024-05-10T09:52:24.320 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-10T09:52:24.340 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-10T09:52:24.380 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-10T09:52:24.675 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-requests. 2024-05-10T09:52:24.701 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-10T09:52:24.741 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-10T09:52:25.038 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-10T09:52:25.065 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-10T09:52:25.104 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-10T09:52:25.392 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-babel. 2024-05-10T09:52:25.399 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-10T09:52:25.420 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-10T09:52:25.426 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:25.458 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-10T09:52:25.465 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:25.795 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-jinja2. 2024-05-10T09:52:25.822 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-10T09:52:25.861 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-10T09:52:25.862 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-10T09:52:25.889 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:25.928 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:26.156 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-10T09:52:26.184 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:26.223 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:26.239 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-10T09:52:26.266 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-10T09:52:26.306 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-10T09:52:26.509 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-10T09:52:26.537 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-10T09:52:26.567 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-openssl. 2024-05-10T09:52:26.575 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-10T09:52:26.582 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-10T09:52:26.642 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-10T09:52:26.878 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-routes. 2024-05-10T09:52:26.906 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-10T09:52:26.945 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-10T09:52:26.970 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr. 2024-05-10T09:52:26.997 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:27.036 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:27.290 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-10T09:52:27.317 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:27.356 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:27.431 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mon. 2024-05-10T09:52:27.458 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:27.497 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mon (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:28.109 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-osd. 2024-05-10T09:52:28.136 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:28.176 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-osd (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:28.670 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-10T09:52:28.694 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-10T09:52:28.736 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-10T09:52:29.237 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph. 2024-05-10T09:52:29.249 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-joblib. 2024-05-10T09:52:29.265 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../066-ceph_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:29.276 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-10T09:52:29.303 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:29.306 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-10T09:52:29.623 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-fuse. 2024-05-10T09:52:29.650 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:29.668 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-10T09:52:29.690 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-fuse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:29.696 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-10T09:52:29.735 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-10T09:52:30.035 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mds. 2024-05-10T09:52:30.054 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-sklearn. 2024-05-10T09:52:30.062 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:30.082 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-10T09:52:30.092 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mds (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:30.121 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-10T09:52:30.496 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package cephadm. 2024-05-10T09:52:30.523 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../069-cephadm_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:30.562 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking cephadm (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:30.838 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-10T09:52:30.866 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:30.873 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-10T09:52:30.900 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-10T09:52:30.939 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-10T09:52:30.998 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:31.259 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-10T09:52:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-10T09:52:31.378 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-10T09:52:31.977 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-cachetools. 2024-05-10T09:52:32.005 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-10T09:52:32.043 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-10T09:52:32.346 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-10T09:52:32.347 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-babel. 2024-05-10T09:52:32.374 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-10T09:52:32.374 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-10T09:52:32.412 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-10T09:52:32.413 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-10T09:52:32.716 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-jinja2. 2024-05-10T09:52:32.743 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-10T09:52:32.758 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-10T09:52:32.783 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-10T09:52:32.785 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-10T09:52:32.824 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-10T09:52:33.122 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-10T09:52:33.146 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:33.160 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-rsa. 2024-05-10T09:52:33.186 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:33.188 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-10T09:52:33.227 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-10T09:52:33.522 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-10T09:52:33.549 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-10T09:52:33.589 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-10T09:52:33.589 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-google-auth. 2024-05-10T09:52:33.617 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-10T09:52:33.664 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-10T09:52:33.916 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-routes. 2024-05-10T09:52:33.943 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-10T09:52:33.983 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-10T09:52:34.051 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-10T09:52:34.079 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-10T09:52:34.125 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-10T09:52:34.336 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-10T09:52:34.363 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:34.411 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:34.504 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-websocket. 2024-05-10T09:52:34.532 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-10T09:52:34.712 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-10T09:52:35.082 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-10T09:52:35.110 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-10T09:52:35.148 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-10T09:52:35.837 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-10T09:52:35.854 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:35.895 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:35.991 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-10T09:52:36.004 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-10T09:52:36.049 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-10T09:52:36.215 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-10T09:52:36.244 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-10T09:52:36.282 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-10T09:52:36.519 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-joblib. 2024-05-10T09:52:36.532 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-10T09:52:36.577 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-10T09:52:36.593 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-10T09:52:36.621 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-10T09:52:36.659 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-10T09:52:36.937 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package jq. 2024-05-10T09:52:36.947 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-10T09:52:36.965 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-10T09:52:36.974 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-10T09:52:37.003 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-10T09:52:37.013 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-10T09:52:37.265 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package socat. 2024-05-10T09:52:37.293 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-10T09:52:37.317 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-sklearn. 2024-05-10T09:52:37.331 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-10T09:52:37.343 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-10T09:52:37.416 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-10T09:52:37.618 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package xmlstarlet. 2024-05-10T09:52:37.634 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-10T09:52:37.668 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-10T09:52:38.030 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-test. 2024-05-10T09:52:38.047 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:38.083 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-10T09:52:38.097 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-test (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:38.110 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:38.235 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:39.180 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-cachetools. 2024-05-10T09:52:39.207 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-10T09:52:39.246 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-10T09:52:39.491 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-10T09:52:39.518 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-10T09:52:39.558 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-10T09:52:39.877 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-10T09:52:39.905 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-10T09:52:39.952 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-10T09:52:40.264 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-rsa. 2024-05-10T09:52:40.291 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-10T09:52:40.330 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-10T09:52:40.401 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package ceph-volume. 2024-05-10T09:52:40.418 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:40.651 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-google-auth. 2024-05-10T09:52:40.668 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking ceph-volume (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:40.678 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-10T09:52:40.717 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-10T09:52:40.980 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-10T09:52:40.997 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:41.038 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking libcephfs-dev (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:41.070 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-10T09:52:41.098 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-10T09:52:41.137 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-10T09:52:41.308 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-10T09:52:41.336 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-10T09:52:41.374 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-10T09:52:41.448 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-websocket. 2024-05-10T09:52:41.475 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-10T09:52:41.514 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-10T09:52:41.679 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-10T09:52:41.707 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-10T09:52:41.745 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-10T09:52:41.826 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-10T09:52:41.853 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-10T09:52:41.892 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-10T09:52:42.116 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package nvme-cli. 2024-05-10T09:52:42.144 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-10T09:52:42.183 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-10T09:52:42.506 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-10T09:52:42.534 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:42.572 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:42.629 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package pkg-config. 2024-05-10T09:52:42.657 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-10T09:52:42.695 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-10T09:52:42.892 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-10T09:52:42.919 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-10T09:52:42.957 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-10T09:52:42.958 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-10T09:52:42.985 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-10T09:52:43.024 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-10T09:52:43.220 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-10T09:52:43.247 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-10T09:52:43.278 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-10T09:52:43.427 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-10T09:52:43.455 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-10T09:52:43.485 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-10T09:52:43.547 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package jq. 2024-05-10T09:52:43.574 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-10T09:52:43.614 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-10T09:52:43.754 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pastescript. 2024-05-10T09:52:43.782 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-10T09:52:43.821 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-10T09:52:43.867 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package socat. 2024-05-10T09:52:43.894 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-10T09:52:43.933 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-10T09:52:44.141 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pluggy. 2024-05-10T09:52:44.169 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-10T09:52:44.207 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-10T09:52:44.236 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package xmlstarlet. 2024-05-10T09:52:44.252 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-10T09:52:44.294 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-10T09:52:44.569 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-psutil. 2024-05-10T09:52:44.597 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-10T09:52:44.635 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-10T09:52:44.673 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-test. 2024-05-10T09:52:44.689 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:44.732 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-test (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:44.947 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-py. 2024-05-10T09:52:44.975 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-10T09:52:45.013 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-10T09:52:45.342 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pygments. 2024-05-10T09:52:45.370 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-10T09:52:45.408 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-10T09:52:45.896 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-10T09:52:45.924 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-10T09:52:45.962 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-10T09:52:46.257 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-toml. 2024-05-10T09:52:46.285 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-10T09:52:46.323 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-10T09:52:46.559 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-pytest. 2024-05-10T09:52:46.587 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-10T09:52:46.625 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-10T09:52:46.954 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package python3-simplejson. 2024-05-10T09:52:46.982 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-10T09:52:47.020 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-10T09:52:47.086 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package ceph-volume. 2024-05-10T09:52:47.113 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3457-g5be95034-1jammy_all.deb ... 2024-05-10T09:52:47.152 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking ceph-volume (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:47.290 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-10T09:52:47.315 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-10T09:52:47.356 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-10T09:52:47.439 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-10T09:52:47.467 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:47.506 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking libcephfs-dev (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:47.775 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-10T09:52:47.803 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-10T09:52:47.842 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-10T09:52:48.094 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package radosgw. 2024-05-10T09:52:48.123 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../116-radosgw_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:48.160 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking radosgw (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:48.163 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-10T09:52:48.190 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-10T09:52:48.221 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-10T09:52:48.592 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package nvme-cli. 2024-05-10T09:52:48.619 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-10T09:52:48.658 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-10T09:52:49.030 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package pkg-config. 2024-05-10T09:52:49.058 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-10T09:52:49.080 INFO:teuthology.orchestra.run.smithi042.stdout:Selecting previously unselected package rbd-fuse. 2024-05-10T09:52:49.088 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-10T09:52:49.097 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:49.146 INFO:teuthology.orchestra.run.smithi042.stdout:Unpacking rbd-fuse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:49.332 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-10T09:52:49.348 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-10T09:52:49.390 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-10T09:52:49.405 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-10T09:52:49.693 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-10T09:52:49.802 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-10T09:52:49.819 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-10T09:52:49.830 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-10T09:52:49.868 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-10T09:52:50.088 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-10T09:52:50.163 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pastescript. 2024-05-10T09:52:50.191 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-10T09:52:50.229 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-10T09:52:50.397 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-10T09:52:50.549 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pluggy. 2024-05-10T09:52:50.577 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-10T09:52:50.616 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-10T09:52:50.810 INFO:teuthology.orchestra.run.smithi042.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-10T09:52:50.879 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up cephadm (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:50.927 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-psutil. 2024-05-10T09:52:50.955 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-10T09:52:50.993 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-10T09:52:51.330 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-py. 2024-05-10T09:52:51.358 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-10T09:52:51.396 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-10T09:52:51.612 INFO:teuthology.orchestra.run.smithi042.stdout:Adding system user cephadm....done 2024-05-10T09:52:51.741 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pygments. 2024-05-10T09:52:51.760 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-10T09:52:51.769 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-10T09:52:51.807 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-10T09:52:52.087 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-10T09:52:52.278 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-10T09:52:52.306 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-10T09:52:52.346 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-10T09:52:52.353 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-10T09:52:52.447 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-10T09:52:52.664 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-toml. 2024-05-10T09:52:52.692 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-10T09:52:52.715 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-10T09:52:52.730 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-10T09:52:52.966 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-10T09:52:53.033 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-pytest. 2024-05-10T09:52:53.061 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-10T09:52:53.092 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-10T09:52:53.099 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-10T09:52:53.419 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-10T09:52:53.453 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package python3-simplejson. 2024-05-10T09:52:53.481 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-10T09:52:53.519 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-10T09:52:53.789 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-10T09:52:53.796 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-10T09:52:53.817 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-10T09:52:53.855 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-10T09:52:54.047 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-10T09:52:54.324 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-10T09:52:54.550 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-10T09:52:54.568 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package radosgw. 2024-05-10T09:52:54.596 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../116-radosgw_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:54.634 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking radosgw (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:54.809 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-10T09:52:55.061 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-10T09:52:55.412 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-ceph-argparse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:55.546 INFO:teuthology.orchestra.run.smithi181.stdout:Selecting previously unselected package rbd-fuse. 2024-05-10T09:52:55.574 INFO:teuthology.orchestra.run.smithi181.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3457-g5be95034-1jammy_amd64.deb ... 2024-05-10T09:52:55.612 INFO:teuthology.orchestra.run.smithi181.stdout:Unpacking rbd-fuse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:55.679 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-10T09:52:55.805 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-10T09:52:55.908 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-10T09:52:55.915 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-10T09:52:56.016 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-10T09:52:56.142 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-10T09:52:56.268 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-10T09:52:56.275 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-10T09:52:56.529 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-10T09:52:56.695 INFO:teuthology.orchestra.run.smithi042.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-10T09:52:56.723 INFO:teuthology.orchestra.run.smithi042.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-10T09:52:56.787 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-10T09:52:56.830 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-10T09:52:56.896 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-10T09:52:57.247 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-10T09:52:57.260 INFO:teuthology.orchestra.run.smithi181.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-10T09:52:57.354 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up cephadm (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:52:57.367 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-10T09:52:57.643 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-10T09:52:57.928 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-10T09:52:58.204 INFO:teuthology.orchestra.run.smithi181.stdout:Adding system user cephadm....done 2024-05-10T09:52:58.237 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up zip (3.0-12build2) ... 2024-05-10T09:52:58.326 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-10T09:52:58.363 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-10T09:52:58.594 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-10T09:52:58.846 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-10T09:52:58.989 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-10T09:52:59.040 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-10T09:52:59.239 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-10T09:52:59.291 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-10T09:52:59.417 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-10T09:52:59.490 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-10T09:52:59.543 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-10T09:52:59.617 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-10T09:52:59.844 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-10T09:52:59.926 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-10T09:53:00.229 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-10T09:53:00.278 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-10T09:53:00.488 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-10T09:53:00.554 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-10T09:53:00.822 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-10T09:53:00.873 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-10T09:53:01.049 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-10T09:53:01.149 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-10T09:53:01.291 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-10T09:53:01.509 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-10T09:53:01.550 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-10T09:53:01.769 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-10T09:53:02.006 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-ceph-argparse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:02.007 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-ceph-common (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:02.036 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-10T09:53:02.170 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-10T09:53:02.196 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-idna (3.3-1) ... 2024-05-10T09:53:02.296 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-10T09:53:02.406 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-10T09:53:02.513 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-10T09:53:02.682 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-10T09:53:03.054 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-10T09:53:03.088 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-10T09:53:03.152 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-10T09:53:03.277 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-10T09:53:03.637 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-10T09:53:03.677 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-10T09:53:03.763 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-10T09:53:03.937 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:53:04.022 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-10T09:53:04.088 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-10T09:53:04.282 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-10T09:53:04.356 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-10T09:53:04.465 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-10T09:53:04.583 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-10T09:53:04.591 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up zip (3.0-12build2) ... 2024-05-10T09:53:04.717 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-10T09:53:04.893 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-10T09:53:05.152 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-10T09:53:05.402 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-10T09:53:05.412 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:53:05.538 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-10T09:53:05.662 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-10T09:53:05.788 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-10T09:53:05.905 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-10T09:53:05.913 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-10T09:53:06.165 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-10T09:53:06.223 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-10T09:53:06.416 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-10T09:53:06.608 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-10T09:53:06.675 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-10T09:53:06.850 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-10T09:53:06.927 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-10T09:53:07.193 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-10T09:53:07.203 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-10T09:53:07.329 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-10T09:53:07.463 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-10T09:53:07.613 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-10T09:53:07.714 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-10T09:53:07.823 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-10T09:53:08.024 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-10T09:53:08.107 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-10T09:53:08.233 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-ceph-common (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:08.342 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-10T09:53:08.526 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-idna (3.3-1) ... 2024-05-10T09:53:08.609 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-10T09:53:08.735 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-10T09:53:08.819 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-10T09:53:08.844 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-10T09:53:08.918 INFO:teuthology.orchestra.run.smithi042.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-10T09:53:09.188 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-10T09:53:09.289 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-10T09:53:09.657 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-10T09:53:09.933 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-10T09:53:09.991 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-10T09:53:10.059 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-10T09:53:10.226 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:53:10.327 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:53:10.335 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-10T09:53:10.436 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-10T09:53:10.578 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-10T09:53:10.703 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-10T09:53:10.746 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-10T09:53:10.830 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-10T09:53:11.047 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-10T09:53:11.164 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-10T09:53:11.306 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-10T09:53:11.432 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-10T09:53:11.432 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-10T09:53:11.683 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:53:11.717 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-10T09:53:11.809 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-10T09:53:11.993 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-10T09:53:12.110 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-10T09:53:12.345 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-10T09:53:12.354 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-10T09:53:12.604 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-10T09:53:12.739 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-10T09:53:12.872 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-10T09:53:13.033 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-10T09:53:13.123 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-10T09:53:13.394 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-10T09:53:13.416 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-10T09:53:13.520 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librados2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:13.541 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-10T09:53:13.646 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:13.747 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-10T09:53:13.817 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-10T09:53:13.919 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-10T09:53:14.075 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libcephfs2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:14.194 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-10T09:53:14.201 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libradosstriper1 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:14.327 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-10T09:53:14.471 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-10T09:53:14.603 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librbd1 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:14.713 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-modules-core (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:14.747 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-10T09:53:14.839 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-fuse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:14.873 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-10T09:53:14.999 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-10T09:53:15.056 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-10T09:53:15.057 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-10T09:53:15.087 INFO:teuthology.orchestra.run.smithi181.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-10T09:53:15.317 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-10T09:53:15.443 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-10T09:53:15.573 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up libcephfs-dev (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:15.716 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rados (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:15.836 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-10T09:53:15.859 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up librgw2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:15.985 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-10T09:53:16.078 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-10T09:53:16.204 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-10T09:53:16.473 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-10T09:53:16.598 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-10T09:53:16.924 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-10T09:53:17.214 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rbd (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:17.234 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-10T09:53:17.341 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up rbd-fuse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:17.467 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-rgw (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:17.493 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-10T09:53:17.593 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up python3-cephfs (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:17.719 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-common (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:17.998 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-10T09:53:18.204 INFO:teuthology.orchestra.run.smithi042.stdout:Adding group ceph....done 2024-05-10T09:53:18.287 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-10T09:53:18.554 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-10T09:53:18.580 INFO:teuthology.orchestra.run.smithi042.stdout:Adding system user ceph....done 2024-05-10T09:53:18.742 INFO:teuthology.orchestra.run.smithi042.stdout:Setting system user ceph properties....done 2024-05-10T09:53:18.757 INFO:teuthology.orchestra.run.smithi042.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-10T09:53:18.902 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-10T09:53:18.924 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-10T09:53:19.253 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-10T09:53:19.309 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-10T09:53:19.586 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-10T09:53:19.728 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-test (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:19.829 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up radosgw (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:19.938 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-10T09:53:20.064 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librados2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:20.190 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:20.297 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-10T09:53:20.297 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-10T09:53:20.316 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-10T09:53:20.677 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcephfs2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:20.731 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-base (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:20.787 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libradosstriper1 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:20.896 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-10T09:53:21.092 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-10T09:53:21.198 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librbd1 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:21.324 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-modules-core (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:21.441 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-fuse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:21.558 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mds (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:21.636 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-10T09:53:21.636 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-10T09:53:21.803 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-10T09:53:21.803 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-10T09:53:22.084 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up libcephfs-dev (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:22.210 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rados (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:22.336 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up librgw2 (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:22.376 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:22.454 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-10T09:53:22.608 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-10T09:53:22.608 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-10T09:53:23.086 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-osd (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:23.388 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-10T09:53:23.389 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-10T09:53:23.716 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rbd (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:23.841 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up rbd-fuse (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:23.845 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:23.946 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:23.984 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-rgw (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:24.081 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mon (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:24.110 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up python3-cephfs (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:24.228 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-common (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:24.301 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-10T09:53:24.302 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-10T09:53:24.746 INFO:teuthology.orchestra.run.smithi181.stdout:Adding group ceph....done 2024-05-10T09:53:24.807 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-cephadm (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:24.958 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:25.084 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-mgr-dashboard (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:25.097 INFO:teuthology.orchestra.run.smithi181.stdout:Adding system user ceph....done 2024-05-10T09:53:25.235 INFO:teuthology.orchestra.run.smithi042.stdout:Setting up ceph-volume (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:25.265 INFO:teuthology.orchestra.run.smithi181.stdout:Setting system user ceph properties....done 2024-05-10T09:53:25.281 INFO:teuthology.orchestra.run.smithi181.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-10T09:53:25.418 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-10T09:53:25.596 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-10T09:53:25.697 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-10T09:53:25.771 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-10T09:53:25.850 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-10T09:53:26.237 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-test (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:26.372 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up radosgw (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:26.846 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-10T09:53:26.846 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-10T09:53:26.967 INFO:teuthology.orchestra.run.smithi042.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-10T09:53:27.298 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-base (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:27.645 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-10T09:53:27.673 INFO:teuthology.orchestra.run.smithi042.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-10T09:53:27.679 DEBUG:teuthology.parallel:result is None 2024-05-10T09:53:28.117 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mds (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:28.356 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-10T09:53:28.356 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-10T09:53:28.843 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:29.077 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-10T09:53:29.077 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-10T09:53:29.528 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-osd (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:29.788 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-10T09:53:29.788 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-10T09:53:30.238 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:30.364 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:30.515 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mon (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:30.726 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-10T09:53:30.727 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-10T09:53:31.241 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-cephadm (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:31.392 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:31.518 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-mgr-dashboard (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:31.669 INFO:teuthology.orchestra.run.smithi181.stdout:Setting up ceph-volume (19.0.0-3457-g5be95034-1jammy) ... 2024-05-10T09:53:32.005 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-10T09:53:32.114 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-10T09:53:32.267 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-10T09:53:33.309 INFO:teuthology.orchestra.run.smithi181.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-10T09:53:33.988 INFO:teuthology.orchestra.run.smithi181.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-10T09:53:33.992 DEBUG:teuthology.parallel:result is None 2024-05-10T09:53:33.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be95034c7c2ad8a0361951b19205b782eb6be06 2024-05-10T09:53:34.138 DEBUG:teuthology.orchestra.run.smithi042:> dpkg-query -W -f '${Version}' ceph 2024-05-10T09:53:34.159 INFO:teuthology.orchestra.run.smithi042.stdout:19.0.0-3457-g5be95034-1jammy 2024-05-10T09:53:34.159 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3457-g5be95034-1jammy 2024-05-10T09:53:34.160 INFO:teuthology.task.install:The correct ceph version 19.0.0-3457-g5be95034-1jammy is installed. 2024-05-10T09:53:34.162 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=5be95034c7c2ad8a0361951b19205b782eb6be06 2024-05-10T09:53:34.305 DEBUG:teuthology.orchestra.run.smithi181:> dpkg-query -W -f '${Version}' ceph 2024-05-10T09:53:34.324 INFO:teuthology.orchestra.run.smithi181.stdout:19.0.0-3457-g5be95034-1jammy 2024-05-10T09:53:34.325 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3457-g5be95034-1jammy 2024-05-10T09:53:34.325 INFO:teuthology.task.install:The correct ceph version 19.0.0-3457-g5be95034-1jammy is installed. 2024-05-10T09:53:34.327 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T09:53:34.327 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:34.327 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T09:53:34.342 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:53:34.342 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T09:53:34.377 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T09:53:34.378 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:34.378 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T09:53:34.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T09:53:34.453 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:53:34.453 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T09:53:34.466 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T09:53:34.521 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T09:53:34.521 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:34.521 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T09:53:34.535 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T09:53:34.589 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:53:34.589 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T09:53:34.602 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T09:53:34.657 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T09:53:34.657 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:34.657 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T09:53:34.671 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T09:53:34.725 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:53:34.725 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T09:53:34.738 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T09:53:34.797 INFO:teuthology.run_tasks:Running task ceph... 2024-05-10T09:53:34.888 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-10T09:53:34.888 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-05-10T09:53:34.891 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-05-10T09:53:34.903 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-10T09:53:34.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T09:53:34.947 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T09:53:34.959 INFO:tasks.ceph:Creating extra log directories... 2024-05-10T09:53:34.959 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T09:53:35.003 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T09:53:35.025 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-10T09:53:35.025 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-10T09:53:35.026 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864', 'branch': 'wip-skoduri-lc-notify', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}', 'email': None, 'first_in_suite': False, 'job_id': '7700864', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-skoduri-lc-notify'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-skoduri-lc-notify', 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06'}}, 'owner': 'scheduled_soumyakoduri@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-skoduri-lc-notify', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_5be95034c7c2ad8a0361951b19205b782eb6be06/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06', 'targets': {'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPLnV3J6+uye8B13rgu2lMBBbDkdiZePrQX0qSfKJ9J/z3rqHnBUkyc5FAdzebjZNCJSSpoESdDGVHXDEvAx9fo=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIgk19yC/Wj8hWKRvJ900Mtp2l0CJ6PvB+IS59+5/qUPHmX2JHaFQVqMzSU6AyPI/5LuU1mcdsD3yBYBB3uoCLc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_multipart_upload.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-10_06:25:19', 'tube': 'smithi', 'user': 'soumyakoduri', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-10T09:53:35.026 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T09:53:35.059 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T09:53:35.064 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T09:53:35.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T09:53:35.119 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:35.120 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T09:53:35.165 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T09:53:35.166 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-05-10T09:53:35.214 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T09:53:35.214 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T09:53:35.214 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-05-10T09:53:35.214 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T09:53:35.214 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-10 09:48:13.539161149 +0000 2024-05-10T09:53:35.214 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-10 09:48:13.263163599 +0000 2024-05-10T09:53:35.214 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-10 09:48:13.263163599 +0000 2024-05-10T09:53:35.214 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-05-10T09:53:35.215 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T09:53:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-10T09:53:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-10T09:53:35.268 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000301485 s, 1.7 MB/s 2024-05-10T09:53:35.270 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T09:53:35.319 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-05-10T09:53:35.366 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T09:53:35.366 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T09:53:35.366 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-05-10T09:53:35.366 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T09:53:35.366 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-10 09:48:14.055156569 +0000 2024-05-10T09:53:35.366 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-10 09:48:13.771159090 +0000 2024-05-10T09:53:35.366 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-10 09:48:13.771159090 +0000 2024-05-10T09:53:35.366 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-05-10T09:53:35.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T09:53:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-10T09:53:35.420 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-10T09:53:35.421 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000311828 s, 1.6 MB/s 2024-05-10T09:53:35.422 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T09:53:35.471 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-05-10T09:53:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T09:53:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T09:53:35.518 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-05-10T09:53:35.518 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T09:53:35.518 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-10 09:48:14.547152201 +0000 2024-05-10T09:53:35.518 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-10 09:48:14.295154438 +0000 2024-05-10T09:53:35.518 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-10 09:48:14.295154438 +0000 2024-05-10T09:53:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-05-10T09:53:35.519 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T09:53:35.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-10T09:53:35.572 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-10T09:53:35.572 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000310091 s, 1.7 MB/s 2024-05-10T09:53:35.574 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T09:53:35.623 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-05-10T09:53:35.671 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T09:53:35.671 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T09:53:35.671 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-05-10T09:53:35.671 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T09:53:35.671 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-10 09:48:15.047147762 +0000 2024-05-10T09:53:35.672 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-10 09:48:14.803149928 +0000 2024-05-10T09:53:35.672 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-10 09:48:14.803149928 +0000 2024-05-10T09:53:35.672 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2024-05-10T09:53:35.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T09:53:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-10T09:53:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-10T09:53:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000313134 s, 1.6 MB/s 2024-05-10T09:53:35.726 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T09:53:35.775 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:35.775 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:53:35.775 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T09:53:35.781 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T09:53:35.781 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-05-10T09:53:35.834 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T09:53:35.835 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T09:53:35.835 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-05-10T09:53:35.835 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T09:53:35.835 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-10 09:48:09.384327663 +0000 2024-05-10T09:53:35.835 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-10 09:48:09.144329808 +0000 2024-05-10T09:53:35.835 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-10 09:48:09.144329808 +0000 2024-05-10T09:53:35.835 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-05-10T09:53:35.835 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T09:53:35.888 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-10T09:53:35.889 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-10T09:53:35.889 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000451953 s, 1.1 MB/s 2024-05-10T09:53:35.890 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T09:53:35.939 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-05-10T09:53:35.985 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T09:53:35.985 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T09:53:35.986 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-05-10T09:53:35.986 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T09:53:35.986 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-10 09:48:09.888323162 +0000 2024-05-10T09:53:35.986 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-10 09:48:09.620325555 +0000 2024-05-10T09:53:35.986 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-10 09:48:09.620325555 +0000 2024-05-10T09:53:35.986 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-05-10T09:53:35.986 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T09:53:36.040 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-10T09:53:36.040 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-10T09:53:36.041 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.0003957 s, 1.3 MB/s 2024-05-10T09:53:36.042 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T09:53:36.091 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-05-10T09:53:36.138 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T09:53:36.138 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T09:53:36.138 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-05-10T09:53:36.138 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T09:53:36.138 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-10 09:48:10.396318625 +0000 2024-05-10T09:53:36.138 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-10 09:48:10.124321054 +0000 2024-05-10T09:53:36.138 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-10 09:48:10.124321054 +0000 2024-05-10T09:53:36.139 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-05-10T09:53:36.139 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T09:53:36.192 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-10T09:53:36.192 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-10T09:53:36.193 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000356938 s, 1.4 MB/s 2024-05-10T09:53:36.194 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T09:53:36.244 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-05-10T09:53:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T09:53:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T09:53:36.290 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-05-10T09:53:36.290 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T09:53:36.290 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-05-10 09:48:10.896314159 +0000 2024-05-10T09:53:36.290 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-05-10 09:48:10.632316517 +0000 2024-05-10T09:53:36.291 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-05-10 09:48:10.632316517 +0000 2024-05-10T09:53:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: - 2024-05-10T09:53:36.291 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T09:53:36.348 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-05-10T09:53:36.348 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-05-10T09:53:36.348 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000348352 s, 1.5 MB/s 2024-05-10T09:53:36.349 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T09:53:36.399 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:36.399 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T09:53:36.399 INFO:tasks.ceph:Generating config... 2024-05-10T09:53:36.401 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-05-10T09:53:36.401 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-10T09:53:36.401 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-10T09:53:36.401 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-10T09:53:36.401 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-10T09:53:36.401 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-10T09:53:36.401 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-10T09:53:36.401 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-10T09:53:36.401 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-10T09:53:36.401 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-10T09:53:36.401 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-10T09:53:36.401 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-10T09:53:36.402 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-10T09:53:36.403 INFO:tasks.ceph:Setting up mon.a... 2024-05-10T09:53:36.403 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-10T09:53:36.438 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2024-05-10T09:53:36.465 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-10T09:53:36.546 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T09:53:36.601 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42'), ('mon.c', '[v2:172.21.15.42:3301,v1:172.21.15.42:6790]'), ('mon.b', '172.21.15.181')] 2024-05-10T09:53:36.602 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.42,[v2:172.21.15.42:3301,v1:172.21.15.42:6790],172.21.15.181'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-05-10T09:53:36.602 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:36.603 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T09:53:36.650 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.42 --addv c '[v2:172.21.15.42:3301,v1:172.21.15.42:6790]' --add b 172.21.15.181 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid 7e1d9b5a-9708-485a-8c63-703e41c4a829 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:fsid 7e1d9b5a-9708-485a-8c63-703e41c4a829 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2024-05-10T09:53:36.739642+0000 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-05-10T09:53:36.739642+0000 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 17 (quincy) 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:election_strategy: 1 2024-05-10T09:53:36.737 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-05-10T09:53:36.738 INFO:teuthology.orchestra.run.smithi042.stdout:1: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.b 2024-05-10T09:53:36.738 INFO:teuthology.orchestra.run.smithi042.stdout:2: [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] mon.c 2024-05-10T09:53:36.738 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-10T09:53:36.739 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T09:53:36.744 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7e1d9b5a-9708-485a-8c63-703e41c4a829... 2024-05-10T09:53:36.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T09:53:36.787 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T09:53:36.813 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-05-10T09:53:36.813 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-05-10T09:53:36.813 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T09:53:36.813 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-05-10T09:53:36.813 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.814 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T09:53:36.815 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,[v2:172.21.15.42:3301,v1:172.21.15.42:6790],172.21.15.181" 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = 7e1d9b5a-9708-485a-8c63-703e41c4a829 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.816 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.817 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-05-10T09:53:36.818 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-05-10T09:53:36.819 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: osd blocked scrub grace period = 3600 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: osd max markdown count = 1000 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: osd shutdown pgref assert = True 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-05-10T09:53:36.820 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T09:53:36.821 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-05-10T09:53:36.822 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi042.stdout: rgw relaxed s3 bucket names = True 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-05-10T09:53:36.823 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.824 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-05-10T09:53:36.825 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-05-10T09:53:36.826 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.42,[v2:172.21.15.42:3301,v1:172.21.15.42:6790],172.21.15.181" 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = 7e1d9b5a-9708-485a-8c63-703e41c4a829 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-05-10T09:53:36.827 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-05-10T09:53:36.828 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: bdev async discard = True 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: bdev enable discard = True 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore allocator = bitmap 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 1/20 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 1/20 2024-05-10T09:53:36.829 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 4/10 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd blocked scrub grace period = 3600 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd max markdown count = 1000 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: osd shutdown pgref assert = True 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-10T09:53:36.830 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-05-10T09:53:36.831 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T09:53:36.832 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.833 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-05-10T09:53:36.833 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-05-10T09:53:36.833 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.833 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-05-10T09:53:36.833 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-05-10T09:53:36.833 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-05-10T09:53:36.833 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-05-10T09:53:36.834 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-05-10T09:53:36.834 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-05-10T09:53:36.834 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T09:53:36.834 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T09:53:36.834 INFO:teuthology.orchestra.run.smithi181.stdout: rgw relaxed s3 bucket names = True 2024-05-10T09:53:36.834 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-05-10T09:53:36.834 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-05-10T09:53:36.834 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-05-10T09:53:36.836 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-10T09:53:36.836 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-10T09:53:36.929 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-10T09:53:36.929 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:36.929 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-10T09:53:36.934 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:36.934 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-10T09:53:36.983 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:53:36.983 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:36.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T09:53:36.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T09:53:37.047 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:53:37.047 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:37.094 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:53:37.094 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:53:37.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T09:53:37.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T09:53:37.117 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:53:37.117 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:37.166 INFO:tasks.ceph:Setting up mon nodes... 2024-05-10T09:53:37.166 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-10T09:53:37.167 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T09:53:37.213 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T09:53:37.216 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T09:53:37.259 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T09:53:37.265 INFO:tasks.ceph:Setting up mds nodes... 2024-05-10T09:53:37.265 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-10T09:53:37.265 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T09:53:37.302 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-10T09:53:37.313 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-10T09:53:37.346 INFO:teuthology.orchestra.run.smithi181.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-10T09:53:37.356 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-10T09:53:37.356 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T09:53:37.356 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-10T09:53:37.373 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:37.373 INFO:tasks.ceph:role: osd.0 2024-05-10T09:53:37.373 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:53:37.373 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T09:53:37.429 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T09:53:37.429 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T09:53:37.429 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T09:53:37.429 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T09:53:37.429 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T09:53:37.429 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-10T09:53:37.430 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T09:53:37.430 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T09:53:37.430 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T09:53:37.430 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T09:53:37.453 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-10T09:53:37.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-10T09:53:37.455 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-10T09:53:37.514 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-10T09:53:37.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:53:37.566 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T09:53:37.566 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-10T09:53:37.619 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:37.619 INFO:tasks.ceph:role: osd.1 2024-05-10T09:53:37.619 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:53:37.619 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T09:53:37.673 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T09:53:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T09:53:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T09:53:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T09:53:37.673 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T09:53:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-10T09:53:37.673 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T09:53:37.673 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T09:53:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T09:53:37.674 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T09:53:37.697 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-10T09:53:37.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-10T09:53:37.699 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-10T09:53:37.756 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-10T09:53:37.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:53:37.808 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T09:53:37.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-10T09:53:37.860 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:37.860 INFO:tasks.ceph:role: osd.2 2024-05-10T09:53:37.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:53:37.861 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T09:53:37.913 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T09:53:37.936 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-10T09:53:37.939 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-10T09:53:37.939 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-10T09:53:37.996 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-10T09:53:38.047 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T09:53:38.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:53:38.048 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-10T09:53:38.099 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:38.099 INFO:tasks.ceph:role: osd.3 2024-05-10T09:53:38.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:53:38.100 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T09:53:38.153 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T09:53:38.153 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T09:53:38.153 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T09:53:38.153 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T09:53:38.153 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T09:53:38.154 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-10T09:53:38.154 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T09:53:38.154 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T09:53:38.154 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T09:53:38.154 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T09:53:38.176 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-10T09:53:38.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-10T09:53:38.178 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-10T09:53:38.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-10T09:53:38.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:53:38.291 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T09:53:38.291 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:38.398+0000 7f00ea3057c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-10T09:53:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:38.398+0000 7f00ea3057c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-10T09:53:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:38.398+0000 7f00ea3057c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T09:53:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:38.398+0000 7f00ea3057c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T09:53:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:38.398+0000 7f00ea3057c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T09:53:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:38.398+0000 7f00ea3057c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-10T09:53:41.402 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-10T09:53:41.416 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:41.502+0000 7fee9f7777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-10T09:53:41.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:41.502+0000 7fee9f7777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-10T09:53:41.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:41.502+0000 7fee9f7777c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T09:53:41.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:41.502+0000 7fee9f7777c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T09:53:41.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:41.502+0000 7fee9f7777c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T09:53:41.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:41.502+0000 7fee9f7777c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-10T09:53:44.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-10T09:53:44.526 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:44.610+0000 7f6b471ad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-10T09:53:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:44.610+0000 7f6b471ad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-10T09:53:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:44.610+0000 7f6b471ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T09:53:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:44.610+0000 7f6b471ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T09:53:44.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:44.610+0000 7f6b471ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T09:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:44.610+0000 7f6b471ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-10T09:53:47.569 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-10T09:53:47.627 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:47.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:47.710+0000 7f945031b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-10T09:53:47.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:47.710+0000 7f945031b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-10T09:53:47.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:47.710+0000 7f945031b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T09:53:47.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:47.710+0000 7f945031b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T09:53:47.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:47.710+0000 7f945031b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T09:53:47.713 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-10T09:53:47.714+0000 7f945031b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-10T09:53:50.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-10T09:53:50.746 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-10T09:53:50.761 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:50.761 INFO:tasks.ceph:role: osd.4 2024-05-10T09:53:50.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:53:50.761 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T09:53:50.826 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T09:53:51.290 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-05-10T09:53:51.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-05-10T09:53:51.292 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-10T09:53:51.384 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-10T09:53:51.394 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:53:51.395 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T09:53:51.395 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-10T09:53:51.448 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:51.448 INFO:tasks.ceph:role: osd.5 2024-05-10T09:53:51.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:53:51.448 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T09:53:51.510 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T09:53:51.975 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-05-10T09:53:51.977 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-05-10T09:53:51.977 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-10T09:53:52.098 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-10T09:53:52.109 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T09:53:52.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:53:52.110 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-10T09:53:52.165 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:52.165 INFO:tasks.ceph:role: osd.6 2024-05-10T09:53:52.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:53:52.165 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T09:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T09:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T09:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T09:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T09:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T09:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-05-10T09:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T09:53:52.229 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T09:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T09:53:52.230 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T09:53:52.716 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-05-10T09:53:52.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-05-10T09:53:52.719 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-10T09:53:52.873 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-10T09:53:52.884 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T09:53:52.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:53:52.885 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-10T09:53:52.941 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T09:53:52.941 INFO:tasks.ceph:role: osd.7 2024-05-10T09:53:52.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:53:52.941 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T09:53:53.005 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T09:53:53.005 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T09:53:53.005 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T09:53:53.005 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T09:53:53.005 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T09:53:53.005 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-05-10T09:53:53.006 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T09:53:53.006 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T09:53:53.006 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T09:53:53.006 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T09:53:53.434 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-05-10T09:53:53.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-05-10T09:53:53.436 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-10T09:53:53.536 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-10T09:53:53.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:53:53.545 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: /sbin/restorecon: command not found 2024-05-10T09:53:53.546 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:53.662 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:53.662+0000 7fe2596967c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-10T09:53:53.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:53.666+0000 7fe2596967c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-10T09:53:53.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:53.666+0000 7fe2596967c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T09:53:53.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:53.666+0000 7fe2596967c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T09:53:53.667 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:53.666+0000 7fe2596967c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T09:53:53.668 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:53.666+0000 7fe2596967c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-10T09:53:56.674 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-10T09:53:56.688 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:56.771 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:56.770+0000 7fb37cfdc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-10T09:53:56.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:56.770+0000 7fb37cfdc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-10T09:53:56.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:56.770+0000 7fb37cfdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T09:53:56.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:56.770+0000 7fb37cfdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T09:53:56.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:56.770+0000 7fb37cfdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T09:53:56.772 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:56.770+0000 7fb37cfdc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-10T09:53:59.745 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-10T09:53:59.801 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:53:59.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:59.882+0000 7f78e7d887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-10T09:53:59.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:59.882+0000 7f78e7d887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-10T09:53:59.884 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:59.882+0000 7f78e7d887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T09:53:59.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:59.882+0000 7f78e7d887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T09:53:59.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:59.882+0000 7f78e7d887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T09:53:59.885 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:53:59.886+0000 7f78e7d887c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-10T09:54:02.860 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-10T09:54:02.912 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:54:02.992 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:54:02.990+0000 7fdbaab447c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-10T09:54:02.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:54:02.990+0000 7fdbaab447c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-10T09:54:02.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:54:02.990+0000 7fdbaab447c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T09:54:02.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:54:02.990+0000 7fdbaab447c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T09:54:02.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:54:02.990+0000 7fdbaab447c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T09:54:02.993 INFO:teuthology.orchestra.run.smithi181.stderr:2024-05-10T09:54:02.994+0000 7fdbaab447c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-10T09:54:05.968 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-10T09:54:06.021 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-10T09:54:06.021 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:06.021 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-10T09:54:06.036 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:06.036 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-10T09:54:06.090 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:06.090 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-10T09:54:06.150 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:06.150 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-10T09:54:06.204 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:06.205 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-10T09:54:06.265 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:06.265 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-10T09:54:06.279 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:06.279 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-10T09:54:06.337 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:06.338 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-10T09:54:06.396 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:06.396 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-10T09:54:06.449 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:06.449 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-10T09:54:06.504 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:06.504 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-10T09:54:06.509 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:06.510 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-10T09:54:06.549 INFO:tasks.ceph:Adding keys to all mons... 2024-05-10T09:54:06.549 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T09:54:06.558 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T09:54:06.595 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2024-05-10T09:54:06.595 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCh7j1mFcfWDBAAZqozqRVwz5AVmUkke0EYtA== 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCi7j1mxwgAGBAASNjNUhOogTH1sMZEvjDReg== 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCl7j1mBC0YHhAAPjQJbVAtM9QVSIr4cIkR1A== 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCo7j1meRN9JBAAKaQJvKRSKAWvnwhPwZeBfQ== 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCr7j1mrnKhKhAAcAmXN5cu/TfPcCgGob/0kQ== 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCh7j1mZ1+ODxAArBGFhqFynI+1M2dKM+cCHg== 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCx7j1m8p6VJxAA+xFRW1QH8yZBE59/LAZSNw== 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC07j1mBLQYLhAAZFoyMK3ytP/qfuDDe5Ehuw== 2024-05-10T09:54:06.596 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2024-05-10T09:54:06.597 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC37j1mv1fTNBAAeHpyiGECr8tVq0SrK7N0Tg== 2024-05-10T09:54:06.597 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2024-05-10T09:54:06.597 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQC67j1mkh1IOxAAQZBDcG6P/+qSv0voE8TdsA== 2024-05-10T09:54:06.597 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-05-10T09:54:06.597 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCh7j1m5FIrEhAAweSpxMNtooLT9/PHhs1G3Q== 2024-05-10T09:54:06.597 INFO:teuthology.orchestra.run.smithi042.stdout:[client.1] 2024-05-10T09:54:06.597 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCh7j1mbxDDFBAAMkwzJcn42PB7JWwcdE13bQ== 2024-05-10T09:54:06.603 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-05-10T09:54:06.603 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCh7j1mFcfWDBAAZqozqRVwz5AVmUkke0EYtA== 2024-05-10T09:54:06.603 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-05-10T09:54:06.603 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCi7j1mxwgAGBAASNjNUhOogTH1sMZEvjDReg== 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCl7j1mBC0YHhAAPjQJbVAtM9QVSIr4cIkR1A== 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCo7j1meRN9JBAAKaQJvKRSKAWvnwhPwZeBfQ== 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCr7j1mrnKhKhAAcAmXN5cu/TfPcCgGob/0kQ== 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCh7j1mZ1+ODxAArBGFhqFynI+1M2dKM+cCHg== 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCx7j1m8p6VJxAA+xFRW1QH8yZBE59/LAZSNw== 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQC07j1mBLQYLhAAZFoyMK3ytP/qfuDDe5Ehuw== 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQC37j1mv1fTNBAAeHpyiGECr8tVq0SrK7N0Tg== 2024-05-10T09:54:06.604 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-05-10T09:54:06.605 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQC67j1mkh1IOxAAQZBDcG6P/+qSv0voE8TdsA== 2024-05-10T09:54:06.605 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-05-10T09:54:06.605 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCh7j1m5FIrEhAAweSpxMNtooLT9/PHhs1G3Q== 2024-05-10T09:54:06.605 INFO:teuthology.orchestra.run.smithi181.stdout:[client.1] 2024-05-10T09:54:06.605 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCh7j1mbxDDFBAAMkwzJcn42PB7JWwcdE13bQ== 2024-05-10T09:54:06.606 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T09:54:06.642 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T09:54:06.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:06.735 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:06.780 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:06.783 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:06.864 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:06.871 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:06.944 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:06.958 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.032 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T09:54:07.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T09:54:07.116 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.139 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.201 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.223 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.268 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.315 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.357 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.360 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T09:54:07.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T09:54:07.442 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T09:54:07.523 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T09:54:07.525 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T09:54:07.607 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-10T09:54:07.607 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-10T09:54:07.619 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T09:54:07.710 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-10T09:54:07.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-10T09:54:07.778 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T09:54:07.866 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-10T09:54:07.920 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-10T09:54:07.935 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T09:54:08.029 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-10T09:54:08.039 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:54:08.042 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T09:54:08.088 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-10T09:54:08.089 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-10T09:54:08.089 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-10T09:54:08.091 INFO:tasks.ceph.mon.a:Started 2024-05-10T09:54:08.091 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-10T09:54:08.091 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-10T09:54:08.094 INFO:tasks.ceph.mon.c:Started 2024-05-10T09:54:08.094 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-10T09:54:08.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-10T09:54:08.134 INFO:tasks.ceph.mon.b:Started 2024-05-10T09:54:08.134 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-10T09:54:08.134 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-10T09:54:08.134 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-10T09:54:08.137 INFO:tasks.ceph.mgr.y:Started 2024-05-10T09:54:08.137 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-10T09:54:08.137 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-10T09:54:08.139 INFO:tasks.ceph.mgr.x:Started 2024-05-10T09:54:08.139 INFO:tasks.ceph:Setting crush tunables to default 2024-05-10T09:54:08.139 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2024-05-10T09:54:13.627 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-05-10T09:54:13.647 INFO:tasks.ceph:check_enable_crimson: False 2024-05-10T09:54:13.647 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-10T09:54:13.647 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:13.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-10T09:54:13.659 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:13.659 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-10T09:54:13.713 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:13.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-10T09:54:13.741 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:13.738+0000 7f6ef8a73180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T09:54:13.750 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:13.750+0000 7f482481e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T09:54:13.752 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:54:13.752 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-10T09:54:13.804 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:13.804 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-10T09:54:13.817 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:13.817 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-10T09:54:13.872 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:13.872 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-10T09:54:13.925 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-05-10T09:54:13.925 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-10T09:54:13.979 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 897c58ab-70e9-4a8d-b51f-cf9dc6cedd29 0 2024-05-10T09:54:14.224 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:14.222+0000 7f482481e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T09:54:14.237 INFO:teuthology.orchestra.run.smithi181.stdout:0 2024-05-10T09:54:14.255 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new fc75a63e-e69c-4efb-89cb-b599f6ded234 1 2024-05-10T09:54:14.292 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:14.290+0000 7f6ef8a73180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T09:54:14.422 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:14.422+0000 7f482481e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T09:54:14.455 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-05-10T09:54:14.478 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 18889f8e-3a4e-4ea7-b9b6-af9547e84e85 2 2024-05-10T09:54:14.517 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:14.514+0000 7f6ef8a73180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T09:54:14.674 INFO:teuthology.orchestra.run.smithi181.stdout:2 2024-05-10T09:54:14.690 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new a2720077-7595-48e4-9f86-60cd449b0d90 3 2024-05-10T09:54:14.879 INFO:teuthology.orchestra.run.smithi181.stdout:3 2024-05-10T09:54:14.896 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new c271ae7d-8d4d-46a6-9273-8a52de33dd30 4 2024-05-10T09:54:15.004 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.002+0000 7f482481e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T09:54:15.080 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.078+0000 7f482481e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T09:54:15.106 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.106+0000 7f6ef8a73180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T09:54:15.121 INFO:teuthology.orchestra.run.smithi181.stdout:4 2024-05-10T09:54:15.134 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.134+0000 7f482481e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T09:54:15.138 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b 5 2024-05-10T09:54:15.163 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.162+0000 7f6ef8a73180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T09:54:15.215 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.214+0000 7f482481e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T09:54:15.218 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.218+0000 7f6ef8a73180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T09:54:15.269 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.270+0000 7f482481e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T09:54:15.299 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.298+0000 7f6ef8a73180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T09:54:15.336 INFO:teuthology.orchestra.run.smithi181.stdout:5 2024-05-10T09:54:15.348 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.346+0000 7f482481e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T09:54:15.352 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 6fa08610-ff9d-41d0-af8a-06d46f3388d7 6 2024-05-10T09:54:15.354 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.354+0000 7f6ef8a73180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T09:54:15.404 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.402+0000 7f482481e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T09:54:15.435 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.434+0000 7f6ef8a73180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T09:54:15.491 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.490+0000 7f6ef8a73180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T09:54:15.543 INFO:teuthology.orchestra.run.smithi181.stdout:6 2024-05-10T09:54:15.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 86869483-0d84-4d13-b78e-3bac8ac2ff03 7 2024-05-10T09:54:15.562 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.562+0000 7f482481e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T09:54:15.626 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:15.626+0000 7f482481e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T09:54:15.649 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.650+0000 7f6ef8a73180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T09:54:15.714 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:15.714+0000 7f6ef8a73180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T09:54:15.753 INFO:teuthology.orchestra.run.smithi181.stdout:7 2024-05-10T09:54:15.768 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-10T09:54:15.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-10T09:54:15.771 INFO:tasks.ceph.osd.0:Started 2024-05-10T09:54:15.771 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-10T09:54:15.771 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-10T09:54:15.773 INFO:tasks.ceph.osd.1:Started 2024-05-10T09:54:15.774 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-10T09:54:15.774 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-10T09:54:15.776 INFO:tasks.ceph.osd.2:Started 2024-05-10T09:54:15.776 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-10T09:54:15.777 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-10T09:54:15.779 INFO:tasks.ceph.osd.3:Started 2024-05-10T09:54:15.779 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T09:54:15.779 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T09:54:15.781 INFO:tasks.ceph.osd.4:Started 2024-05-10T09:54:15.781 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T09:54:15.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T09:54:15.783 INFO:tasks.ceph.osd.5:Started 2024-05-10T09:54:15.783 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-10T09:54:15.784 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-10T09:54:15.786 INFO:tasks.ceph.osd.6:Started 2024-05-10T09:54:15.786 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-10T09:54:15.786 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-10T09:54:15.788 INFO:tasks.ceph.osd.7:Started 2024-05-10T09:54:15.788 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T09:54:15.984 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:15.984 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:54:15.752492+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:54:16.001 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-10T09:54:16.001 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-10T09:54:16.261 INFO:tasks.ceph.mgr.x.smithi181.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-10T09:54:16.261 INFO:tasks.ceph.mgr.x.smithi181.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-10T09:54:16.261 INFO:tasks.ceph.mgr.x.smithi181.stderr: from numpy import show_config as show_numpy_config 2024-05-10T09:54:16.315 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:16.314+0000 7f482481e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T09:54:16.406 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:54:16.406+0000 7fb2e23c47c0 -1 Falling back to public interface 2024-05-10T09:54:16.406 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:54:16.406+0000 7f2b619d57c0 -1 Falling back to public interface 2024-05-10T09:54:16.407 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:54:16.406+0000 7f3477ffc7c0 -1 Falling back to public interface 2024-05-10T09:54:16.408 INFO:tasks.ceph.mgr.y.smithi042.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-10T09:54:16.408 INFO:tasks.ceph.mgr.y.smithi042.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-10T09:54:16.408 INFO:tasks.ceph.mgr.y.smithi042.stderr: from numpy import show_config as show_numpy_config 2024-05-10T09:54:16.411 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:54:16.410+0000 7f76683ab7c0 -1 Falling back to public interface 2024-05-10T09:54:16.418 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:54:16.418+0000 7f03ff26e7c0 -1 Falling back to public interface 2024-05-10T09:54:16.422 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:54:16.422+0000 7f724f0cc7c0 -1 Falling back to public interface 2024-05-10T09:54:16.422 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:54:16.422+0000 7f4a531e37c0 -1 Falling back to public interface 2024-05-10T09:54:16.434 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:54:16.434+0000 7f3e9c9207c0 -1 Falling back to public interface 2024-05-10T09:54:16.464 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:16.462+0000 7f482481e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T09:54:16.466 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:16.466+0000 7f6ef8a73180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T09:54:16.613 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:16.610+0000 7f482481e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T09:54:16.627 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:16.626+0000 7f6ef8a73180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T09:54:16.677 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:16.674+0000 7f482481e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T09:54:16.805 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:16.806+0000 7f6ef8a73180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T09:54:16.808 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T09:54:16.812 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:16.810+0000 7f482481e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T09:54:16.878 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:16.878+0000 7f6ef8a73180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T09:54:16.993 INFO:teuthology.misc.health.smithi042.stdout: 2024-05-10T09:54:16.993 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":10,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:54:15.752492+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:54:17.010 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T09:54:17.035 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:17.034+0000 7f6ef8a73180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T09:54:17.449 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:17.450+0000 7f482481e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T09:54:17.524 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:17.522+0000 7f482481e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T09:54:17.665 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:17.666+0000 7f6ef8a73180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T09:54:17.707 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:17.706+0000 7f482481e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T09:54:17.744 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:17.742+0000 7f6ef8a73180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T09:54:17.781 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:17.778+0000 7f482481e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T09:54:17.935 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:17.934+0000 7f6ef8a73180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T09:54:18.012 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:18.010+0000 7f6ef8a73180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T09:54:18.069 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:18.070+0000 7f482481e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T09:54:18.130 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:18.130+0000 7f482481e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T09:54:18.321 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:18.322+0000 7f6ef8a73180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T09:54:18.386 INFO:tasks.ceph.mgr.y.smithi042.stderr:2024-05-10T09:54:18.386+0000 7f6ef8a73180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T09:54:19.169 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:19.166+0000 7f47cb468640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T09:54:19.177 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:19.178+0000 7f47cb468640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-10T09:54:19.751 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:54:19.750+0000 7f4a531e37c0 -1 osd.1 0 log_to_monitors true 2024-05-10T09:54:20.206 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:54:20.206+0000 7f724f0cc7c0 -1 osd.2 0 log_to_monitors true 2024-05-10T09:54:20.300 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:54:20.298+0000 7f03ff26e7c0 -1 osd.0 0 log_to_monitors true 2024-05-10T09:54:20.315 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:54:20.314+0000 7f3e9c9207c0 -1 osd.3 0 log_to_monitors true 2024-05-10T09:54:20.332 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:54:20.330+0000 7f76683ab7c0 -1 osd.4 0 log_to_monitors true 2024-05-10T09:54:20.403 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:54:20.402+0000 7f2b619d57c0 -1 osd.7 0 log_to_monitors true 2024-05-10T09:54:20.418 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:54:20.418+0000 7fb2e23c47c0 -1 osd.6 0 log_to_monitors true 2024-05-10T09:54:20.419 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:54:20.418+0000 7f3477ffc7c0 -1 osd.5 0 log_to_monitors true 2024-05-10T09:54:22.172 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:54:22.170+0000 7f4a4f18c640 -1 osd.1 0 waiting for initial osdmap 2024-05-10T09:54:22.205 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:54:22.206+0000 7f4a46fc0640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:54:23.434 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:54:23.434+0000 7f3e988c9640 -1 osd.3 0 waiting for initial osdmap 2024-05-10T09:54:23.454 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:54:23.453+0000 7f3e906fd640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:54:23.483 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:54:23.481+0000 7f724b075640 -1 osd.2 0 waiting for initial osdmap 2024-05-10T09:54:23.485 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:54:23.485+0000 7f03fba29640 -1 osd.0 0 waiting for initial osdmap 2024-05-10T09:54:23.510 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:54:23.509+0000 7f03f304b640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:54:23.510 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:54:23.509+0000 7f7242ea9640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:54:23.815 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T09:54:24.110 INFO:teuthology.misc.health.smithi042.stdout: 2024-05-10T09:54:24.111 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":14,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:54:23.227183+0000","last_up_change":"2024-05-10T09:54:23.227183+0000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6811","nonce":2743871003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6815","nonce":2743871003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6823","nonce":2743871003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6819","nonce":2743871003}]},"public_addr":"172.21.15.42:6811/2743871003","cluster_addr":"172.21.15.42:6815/2743871003","heartbeat_back_addr":"172.21.15.42:6823/2743871003","heartbeat_front_addr":"172.21.15.42:6819/2743871003","state":["exists","up"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:54:24.127 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-05-10T09:54:24.312 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:54:24.310+0000 7f2b5d97e640 -1 osd.7 0 waiting for initial osdmap 2024-05-10T09:54:24.337 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:54:24.338+0000 7f3473fa5640 -1 osd.5 0 waiting for initial osdmap 2024-05-10T09:54:24.345 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:54:24.346+0000 7f2b557b2640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:54:24.365 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:54:24.366+0000 7f346bdd9640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:54:24.370 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:54:24.370+0000 7f7664354640 -1 osd.4 0 waiting for initial osdmap 2024-05-10T09:54:24.382 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:54:24.382+0000 7fb2de36d640 -1 osd.6 0 waiting for initial osdmap 2024-05-10T09:54:24.393 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:54:24.394+0000 7f765c188640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:54:24.409 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:54:24.410+0000 7fb2d61a1640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:54:30.934 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T09:54:31.237 INFO:teuthology.misc.health.smithi042.stdout: 2024-05-10T09:54:31.237 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":19,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:54:28.529406+0000","last_up_change":"2024-05-10T09:54:24.495518+0000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T09:54:26.214148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6801","nonce":3913515164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6803","nonce":3913515164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6807","nonce":3913515164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6805","nonce":3913515164}]},"public_addr":"172.21.15.42:6801/3913515164","cluster_addr":"172.21.15.42:6803/3913515164","heartbeat_back_addr":"172.21.15.42:6807/3913515164","heartbeat_front_addr":"172.21.15.42:6805/3913515164","state":["exists","up"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6811","nonce":2743871003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6815","nonce":2743871003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6823","nonce":2743871003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6819","nonce":2743871003}]},"public_addr":"172.21.15.42:6811/2743871003","cluster_addr":"172.21.15.42:6815/2743871003","heartbeat_back_addr":"172.21.15.42:6823/2743871003","heartbeat_front_addr":"172.21.15.42:6819/2743871003","state":["exists","up"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6810","nonce":3683869396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6814","nonce":3683869396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6822","nonce":3683869396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6818","nonce":3683869396}]},"public_addr":"172.21.15.42:6810/3683869396","cluster_addr":"172.21.15.42:6814/3683869396","heartbeat_back_addr":"172.21.15.42:6822/3683869396","heartbeat_front_addr":"172.21.15.42:6818/3683869396","state":["exists","up"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6825","nonce":125865404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6827","nonce":125865404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6831","nonce":125865404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6829","nonce":125865404}]},"public_addr":"172.21.15.42:6825/125865404","cluster_addr":"172.21.15.42:6827/125865404","heartbeat_back_addr":"172.21.15.42:6831/125865404","heartbeat_front_addr":"172.21.15.42:6829/125865404","state":["exists","up"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6825","nonce":74015139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6827","nonce":74015139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6831","nonce":74015139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6829","nonce":74015139}]},"public_addr":"172.21.15.181:6825/74015139","cluster_addr":"172.21.15.181:6827/74015139","heartbeat_back_addr":"172.21.15.181:6831/74015139","heartbeat_front_addr":"172.21.15.181:6829/74015139","state":["exists","up"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6809","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6812","nonce":893112190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6816","nonce":893112190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6824","nonce":893112190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6819","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6821","nonce":893112190}]},"public_addr":"172.21.15.181:6812/893112190","cluster_addr":"172.21.15.181:6816/893112190","heartbeat_back_addr":"172.21.15.181:6824/893112190","heartbeat_front_addr":"172.21.15.181:6821/893112190","state":["exists","up"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6802","nonce":1622048387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6807","nonce":1622048387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6820","nonce":1622048387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6813","nonce":1622048387}]},"public_addr":"172.21.15.181:6802/1622048387","cluster_addr":"172.21.15.181:6807/1622048387","heartbeat_back_addr":"172.21.15.181:6820/1622048387","heartbeat_front_addr":"172.21.15.181:6813/1622048387","state":["exists","up"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6801","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6803","nonce":3508953868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6805","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6806","nonce":3508953868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6815","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6818","nonce":3508953868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6811","nonce":3508953868}]},"public_addr":"172.21.15.181:6803/3508953868","cluster_addr":"172.21.15.181:6806/3508953868","heartbeat_back_addr":"172.21.15.181:6818/3508953868","heartbeat_front_addr":"172.21.15.181:6811/3508953868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.309797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:20.776872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.163014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.344100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.292805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.412990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.456741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.437150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:54:31.255 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-10T09:54:31.255 INFO:tasks.ceph:Creating RBD pool 2024-05-10T09:54:31.255 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-10T09:54:32.565 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'rbd' created 2024-05-10T09:54:32.590 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-10T09:54:33.567 INFO:teuthology.orchestra.run.smithi042.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-10T09:54:33.592 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-10T09:54:33.593 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T09:54:33.593 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-10T09:54:33.593 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-10T09:54:33.593 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-10T09:54:33.939 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:33.958 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":3137713163},{"type":"v1","addr":"172.21.15.181:6833","nonce":3137713163}]},"active_addr":"172.21.15.181:6833/3137713163","active_change":"2024-05-10T09:54:18.155014+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":3169542985}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":3102128542}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":2484804908}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.181:0","nonce":392662742}]}]} 2024-05-10T09:54:33.964 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-10T09:54:33.964 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T09:54:33.964 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T09:54:34.258 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:34.258 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:54:33.560971+0000","last_up_change":"2024-05-10T09:54:24.495518+0000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T09:54:26.214148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T09:54:31.575111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6801","nonce":3913515164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6803","nonce":3913515164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6807","nonce":3913515164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6805","nonce":3913515164}]},"public_addr":"172.21.15.42:6801/3913515164","cluster_addr":"172.21.15.42:6803/3913515164","heartbeat_back_addr":"172.21.15.42:6807/3913515164","heartbeat_front_addr":"172.21.15.42:6805/3913515164","state":["exists","up"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6811","nonce":2743871003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6815","nonce":2743871003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6823","nonce":2743871003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6819","nonce":2743871003}]},"public_addr":"172.21.15.42:6811/2743871003","cluster_addr":"172.21.15.42:6815/2743871003","heartbeat_back_addr":"172.21.15.42:6823/2743871003","heartbeat_front_addr":"172.21.15.42:6819/2743871003","state":["exists","up"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6810","nonce":3683869396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6814","nonce":3683869396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6822","nonce":3683869396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6818","nonce":3683869396}]},"public_addr":"172.21.15.42:6810/3683869396","cluster_addr":"172.21.15.42:6814/3683869396","heartbeat_back_addr":"172.21.15.42:6822/3683869396","heartbeat_front_addr":"172.21.15.42:6818/3683869396","state":["exists","up"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6825","nonce":125865404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6827","nonce":125865404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6831","nonce":125865404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6829","nonce":125865404}]},"public_addr":"172.21.15.42:6825/125865404","cluster_addr":"172.21.15.42:6827/125865404","heartbeat_back_addr":"172.21.15.42:6831/125865404","heartbeat_front_addr":"172.21.15.42:6829/125865404","state":["exists","up"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6825","nonce":74015139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6827","nonce":74015139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6831","nonce":74015139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6829","nonce":74015139}]},"public_addr":"172.21.15.181:6825/74015139","cluster_addr":"172.21.15.181:6827/74015139","heartbeat_back_addr":"172.21.15.181:6831/74015139","heartbeat_front_addr":"172.21.15.181:6829/74015139","state":["exists","up"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6809","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6812","nonce":893112190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6816","nonce":893112190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6824","nonce":893112190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6819","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6821","nonce":893112190}]},"public_addr":"172.21.15.181:6812/893112190","cluster_addr":"172.21.15.181:6816/893112190","heartbeat_back_addr":"172.21.15.181:6824/893112190","heartbeat_front_addr":"172.21.15.181:6821/893112190","state":["exists","up"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6802","nonce":1622048387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6807","nonce":1622048387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6820","nonce":1622048387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6813","nonce":1622048387}]},"public_addr":"172.21.15.181:6802/1622048387","cluster_addr":"172.21.15.181:6807/1622048387","heartbeat_back_addr":"172.21.15.181:6820/1622048387","heartbeat_front_addr":"172.21.15.181:6813/1622048387","state":["exists","up"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6801","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6803","nonce":3508953868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6805","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6806","nonce":3508953868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6815","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6818","nonce":3508953868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6811","nonce":3508953868}]},"public_addr":"172.21.15.181:6803/3508953868","cluster_addr":"172.21.15.181:6806/3508953868","heartbeat_back_addr":"172.21.15.181:6818/3508953868","heartbeat_front_addr":"172.21.15.181:6811/3508953868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.309797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:20.776872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.163014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.344100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.292805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.412990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.456741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.437150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:54:34.275 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T09:54:34.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T09:54:34.581 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:34.581 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:54:34.572461+0000","last_up_change":"2024-05-10T09:54:24.495518+0000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T09:54:26.214148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T09:54:31.575111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6801","nonce":3913515164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6803","nonce":3913515164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6807","nonce":3913515164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6805","nonce":3913515164}]},"public_addr":"172.21.15.42:6801/3913515164","cluster_addr":"172.21.15.42:6803/3913515164","heartbeat_back_addr":"172.21.15.42:6807/3913515164","heartbeat_front_addr":"172.21.15.42:6805/3913515164","state":["exists","up"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6811","nonce":2743871003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6815","nonce":2743871003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6823","nonce":2743871003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6819","nonce":2743871003}]},"public_addr":"172.21.15.42:6811/2743871003","cluster_addr":"172.21.15.42:6815/2743871003","heartbeat_back_addr":"172.21.15.42:6823/2743871003","heartbeat_front_addr":"172.21.15.42:6819/2743871003","state":["exists","up"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6810","nonce":3683869396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6814","nonce":3683869396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6822","nonce":3683869396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6818","nonce":3683869396}]},"public_addr":"172.21.15.42:6810/3683869396","cluster_addr":"172.21.15.42:6814/3683869396","heartbeat_back_addr":"172.21.15.42:6822/3683869396","heartbeat_front_addr":"172.21.15.42:6818/3683869396","state":["exists","up"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6825","nonce":125865404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6827","nonce":125865404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6831","nonce":125865404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6829","nonce":125865404}]},"public_addr":"172.21.15.42:6825/125865404","cluster_addr":"172.21.15.42:6827/125865404","heartbeat_back_addr":"172.21.15.42:6831/125865404","heartbeat_front_addr":"172.21.15.42:6829/125865404","state":["exists","up"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6825","nonce":74015139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6827","nonce":74015139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6831","nonce":74015139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":74015139},{"type":"v1","addr":"172.21.15.181:6829","nonce":74015139}]},"public_addr":"172.21.15.181:6825/74015139","cluster_addr":"172.21.15.181:6827/74015139","heartbeat_back_addr":"172.21.15.181:6831/74015139","heartbeat_front_addr":"172.21.15.181:6829/74015139","state":["exists","up"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6809","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6812","nonce":893112190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6816","nonce":893112190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6824","nonce":893112190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6819","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6821","nonce":893112190}]},"public_addr":"172.21.15.181:6812/893112190","cluster_addr":"172.21.15.181:6816/893112190","heartbeat_back_addr":"172.21.15.181:6824/893112190","heartbeat_front_addr":"172.21.15.181:6821/893112190","state":["exists","up"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6802","nonce":1622048387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6807","nonce":1622048387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6820","nonce":1622048387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6813","nonce":1622048387}]},"public_addr":"172.21.15.181:6802/1622048387","cluster_addr":"172.21.15.181:6807/1622048387","heartbeat_back_addr":"172.21.15.181:6820/1622048387","heartbeat_front_addr":"172.21.15.181:6813/1622048387","state":["exists","up"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6801","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6803","nonce":3508953868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6805","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6806","nonce":3508953868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6815","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6818","nonce":3508953868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6811","nonce":3508953868}]},"public_addr":"172.21.15.181:6803/3508953868","cluster_addr":"172.21.15.181:6806/3508953868","heartbeat_back_addr":"172.21.15.181:6818/3508953868","heartbeat_front_addr":"172.21.15.181:6811/3508953868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.309797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:20.776872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.163014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.344100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.292805+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.412990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.456741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.437150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:54:34.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T09:54:34.601 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T09:54:34.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T09:54:34.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T09:54:34.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T09:54:34.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T09:54:34.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T09:54:34.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T09:54:34.868 INFO:teuthology.orchestra.run.smithi042.stdout:64424509446 2024-05-10T09:54:34.868 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T09:54:34.883 INFO:teuthology.orchestra.run.smithi042.stdout:64424509444 2024-05-10T09:54:34.883 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T09:54:34.885 INFO:teuthology.orchestra.run.smithi042.stdout:64424509444 2024-05-10T09:54:34.886 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T09:54:34.887 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-05-10T09:54:34.888 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T09:54:34.891 INFO:teuthology.orchestra.run.smithi042.stdout:64424509444 2024-05-10T09:54:34.891 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T09:54:34.893 INFO:teuthology.orchestra.run.smithi042.stdout:64424509444 2024-05-10T09:54:34.893 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T09:54:34.894 INFO:teuthology.orchestra.run.smithi042.stdout:64424509446 2024-05-10T09:54:34.895 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T09:54:34.901 INFO:teuthology.orchestra.run.smithi042.stdout:60129542150 2024-05-10T09:54:34.902 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T09:54:35.358 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-05-10T09:54:35.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.3 2024-05-10T09:54:35.399 INFO:teuthology.orchestra.run.smithi042.stdout:64424509444 2024-05-10T09:54:35.404 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-05-10T09:54:35.417 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-05-10T09:54:35.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.0 2024-05-10T09:54:35.429 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-05-10T09:54:35.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.6 2024-05-10T09:54:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:64424509443 2024-05-10T09:54:35.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.7 2024-05-10T09:54:35.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-05-10T09:54:35.454 INFO:teuthology.orchestra.run.smithi042.stdout:60129542148 2024-05-10T09:54:35.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.2 2024-05-10T09:54:35.471 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-05-10T09:54:35.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.1 2024-05-10T09:54:35.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2024-05-10T09:54:36.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T09:54:36.430 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T09:54:36.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T09:54:36.450 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T09:54:36.450 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T09:54:36.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T09:54:36.473 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T09:54:36.488 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T09:54:36.876 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-05-10T09:54:36.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.3 2024-05-10T09:54:36.899 DEBUG:teuthology.parallel:result is None 2024-05-10T09:54:36.969 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-05-10T09:54:36.969 INFO:teuthology.orchestra.run.smithi042.stdout:64424509446 2024-05-10T09:54:36.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.7 2024-05-10T09:54:36.989 DEBUG:teuthology.parallel:result is None 2024-05-10T09:54:36.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.0 2024-05-10T09:54:36.997 DEBUG:teuthology.parallel:result is None 2024-05-10T09:54:37.010 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-05-10T09:54:37.017 INFO:teuthology.orchestra.run.smithi042.stdout:60129542150 2024-05-10T09:54:37.018 INFO:teuthology.orchestra.run.smithi042.stdout:64424509445 2024-05-10T09:54:37.026 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-05-10T09:54:37.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.2 2024-05-10T09:54:37.040 DEBUG:teuthology.parallel:result is None 2024-05-10T09:54:37.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.6 2024-05-10T09:54:37.042 DEBUG:teuthology.parallel:result is None 2024-05-10T09:54:37.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-05-10T09:54:37.049 DEBUG:teuthology.parallel:result is None 2024-05-10T09:54:37.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2024-05-10T09:54:37.053 DEBUG:teuthology.parallel:result is None 2024-05-10T09:54:37.059 INFO:teuthology.orchestra.run.smithi042.stdout:64424509447 2024-05-10T09:54:37.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.5 2024-05-10T09:54:37.076 DEBUG:teuthology.parallel:result is None 2024-05-10T09:54:37.076 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T09:54:37.076 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:54:37.395 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:37.395 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:54:37.411 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-10T09:54:36.169357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239792,"kb_used_data":2804,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734928,"statfs":{"total":773094113280,"available":772848566272,"internally_reserved":0,"allocated":2871296,"data_stored":1725180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":242535990},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001088"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.763002+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:54:34.763002+0000","last_peered":"2024-05-10T09:54:34.763002+0000","last_clean":"2024-05-10T09:54:34.763002+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:54:34.763002+0000","last_undegraded":"2024-05-10T09:54:34.763002+0000","last_fullsized":"2024-05-10T09:54:34.763002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.582493+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:54:34.582493+0000","last_peered":"2024-05-10T09:54:34.582493+0000","last_clean":"2024-05-10T09:54:34.582493+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:54:34.582493+0000","last_undegraded":"2024-05-10T09:54:34.582493+0000","last_fullsized":"2024-05-10T09:54:34.582493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.763837+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:54:34.763837+0000","last_peered":"2024-05-10T09:54:34.763837+0000","last_clean":"2024-05-10T09:54:34.763837+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:54:34.763837+0000","last_undegraded":"2024-05-10T09:54:34.763837+0000","last_fullsized":"2024-05-10T09:54:34.763837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.582102+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:54:34.582102+0000","last_peered":"2024-05-10T09:54:34.582102+0000","last_clean":"2024-05-10T09:54:34.582102+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:54:34.582102+0000","last_undegraded":"2024-05-10T09:54:34.582102+0000","last_fullsized":"2024-05-10T09:54:34.582102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.584732+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:54:34.584732+0000","last_peered":"2024-05-10T09:54:34.584732+0000","last_clean":"2024-05-10T09:54:34.584732+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:54:34.584732+0000","last_undegraded":"2024-05-10T09:54:34.584732+0000","last_fullsized":"2024-05-10T09:54:34.584732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.582062+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:54:34.582062+0000","last_peered":"2024-05-10T09:54:34.582062+0000","last_clean":"2024-05-10T09:54:34.582062+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:54:34.582062+0000","last_undegraded":"2024-05-10T09:54:34.582062+0000","last_fullsized":"2024-05-10T09:54:34.582062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.763824+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:54:34.763824+0000","last_peered":"2024-05-10T09:54:34.763824+0000","last_clean":"2024-05-10T09:54:34.763824+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:54:34.763824+0000","last_undegraded":"2024-05-10T09:54:34.763824+0000","last_fullsized":"2024-05-10T09:54:34.763824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.584602+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:54:34.584602+0000","last_peered":"2024-05-10T09:54:34.584602+0000","last_clean":"2024-05-10T09:54:34.584602+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:54:34.584602+0000","last_undegraded":"2024-05-10T09:54:34.584602+0000","last_fullsized":"2024-05-10T09:54:34.584602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":108,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.763541+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:54:34.763541+0000","last_peered":"2024-05-10T09:54:34.763541+0000","last_clean":"2024-05-10T09:54:34.763541+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:54:34.763541+0000","last_undegraded":"2024-05-10T09:54:34.763541+0000","last_fullsized":"2024-05-10T09:54:34.763541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":657705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":657705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":221184,"data_stored":73085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:54:37.412 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:54:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:37.701 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:54:37.717 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-10T09:54:36.169357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239792,"kb_used_data":2804,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734928,"statfs":{"total":773094113280,"available":772848566272,"internally_reserved":0,"allocated":2871296,"data_stored":1725180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":242535990},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001088"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.763002+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:54:34.763002+0000","last_peered":"2024-05-10T09:54:34.763002+0000","last_clean":"2024-05-10T09:54:34.763002+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:54:34.763002+0000","last_undegraded":"2024-05-10T09:54:34.763002+0000","last_fullsized":"2024-05-10T09:54:34.763002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.582493+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:54:34.582493+0000","last_peered":"2024-05-10T09:54:34.582493+0000","last_clean":"2024-05-10T09:54:34.582493+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:54:34.582493+0000","last_undegraded":"2024-05-10T09:54:34.582493+0000","last_fullsized":"2024-05-10T09:54:34.582493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.763837+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:54:34.763837+0000","last_peered":"2024-05-10T09:54:34.763837+0000","last_clean":"2024-05-10T09:54:34.763837+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:54:34.763837+0000","last_undegraded":"2024-05-10T09:54:34.763837+0000","last_fullsized":"2024-05-10T09:54:34.763837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.582102+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:54:34.582102+0000","last_peered":"2024-05-10T09:54:34.582102+0000","last_clean":"2024-05-10T09:54:34.582102+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:54:34.582102+0000","last_undegraded":"2024-05-10T09:54:34.582102+0000","last_fullsized":"2024-05-10T09:54:34.582102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.584732+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:54:34.584732+0000","last_peered":"2024-05-10T09:54:34.584732+0000","last_clean":"2024-05-10T09:54:34.584732+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:54:34.584732+0000","last_undegraded":"2024-05-10T09:54:34.584732+0000","last_fullsized":"2024-05-10T09:54:34.584732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.582062+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:54:34.582062+0000","last_peered":"2024-05-10T09:54:34.582062+0000","last_clean":"2024-05-10T09:54:34.582062+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:54:34.582062+0000","last_undegraded":"2024-05-10T09:54:34.582062+0000","last_fullsized":"2024-05-10T09:54:34.582062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.763824+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:54:34.763824+0000","last_peered":"2024-05-10T09:54:34.763824+0000","last_clean":"2024-05-10T09:54:34.763824+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:54:34.763824+0000","last_undegraded":"2024-05-10T09:54:34.763824+0000","last_fullsized":"2024-05-10T09:54:34.763824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.584602+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:54:34.584602+0000","last_peered":"2024-05-10T09:54:34.584602+0000","last_clean":"2024-05-10T09:54:34.584602+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:54:34.584602+0000","last_undegraded":"2024-05-10T09:54:34.584602+0000","last_fullsized":"2024-05-10T09:54:34.584602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":108,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-05-10T09:54:34.763541+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:54:34.763541+0000","last_peered":"2024-05-10T09:54:34.763541+0000","last_clean":"2024-05-10T09:54:34.763541+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:54:34.763541+0000","last_undegraded":"2024-05-10T09:54:34.763541+0000","last_fullsized":"2024-05-10T09:54:34.763541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":657705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":67337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":802816,"data_stored":657705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":221184,"data_stored":73085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:54:37.718 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T09:54:37.718 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T09:54:37.718 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-10T09:54:37.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T09:54:38.030 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:38.030 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T09:54:38.047 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-10T09:54:38.048 INFO:teuthology.run_tasks:Running task rgw... 2024-05-10T09:54:38.065 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-10T09:54:38.065 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-10T09:54:38.066 INFO:tasks.rgw:Creating data pools 2024-05-10T09:54:38.066 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-10T09:54:38.066 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-05-10T09:54:38.611 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'default.rgw.buckets.data' created 2024-05-10T09:54:38.639 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-10T09:54:39.603 INFO:teuthology.orchestra.run.smithi042.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-10T09:54:39.641 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-10T09:54:40.624 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'default.rgw.buckets.index' created 2024-05-10T09:54:40.661 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-10T09:54:41.627 INFO:teuthology.orchestra.run.smithi042.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-10T09:54:41.671 DEBUG:tasks.rgw:Pools created 2024-05-10T09:54:41.672 INFO:tasks.rgw:Starting rgw... 2024-05-10T09:54:41.672 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-10T09:54:41.672 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-10T09:54:41.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo echo -n http://smithi042.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-10T09:54:41.687 INFO:teuthology.orchestra.run.smithi042.stdout:http://smithi042.front.sepia.ceph.com:80 2024-05-10T09:54:41.687 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-10T09:54:41.743 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-10T09:54:41.743 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-10T09:54:41.790 INFO:tasks.rgw.client.0:Started 2024-05-10T09:54:41.790 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi042.front.sepia.ceph.com:80/ 2024-05-10T09:54:41.791 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-05-10T09:54:41.818 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-10T09:54:41.818 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T09:54:41.818 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-05-10T09:54:41.818 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-10T09:54:41.818 INFO:teuthology.orchestra.run.smithi042.stderr:curl: (7) Failed to connect to smithi042.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-10T09:54:42.820 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-05-10T09:54:42.832 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T09:54:42.832 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-05-10T09:54:42.832 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-10T09:54:42.832 INFO:teuthology.orchestra.run.smithi042.stderr:curl: (7) Failed to connect to smithi042.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-10T09:54:42.833 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-10T09:54:44.833 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-05-10T09:54:44.845 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T09:54:44.845 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-05-10T09:54:44.846 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-10T09:54:44.846 INFO:teuthology.orchestra.run.smithi042.stderr:curl: (7) Failed to connect to smithi042.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-10T09:54:44.846 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-10T09:54:48.847 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-05-10T09:54:48.859 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T09:54:48.859 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-05-10T09:54:48.860 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-10T09:54:48.860 INFO:teuthology.orchestra.run.smithi042.stderr:curl: (7) Failed to connect to smithi042.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-10T09:54:48.861 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-10T09:54:50.893 INFO:tasks.rgw.client.0.smithi042.stdout:2024-05-10T09:54:50.893+0000 7fd04575ba40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-10T09:54:56.862 DEBUG:teuthology.orchestra.run.smithi042:> curl http://smithi042.front.sepia.ceph.com:80/ 2024-05-10T09:54:56.873 INFO:teuthology.orchestra.run.smithi042.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-10T09:54:56.873 INFO:teuthology.orchestra.run.smithi042.stderr: Dload Upload Total Spent Left Speed 2024-05-10T09:54:56.877 INFO:teuthology.orchestra.run.smithi042.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 52031 0 --:--:-- --:--:-- --:--:-- 62333 2024-05-10T09:54:56.877 INFO:teuthology.orchestra.run.smithi042.stdout:anonymous 2024-05-10T09:54:56.878 INFO:teuthology.run_tasks:Running task thrashosds... 2024-05-10T09:54:56.903 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-05-10T09:54:56.903 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-skoduri-lc-notify'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-skoduri-lc-notify', 'sha1': '5be95034c7c2ad8a0361951b19205b782eb6be06'}} 2024-05-10T09:54:56.903 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-05-10T09:54:56.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-05-10T09:54:57.263 INFO:tasks.thrashosds:Beginning thrashosds... 2024-05-10T09:54:57.263 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T09:54:57.263 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:54:57.623 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:57.629 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:54:57.644 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-10T09:54:56.176087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249740,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724980,"statfs":{"total":773094113280,"available":772838379520,"internally_reserved":0,"allocated":4562944,"data_stored":2533630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":251055670},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.487858"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720450+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:54:50.720450+0000","last_peered":"2024-05-10T09:54:50.720450+0000","last_clean":"2024-05-10T09:54:50.720450+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:54:50.720450+0000","last_undegraded":"2024-05-10T09:54:50.720450+0000","last_fullsized":"2024-05-10T09:54:50.720450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745614+0000","last_change":"2024-05-10T09:54:41.667015+0000","last_active":"2024-05-10T09:54:50.745614+0000","last_peered":"2024-05-10T09:54:50.745614+0000","last_clean":"2024-05-10T09:54:50.745614+0000","last_became_active":"2024-05-10T09:54:41.666273+0000","last_became_peered":"2024-05-10T09:54:41.666273+0000","last_unstale":"2024-05-10T09:54:50.745614+0000","last_undegraded":"2024-05-10T09:54:50.745614+0000","last_fullsized":"2024-05-10T09:54:50.745614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740976+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:54:50.740976+0000","last_peered":"2024-05-10T09:54:50.740976+0000","last_clean":"2024-05-10T09:54:50.740976+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:54:50.740976+0000","last_undegraded":"2024-05-10T09:54:50.740976+0000","last_fullsized":"2024-05-10T09:54:50.740976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720154+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:54:50.720154+0000","last_peered":"2024-05-10T09:54:50.720154+0000","last_clean":"2024-05-10T09:54:50.720154+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:54:50.720154+0000","last_undegraded":"2024-05-10T09:54:50.720154+0000","last_fullsized":"2024-05-10T09:54:50.720154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755624+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:54:50.755624+0000","last_peered":"2024-05-10T09:54:50.755624+0000","last_clean":"2024-05-10T09:54:50.755624+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:54:50.755624+0000","last_undegraded":"2024-05-10T09:54:50.755624+0000","last_fullsized":"2024-05-10T09:54:50.755624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763861+0000","last_change":"2024-05-10T09:54:41.653638+0000","last_active":"2024-05-10T09:54:50.763861+0000","last_peered":"2024-05-10T09:54:50.763861+0000","last_clean":"2024-05-10T09:54:50.763861+0000","last_became_active":"2024-05-10T09:54:41.652899+0000","last_became_peered":"2024-05-10T09:54:41.652899+0000","last_unstale":"2024-05-10T09:54:50.763861+0000","last_undegraded":"2024-05-10T09:54:50.763861+0000","last_fullsized":"2024-05-10T09:54:50.763861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747577+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:54:50.747577+0000","last_peered":"2024-05-10T09:54:50.747577+0000","last_clean":"2024-05-10T09:54:50.747577+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:54:50.747577+0000","last_undegraded":"2024-05-10T09:54:50.747577+0000","last_fullsized":"2024-05-10T09:54:50.747577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754734+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:54:50.754734+0000","last_peered":"2024-05-10T09:54:50.754734+0000","last_clean":"2024-05-10T09:54:50.754734+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:54:50.754734+0000","last_undegraded":"2024-05-10T09:54:50.754734+0000","last_fullsized":"2024-05-10T09:54:50.754734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720668+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:54:50.720668+0000","last_peered":"2024-05-10T09:54:50.720668+0000","last_clean":"2024-05-10T09:54:50.720668+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:54:50.720668+0000","last_undegraded":"2024-05-10T09:54:50.720668+0000","last_fullsized":"2024-05-10T09:54:50.720668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752588+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:54:50.752588+0000","last_peered":"2024-05-10T09:54:50.752588+0000","last_clean":"2024-05-10T09:54:50.752588+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:54:50.752588+0000","last_undegraded":"2024-05-10T09:54:50.752588+0000","last_fullsized":"2024-05-10T09:54:50.752588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746293+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:54:50.746293+0000","last_peered":"2024-05-10T09:54:50.746293+0000","last_clean":"2024-05-10T09:54:50.746293+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:54:50.746293+0000","last_undegraded":"2024-05-10T09:54:50.746293+0000","last_fullsized":"2024-05-10T09:54:50.746293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765007+0000","last_change":"2024-05-10T09:54:41.653073+0000","last_active":"2024-05-10T09:54:50.765007+0000","last_peered":"2024-05-10T09:54:50.765007+0000","last_clean":"2024-05-10T09:54:50.765007+0000","last_became_active":"2024-05-10T09:54:41.652296+0000","last_became_peered":"2024-05-10T09:54:41.652296+0000","last_unstale":"2024-05-10T09:54:50.765007+0000","last_undegraded":"2024-05-10T09:54:50.765007+0000","last_fullsized":"2024-05-10T09:54:50.765007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720393+0000","last_change":"2024-05-10T09:54:39.636608+0000","last_active":"2024-05-10T09:54:50.720393+0000","last_peered":"2024-05-10T09:54:50.720393+0000","last_clean":"2024-05-10T09:54:50.720393+0000","last_became_active":"2024-05-10T09:54:39.635348+0000","last_became_peered":"2024-05-10T09:54:39.635348+0000","last_unstale":"2024-05-10T09:54:50.720393+0000","last_undegraded":"2024-05-10T09:54:50.720393+0000","last_fullsized":"2024-05-10T09:54:50.720393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747138+0000","last_change":"2024-05-10T09:54:41.671781+0000","last_active":"2024-05-10T09:54:50.747138+0000","last_peered":"2024-05-10T09:54:50.747138+0000","last_clean":"2024-05-10T09:54:50.747138+0000","last_became_active":"2024-05-10T09:54:41.668302+0000","last_became_peered":"2024-05-10T09:54:41.668302+0000","last_unstale":"2024-05-10T09:54:50.747138+0000","last_undegraded":"2024-05-10T09:54:50.747138+0000","last_fullsized":"2024-05-10T09:54:50.747138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:51.449905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720507+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:54:50.720507+0000","last_peered":"2024-05-10T09:54:50.720507+0000","last_clean":"2024-05-10T09:54:50.720507+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:54:50.720507+0000","last_undegraded":"2024-05-10T09:54:50.720507+0000","last_fullsized":"2024-05-10T09:54:50.720507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.722234+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:54:50.722234+0000","last_peered":"2024-05-10T09:54:50.722234+0000","last_clean":"2024-05-10T09:54:50.722234+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:54:50.722234+0000","last_undegraded":"2024-05-10T09:54:50.722234+0000","last_fullsized":"2024-05-10T09:54:50.722234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763445+0000","last_change":"2024-05-10T09:54:41.650051+0000","last_active":"2024-05-10T09:54:50.763445+0000","last_peered":"2024-05-10T09:54:50.763445+0000","last_clean":"2024-05-10T09:54:50.763445+0000","last_became_active":"2024-05-10T09:54:41.649076+0000","last_became_peered":"2024-05-10T09:54:41.649076+0000","last_unstale":"2024-05-10T09:54:50.763445+0000","last_undegraded":"2024-05-10T09:54:50.763445+0000","last_fullsized":"2024-05-10T09:54:50.763445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720686+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:54:50.720686+0000","last_peered":"2024-05-10T09:54:50.720686+0000","last_clean":"2024-05-10T09:54:50.720686+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:54:50.720686+0000","last_undegraded":"2024-05-10T09:54:50.720686+0000","last_fullsized":"2024-05-10T09:54:50.720686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720314+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:54:50.720314+0000","last_peered":"2024-05-10T09:54:50.720314+0000","last_clean":"2024-05-10T09:54:50.720314+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:54:50.720314+0000","last_undegraded":"2024-05-10T09:54:50.720314+0000","last_fullsized":"2024-05-10T09:54:50.720314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753212+0000","last_change":"2024-05-10T09:54:39.661291+0000","last_active":"2024-05-10T09:54:50.753212+0000","last_peered":"2024-05-10T09:54:50.753212+0000","last_clean":"2024-05-10T09:54:50.753212+0000","last_became_active":"2024-05-10T09:54:39.660723+0000","last_became_peered":"2024-05-10T09:54:39.660723+0000","last_unstale":"2024-05-10T09:54:50.753212+0000","last_undegraded":"2024-05-10T09:54:50.753212+0000","last_fullsized":"2024-05-10T09:54:50.753212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746673+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:54:50.746673+0000","last_peered":"2024-05-10T09:54:50.746673+0000","last_clean":"2024-05-10T09:54:50.746673+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:54:50.746673+0000","last_undegraded":"2024-05-10T09:54:50.746673+0000","last_fullsized":"2024-05-10T09:54:50.746673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753336+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:54:50.753336+0000","last_peered":"2024-05-10T09:54:50.753336+0000","last_clean":"2024-05-10T09:54:50.753336+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:54:50.753336+0000","last_undegraded":"2024-05-10T09:54:50.753336+0000","last_fullsized":"2024-05-10T09:54:50.753336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719590+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:54:50.719590+0000","last_peered":"2024-05-10T09:54:50.719590+0000","last_clean":"2024-05-10T09:54:50.719590+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:54:50.719590+0000","last_undegraded":"2024-05-10T09:54:50.719590+0000","last_fullsized":"2024-05-10T09:54:50.719590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764291+0000","last_change":"2024-05-10T09:54:39.645559+0000","last_active":"2024-05-10T09:54:50.764291+0000","last_peered":"2024-05-10T09:54:50.764291+0000","last_clean":"2024-05-10T09:54:50.764291+0000","last_became_active":"2024-05-10T09:54:39.644846+0000","last_became_peered":"2024-05-10T09:54:39.644846+0000","last_unstale":"2024-05-10T09:54:50.764291+0000","last_undegraded":"2024-05-10T09:54:50.764291+0000","last_fullsized":"2024-05-10T09:54:50.764291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719996+0000","last_change":"2024-05-10T09:54:41.649115+0000","last_active":"2024-05-10T09:54:50.719996+0000","last_peered":"2024-05-10T09:54:50.719996+0000","last_clean":"2024-05-10T09:54:50.719996+0000","last_became_active":"2024-05-10T09:54:41.647430+0000","last_became_peered":"2024-05-10T09:54:41.647430+0000","last_unstale":"2024-05-10T09:54:50.719996+0000","last_undegraded":"2024-05-10T09:54:50.719996+0000","last_fullsized":"2024-05-10T09:54:50.719996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:42.765522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720277+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:54:50.720277+0000","last_peered":"2024-05-10T09:54:50.720277+0000","last_clean":"2024-05-10T09:54:50.720277+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:54:50.720277+0000","last_undegraded":"2024-05-10T09:54:50.720277+0000","last_fullsized":"2024-05-10T09:54:50.720277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765030+0000","last_change":"2024-05-10T09:54:41.682344+0000","last_active":"2024-05-10T09:54:50.765030+0000","last_peered":"2024-05-10T09:54:50.765030+0000","last_clean":"2024-05-10T09:54:50.765030+0000","last_became_active":"2024-05-10T09:54:41.681757+0000","last_became_peered":"2024-05-10T09:54:41.681757+0000","last_unstale":"2024-05-10T09:54:50.765030+0000","last_undegraded":"2024-05-10T09:54:50.765030+0000","last_fullsized":"2024-05-10T09:54:50.765030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755171+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:54:50.755171+0000","last_peered":"2024-05-10T09:54:50.755171+0000","last_clean":"2024-05-10T09:54:50.755171+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:54:50.755171+0000","last_undegraded":"2024-05-10T09:54:50.755171+0000","last_fullsized":"2024-05-10T09:54:50.755171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763158+0000","last_change":"2024-05-10T09:54:49.721834+0000","last_active":"2024-05-10T09:54:50.763158+0000","last_peered":"2024-05-10T09:54:50.763158+0000","last_clean":"2024-05-10T09:54:50.763158+0000","last_became_active":"2024-05-10T09:54:49.721053+0000","last_became_peered":"2024-05-10T09:54:49.721053+0000","last_unstale":"2024-05-10T09:54:50.763158+0000","last_undegraded":"2024-05-10T09:54:50.763158+0000","last_fullsized":"2024-05-10T09:54:50.763158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:57.380622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723802+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:54:50.723802+0000","last_peered":"2024-05-10T09:54:50.723802+0000","last_clean":"2024-05-10T09:54:50.723802+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:54:50.723802+0000","last_undegraded":"2024-05-10T09:54:50.723802+0000","last_fullsized":"2024-05-10T09:54:50.723802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720866+0000","last_change":"2024-05-10T09:54:39.650251+0000","last_active":"2024-05-10T09:54:50.720866+0000","last_peered":"2024-05-10T09:54:50.720866+0000","last_clean":"2024-05-10T09:54:50.720866+0000","last_became_active":"2024-05-10T09:54:39.649230+0000","last_became_peered":"2024-05-10T09:54:39.649230+0000","last_unstale":"2024-05-10T09:54:50.720866+0000","last_undegraded":"2024-05-10T09:54:50.720866+0000","last_fullsized":"2024-05-10T09:54:50.720866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747672+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:54:50.747672+0000","last_peered":"2024-05-10T09:54:50.747672+0000","last_clean":"2024-05-10T09:54:50.747672+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:54:50.747672+0000","last_undegraded":"2024-05-10T09:54:50.747672+0000","last_fullsized":"2024-05-10T09:54:50.747672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.151229+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:54:51.151229+0000","last_peered":"2024-05-10T09:54:51.151229+0000","last_clean":"2024-05-10T09:54:51.151229+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:54:51.151229+0000","last_undegraded":"2024-05-10T09:54:51.151229+0000","last_fullsized":"2024-05-10T09:54:51.151229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719952+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:54:50.719952+0000","last_peered":"2024-05-10T09:54:50.719952+0000","last_clean":"2024-05-10T09:54:50.719952+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:54:50.719952+0000","last_undegraded":"2024-05-10T09:54:50.719952+0000","last_fullsized":"2024-05-10T09:54:50.719952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745524+0000","last_change":"2024-05-10T09:54:49.714649+0000","last_active":"2024-05-10T09:54:50.745524+0000","last_peered":"2024-05-10T09:54:50.745524+0000","last_clean":"2024-05-10T09:54:50.745524+0000","last_became_active":"2024-05-10T09:54:49.713854+0000","last_became_peered":"2024-05-10T09:54:49.713854+0000","last_unstale":"2024-05-10T09:54:50.745524+0000","last_undegraded":"2024-05-10T09:54:50.745524+0000","last_fullsized":"2024-05-10T09:54:50.745524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748188+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:54:50.748188+0000","last_peered":"2024-05-10T09:54:50.748188+0000","last_clean":"2024-05-10T09:54:50.748188+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:54:50.748188+0000","last_undegraded":"2024-05-10T09:54:50.748188+0000","last_fullsized":"2024-05-10T09:54:50.748188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755849+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:54:50.755849+0000","last_peered":"2024-05-10T09:54:50.755849+0000","last_clean":"2024-05-10T09:54:50.755849+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:54:50.755849+0000","last_undegraded":"2024-05-10T09:54:50.755849+0000","last_fullsized":"2024-05-10T09:54:50.755849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723389+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:54:50.723389+0000","last_peered":"2024-05-10T09:54:50.723389+0000","last_clean":"2024-05-10T09:54:50.723389+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:54:50.723389+0000","last_undegraded":"2024-05-10T09:54:50.723389+0000","last_fullsized":"2024-05-10T09:54:50.723389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.552431+0000","last_change":"2024-05-10T09:54:45.672737+0000","last_active":"2024-05-10T09:54:51.552431+0000","last_peered":"2024-05-10T09:54:51.552431+0000","last_clean":"2024-05-10T09:54:51.552431+0000","last_became_active":"2024-05-10T09:54:45.671969+0000","last_became_peered":"2024-05-10T09:54:45.671969+0000","last_unstale":"2024-05-10T09:54:51.552431+0000","last_undegraded":"2024-05-10T09:54:51.552431+0000","last_fullsized":"2024-05-10T09:54:51.552431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765022+0000","last_change":"2024-05-10T09:54:47.705920+0000","last_active":"2024-05-10T09:54:50.765022+0000","last_peered":"2024-05-10T09:54:50.765022+0000","last_clean":"2024-05-10T09:54:50.765022+0000","last_became_active":"2024-05-10T09:54:47.705078+0000","last_became_peered":"2024-05-10T09:54:47.705078+0000","last_unstale":"2024-05-10T09:54:50.765022+0000","last_undegraded":"2024-05-10T09:54:50.765022+0000","last_fullsized":"2024-05-10T09:54:50.765022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754437+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:54:50.754437+0000","last_peered":"2024-05-10T09:54:50.754437+0000","last_clean":"2024-05-10T09:54:50.754437+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:54:50.754437+0000","last_undegraded":"2024-05-10T09:54:50.754437+0000","last_fullsized":"2024-05-10T09:54:50.754437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757827+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:54:50.757827+0000","last_peered":"2024-05-10T09:54:50.757827+0000","last_clean":"2024-05-10T09:54:50.757827+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:54:50.757827+0000","last_undegraded":"2024-05-10T09:54:50.757827+0000","last_fullsized":"2024-05-10T09:54:50.757827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720453+0000","last_change":"2024-05-10T09:54:39.656953+0000","last_active":"2024-05-10T09:54:50.720453+0000","last_peered":"2024-05-10T09:54:50.720453+0000","last_clean":"2024-05-10T09:54:50.720453+0000","last_became_active":"2024-05-10T09:54:39.656385+0000","last_became_peered":"2024-05-10T09:54:39.656385+0000","last_unstale":"2024-05-10T09:54:50.720453+0000","last_undegraded":"2024-05-10T09:54:50.720453+0000","last_fullsized":"2024-05-10T09:54:50.720453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.724159+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:54:50.724159+0000","last_peered":"2024-05-10T09:54:50.724159+0000","last_clean":"2024-05-10T09:54:50.724159+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:54:50.724159+0000","last_undegraded":"2024-05-10T09:54:50.724159+0000","last_fullsized":"2024-05-10T09:54:50.724159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.610407+0000","last_change":"2024-05-10T09:54:45.682487+0000","last_active":"2024-05-10T09:54:51.610407+0000","last_peered":"2024-05-10T09:54:51.610407+0000","last_clean":"2024-05-10T09:54:51.610407+0000","last_became_active":"2024-05-10T09:54:45.681037+0000","last_became_peered":"2024-05-10T09:54:45.681037+0000","last_unstale":"2024-05-10T09:54:51.610407+0000","last_undegraded":"2024-05-10T09:54:51.610407+0000","last_fullsized":"2024-05-10T09:54:51.610407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.890143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719700+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:54:50.719700+0000","last_peered":"2024-05-10T09:54:50.719700+0000","last_clean":"2024-05-10T09:54:50.719700+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:54:50.719700+0000","last_undegraded":"2024-05-10T09:54:50.719700+0000","last_fullsized":"2024-05-10T09:54:50.719700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763932+0000","last_change":"2024-05-10T09:54:49.698020+0000","last_active":"2024-05-10T09:54:50.763932+0000","last_peered":"2024-05-10T09:54:50.763932+0000","last_clean":"2024-05-10T09:54:50.763932+0000","last_became_active":"2024-05-10T09:54:49.697266+0000","last_became_peered":"2024-05-10T09:54:49.697266+0000","last_unstale":"2024-05-10T09:54:50.763932+0000","last_undegraded":"2024-05-10T09:54:50.763932+0000","last_fullsized":"2024-05-10T09:54:50.763932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:03.046232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723440+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:54:50.723440+0000","last_peered":"2024-05-10T09:54:50.723440+0000","last_clean":"2024-05-10T09:54:50.723440+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:54:50.723440+0000","last_undegraded":"2024-05-10T09:54:50.723440+0000","last_fullsized":"2024-05-10T09:54:50.723440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751433+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:54:50.751433+0000","last_peered":"2024-05-10T09:54:50.751433+0000","last_clean":"2024-05-10T09:54:50.751433+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:54:50.751433+0000","last_undegraded":"2024-05-10T09:54:50.751433+0000","last_fullsized":"2024-05-10T09:54:50.751433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746878+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:54:50.746878+0000","last_peered":"2024-05-10T09:54:50.746878+0000","last_clean":"2024-05-10T09:54:50.746878+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:54:50.746878+0000","last_undegraded":"2024-05-10T09:54:50.746878+0000","last_fullsized":"2024-05-10T09:54:50.746878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.618251+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:54:51.618251+0000","last_peered":"2024-05-10T09:54:51.618251+0000","last_clean":"2024-05-10T09:54:51.618251+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:54:51.618251+0000","last_undegraded":"2024-05-10T09:54:51.618251+0000","last_fullsized":"2024-05-10T09:54:51.618251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723365+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:54:50.723365+0000","last_peered":"2024-05-10T09:54:50.723365+0000","last_clean":"2024-05-10T09:54:50.723365+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:54:50.723365+0000","last_undegraded":"2024-05-10T09:54:50.723365+0000","last_fullsized":"2024-05-10T09:54:50.723365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745997+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:54:50.745997+0000","last_peered":"2024-05-10T09:54:50.745997+0000","last_clean":"2024-05-10T09:54:50.745997+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:54:50.745997+0000","last_undegraded":"2024-05-10T09:54:50.745997+0000","last_fullsized":"2024-05-10T09:54:50.745997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720929+0000","last_change":"2024-05-10T09:54:39.655305+0000","last_active":"2024-05-10T09:54:50.720929+0000","last_peered":"2024-05-10T09:54:50.720929+0000","last_clean":"2024-05-10T09:54:50.720929+0000","last_became_active":"2024-05-10T09:54:39.654853+0000","last_became_peered":"2024-05-10T09:54:39.654853+0000","last_unstale":"2024-05-10T09:54:50.720929+0000","last_undegraded":"2024-05-10T09:54:50.720929+0000","last_fullsized":"2024-05-10T09:54:50.720929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718848+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:54:50.718848+0000","last_peered":"2024-05-10T09:54:50.718848+0000","last_clean":"2024-05-10T09:54:50.718848+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:54:50.718848+0000","last_undegraded":"2024-05-10T09:54:50.718848+0000","last_fullsized":"2024-05-10T09:54:50.718848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.714769+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:54:51.714769+0000","last_peered":"2024-05-10T09:54:51.714769+0000","last_clean":"2024-05-10T09:54:51.714769+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:54:51.714769+0000","last_undegraded":"2024-05-10T09:54:51.714769+0000","last_fullsized":"2024-05-10T09:54:51.714769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739335+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:54:50.739335+0000","last_peered":"2024-05-10T09:54:50.739335+0000","last_clean":"2024-05-10T09:54:50.739335+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:54:50.739335+0000","last_undegraded":"2024-05-10T09:54:50.739335+0000","last_fullsized":"2024-05-10T09:54:50.739335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747009+0000","last_change":"2024-05-10T09:54:49.714403+0000","last_active":"2024-05-10T09:54:50.747009+0000","last_peered":"2024-05-10T09:54:50.747009+0000","last_clean":"2024-05-10T09:54:50.747009+0000","last_became_active":"2024-05-10T09:54:49.713603+0000","last_became_peered":"2024-05-10T09:54:49.713603+0000","last_unstale":"2024-05-10T09:54:50.747009+0000","last_undegraded":"2024-05-10T09:54:50.747009+0000","last_fullsized":"2024-05-10T09:54:50.747009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763415+0000","last_change":"2024-05-10T09:54:41.679939+0000","last_active":"2024-05-10T09:54:50.763415+0000","last_peered":"2024-05-10T09:54:50.763415+0000","last_clean":"2024-05-10T09:54:50.763415+0000","last_became_active":"2024-05-10T09:54:41.677609+0000","last_became_peered":"2024-05-10T09:54:41.677609+0000","last_unstale":"2024-05-10T09:54:50.763415+0000","last_undegraded":"2024-05-10T09:54:50.763415+0000","last_fullsized":"2024-05-10T09:54:50.763415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:32.390355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720262+0000","last_change":"2024-05-10T09:54:39.653238+0000","last_active":"2024-05-10T09:54:50.720262+0000","last_peered":"2024-05-10T09:54:50.720262+0000","last_clean":"2024-05-10T09:54:50.720262+0000","last_became_active":"2024-05-10T09:54:39.652480+0000","last_became_peered":"2024-05-10T09:54:39.652480+0000","last_unstale":"2024-05-10T09:54:50.720262+0000","last_undegraded":"2024-05-10T09:54:50.720262+0000","last_fullsized":"2024-05-10T09:54:50.720262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:14.288277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718201+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:54:50.718201+0000","last_peered":"2024-05-10T09:54:50.718201+0000","last_clean":"2024-05-10T09:54:50.718201+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:54:50.718201+0000","last_undegraded":"2024-05-10T09:54:50.718201+0000","last_fullsized":"2024-05-10T09:54:50.718201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.587695+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:54:51.587695+0000","last_peered":"2024-05-10T09:54:51.587695+0000","last_clean":"2024-05-10T09:54:51.587695+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:54:51.587695+0000","last_undegraded":"2024-05-10T09:54:51.587695+0000","last_fullsized":"2024-05-10T09:54:51.587695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718942+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:54:50.718942+0000","last_peered":"2024-05-10T09:54:50.718942+0000","last_clean":"2024-05-10T09:54:50.718942+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:54:50.718942+0000","last_undegraded":"2024-05-10T09:54:50.718942+0000","last_fullsized":"2024-05-10T09:54:50.718942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752672+0000","last_change":"2024-05-10T09:54:49.713266+0000","last_active":"2024-05-10T09:54:50.752672+0000","last_peered":"2024-05-10T09:54:50.752672+0000","last_clean":"2024-05-10T09:54:50.752672+0000","last_became_active":"2024-05-10T09:54:49.712512+0000","last_became_peered":"2024-05-10T09:54:49.712512+0000","last_unstale":"2024-05-10T09:54:50.752672+0000","last_undegraded":"2024-05-10T09:54:50.752672+0000","last_fullsized":"2024-05-10T09:54:50.752672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:27:03.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752036+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:54:50.752036+0000","last_peered":"2024-05-10T09:54:50.752036+0000","last_clean":"2024-05-10T09:54:50.752036+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:54:50.752036+0000","last_undegraded":"2024-05-10T09:54:50.752036+0000","last_fullsized":"2024-05-10T09:54:50.752036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721044+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:54:50.721044+0000","last_peered":"2024-05-10T09:54:50.721044+0000","last_clean":"2024-05-10T09:54:50.721044+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:54:50.721044+0000","last_undegraded":"2024-05-10T09:54:50.721044+0000","last_fullsized":"2024-05-10T09:54:50.721044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720374+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:54:50.720374+0000","last_peered":"2024-05-10T09:54:50.720374+0000","last_clean":"2024-05-10T09:54:50.720374+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:54:50.720374+0000","last_undegraded":"2024-05-10T09:54:50.720374+0000","last_fullsized":"2024-05-10T09:54:50.720374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.502943+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:54:51.502943+0000","last_peered":"2024-05-10T09:54:51.502943+0000","last_clean":"2024-05-10T09:54:51.502943+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:54:51.502943+0000","last_undegraded":"2024-05-10T09:54:51.502943+0000","last_fullsized":"2024-05-10T09:54:51.502943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753947+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:54:50.753947+0000","last_peered":"2024-05-10T09:54:50.753947+0000","last_clean":"2024-05-10T09:54:50.753947+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:54:50.753947+0000","last_undegraded":"2024-05-10T09:54:50.753947+0000","last_fullsized":"2024-05-10T09:54:50.753947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756484+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:54:50.756484+0000","last_peered":"2024-05-10T09:54:50.756484+0000","last_clean":"2024-05-10T09:54:50.756484+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:54:50.756484+0000","last_undegraded":"2024-05-10T09:54:50.756484+0000","last_fullsized":"2024-05-10T09:54:50.756484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756292+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:54:50.756292+0000","last_peered":"2024-05-10T09:54:50.756292+0000","last_clean":"2024-05-10T09:54:50.756292+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:54:50.756292+0000","last_undegraded":"2024-05-10T09:54:50.756292+0000","last_fullsized":"2024-05-10T09:54:50.756292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748143+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:54:50.748143+0000","last_peered":"2024-05-10T09:54:50.748143+0000","last_clean":"2024-05-10T09:54:50.748143+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:54:50.748143+0000","last_undegraded":"2024-05-10T09:54:50.748143+0000","last_fullsized":"2024-05-10T09:54:50.748143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719170+0000","last_change":"2024-05-10T09:54:43.670736+0000","last_active":"2024-05-10T09:54:50.719170+0000","last_peered":"2024-05-10T09:54:50.719170+0000","last_clean":"2024-05-10T09:54:50.719170+0000","last_became_active":"2024-05-10T09:54:43.670051+0000","last_became_peered":"2024-05-10T09:54:43.670051+0000","last_unstale":"2024-05-10T09:54:50.719170+0000","last_undegraded":"2024-05-10T09:54:50.719170+0000","last_fullsized":"2024-05-10T09:54:50.719170+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:06.739493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.118485+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:54:51.118485+0000","last_peered":"2024-05-10T09:54:51.118485+0000","last_clean":"2024-05-10T09:54:51.118485+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:54:51.118485+0000","last_undegraded":"2024-05-10T09:54:51.118485+0000","last_fullsized":"2024-05-10T09:54:51.118485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718001+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:54:50.718001+0000","last_peered":"2024-05-10T09:54:50.718001+0000","last_clean":"2024-05-10T09:54:50.718001+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:54:50.718001+0000","last_undegraded":"2024-05-10T09:54:50.718001+0000","last_fullsized":"2024-05-10T09:54:50.718001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740565+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:54:50.740565+0000","last_peered":"2024-05-10T09:54:50.740565+0000","last_clean":"2024-05-10T09:54:50.740565+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:54:50.740565+0000","last_undegraded":"2024-05-10T09:54:50.740565+0000","last_fullsized":"2024-05-10T09:54:50.740565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764597+0000","last_change":"2024-05-10T09:54:41.660216+0000","last_active":"2024-05-10T09:54:50.764597+0000","last_peered":"2024-05-10T09:54:50.764597+0000","last_clean":"2024-05-10T09:54:50.764597+0000","last_became_active":"2024-05-10T09:54:41.659431+0000","last_became_peered":"2024-05-10T09:54:41.659431+0000","last_unstale":"2024-05-10T09:54:50.764597+0000","last_undegraded":"2024-05-10T09:54:50.764597+0000","last_fullsized":"2024-05-10T09:54:50.764597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719614+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:54:50.719614+0000","last_peered":"2024-05-10T09:54:50.719614+0000","last_clean":"2024-05-10T09:54:50.719614+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:54:50.719614+0000","last_undegraded":"2024-05-10T09:54:50.719614+0000","last_fullsized":"2024-05-10T09:54:50.719614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720635+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:54:50.720635+0000","last_peered":"2024-05-10T09:54:50.720635+0000","last_clean":"2024-05-10T09:54:50.720635+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:54:50.720635+0000","last_undegraded":"2024-05-10T09:54:50.720635+0000","last_fullsized":"2024-05-10T09:54:50.720635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.653243+0000","last_change":"2024-05-10T09:54:45.680787+0000","last_active":"2024-05-10T09:54:51.653243+0000","last_peered":"2024-05-10T09:54:51.653243+0000","last_clean":"2024-05-10T09:54:51.653243+0000","last_became_active":"2024-05-10T09:54:45.680051+0000","last_became_peered":"2024-05-10T09:54:45.680051+0000","last_unstale":"2024-05-10T09:54:51.653243+0000","last_undegraded":"2024-05-10T09:54:51.653243+0000","last_fullsized":"2024-05-10T09:54:51.653243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756300+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:54:50.756300+0000","last_peered":"2024-05-10T09:54:50.756300+0000","last_clean":"2024-05-10T09:54:50.756300+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:54:50.756300+0000","last_undegraded":"2024-05-10T09:54:50.756300+0000","last_fullsized":"2024-05-10T09:54:50.756300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719120+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:54:50.719120+0000","last_peered":"2024-05-10T09:54:50.719120+0000","last_clean":"2024-05-10T09:54:50.719120+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:54:50.719120+0000","last_undegraded":"2024-05-10T09:54:50.719120+0000","last_fullsized":"2024-05-10T09:54:50.719120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765312+0000","last_change":"2024-05-10T09:54:41.642683+0000","last_active":"2024-05-10T09:54:50.765312+0000","last_peered":"2024-05-10T09:54:50.765312+0000","last_clean":"2024-05-10T09:54:50.765312+0000","last_became_active":"2024-05-10T09:54:41.641669+0000","last_became_peered":"2024-05-10T09:54:41.641669+0000","last_unstale":"2024-05-10T09:54:50.765312+0000","last_undegraded":"2024-05-10T09:54:50.765312+0000","last_fullsized":"2024-05-10T09:54:50.765312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752255+0000","last_change":"2024-05-10T09:54:39.642724+0000","last_active":"2024-05-10T09:54:50.752255+0000","last_peered":"2024-05-10T09:54:50.752255+0000","last_clean":"2024-05-10T09:54:50.752255+0000","last_became_active":"2024-05-10T09:54:39.641876+0000","last_became_peered":"2024-05-10T09:54:39.641876+0000","last_unstale":"2024-05-10T09:54:50.752255+0000","last_undegraded":"2024-05-10T09:54:50.752255+0000","last_fullsized":"2024-05-10T09:54:50.752255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:46.367837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739272+0000","last_change":"2024-05-10T09:54:43.676085+0000","last_active":"2024-05-10T09:54:50.739272+0000","last_peered":"2024-05-10T09:54:50.739272+0000","last_clean":"2024-05-10T09:54:50.739272+0000","last_became_active":"2024-05-10T09:54:43.675436+0000","last_became_peered":"2024-05-10T09:54:43.675436+0000","last_unstale":"2024-05-10T09:54:50.739272+0000","last_undegraded":"2024-05-10T09:54:50.739272+0000","last_fullsized":"2024-05-10T09:54:50.739272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:44.545569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.722350+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:54:51.722350+0000","last_peered":"2024-05-10T09:54:51.722350+0000","last_clean":"2024-05-10T09:54:51.722350+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:54:51.722350+0000","last_undegraded":"2024-05-10T09:54:51.722350+0000","last_fullsized":"2024-05-10T09:54:51.722350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723929+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:54:50.723929+0000","last_peered":"2024-05-10T09:54:50.723929+0000","last_clean":"2024-05-10T09:54:50.723929+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:54:50.723929+0000","last_undegraded":"2024-05-10T09:54:50.723929+0000","last_fullsized":"2024-05-10T09:54:50.723929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739804+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:54:50.739804+0000","last_peered":"2024-05-10T09:54:50.739804+0000","last_clean":"2024-05-10T09:54:50.739804+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:54:50.739804+0000","last_undegraded":"2024-05-10T09:54:50.739804+0000","last_fullsized":"2024-05-10T09:54:50.739804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765673+0000","last_change":"2024-05-10T09:54:41.679291+0000","last_active":"2024-05-10T09:54:50.765673+0000","last_peered":"2024-05-10T09:54:50.765673+0000","last_clean":"2024-05-10T09:54:50.765673+0000","last_became_active":"2024-05-10T09:54:41.678293+0000","last_became_peered":"2024-05-10T09:54:41.678293+0000","last_unstale":"2024-05-10T09:54:50.765673+0000","last_undegraded":"2024-05-10T09:54:50.765673+0000","last_fullsized":"2024-05-10T09:54:50.765673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:51.449905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764284+0000","last_change":"2024-05-10T09:54:39.616968+0000","last_active":"2024-05-10T09:54:50.764284+0000","last_peered":"2024-05-10T09:54:50.764284+0000","last_clean":"2024-05-10T09:54:50.764284+0000","last_became_active":"2024-05-10T09:54:39.616425+0000","last_became_peered":"2024-05-10T09:54:39.616425+0000","last_unstale":"2024-05-10T09:54:50.764284+0000","last_undegraded":"2024-05-10T09:54:50.764284+0000","last_fullsized":"2024-05-10T09:54:50.764284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:46.367837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747666+0000","last_change":"2024-05-10T09:54:43.678495+0000","last_active":"2024-05-10T09:54:50.747666+0000","last_peered":"2024-05-10T09:54:50.747666+0000","last_clean":"2024-05-10T09:54:50.747666+0000","last_became_active":"2024-05-10T09:54:43.677157+0000","last_became_peered":"2024-05-10T09:54:43.677157+0000","last_unstale":"2024-05-10T09:54:50.747666+0000","last_undegraded":"2024-05-10T09:54:50.747666+0000","last_fullsized":"2024-05-10T09:54:50.747666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:58.560484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.509551+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:54:51.509551+0000","last_peered":"2024-05-10T09:54:51.509551+0000","last_clean":"2024-05-10T09:54:51.509551+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:54:51.509551+0000","last_undegraded":"2024-05-10T09:54:51.509551+0000","last_fullsized":"2024-05-10T09:54:51.509551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752855+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:54:50.752855+0000","last_peered":"2024-05-10T09:54:50.752855+0000","last_clean":"2024-05-10T09:54:50.752855+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:54:50.752855+0000","last_undegraded":"2024-05-10T09:54:50.752855+0000","last_fullsized":"2024-05-10T09:54:50.752855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763972+0000","last_change":"2024-05-10T09:54:49.702101+0000","last_active":"2024-05-10T09:54:50.763972+0000","last_peered":"2024-05-10T09:54:50.763972+0000","last_clean":"2024-05-10T09:54:50.763972+0000","last_became_active":"2024-05-10T09:54:49.701351+0000","last_became_peered":"2024-05-10T09:54:49.701351+0000","last_unstale":"2024-05-10T09:54:50.763972+0000","last_undegraded":"2024-05-10T09:54:50.763972+0000","last_fullsized":"2024-05-10T09:54:50.763972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.741091+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:54:50.741091+0000","last_peered":"2024-05-10T09:54:50.741091+0000","last_clean":"2024-05-10T09:54:50.741091+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:54:50.741091+0000","last_undegraded":"2024-05-10T09:54:50.741091+0000","last_fullsized":"2024-05-10T09:54:50.741091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720763+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:54:50.720763+0000","last_peered":"2024-05-10T09:54:50.720763+0000","last_clean":"2024-05-10T09:54:50.720763+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:54:50.720763+0000","last_undegraded":"2024-05-10T09:54:50.720763+0000","last_fullsized":"2024-05-10T09:54:50.720763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765358+0000","last_change":"2024-05-10T09:54:43.670667+0000","last_active":"2024-05-10T09:54:50.765358+0000","last_peered":"2024-05-10T09:54:50.765358+0000","last_clean":"2024-05-10T09:54:50.765358+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:54:50.765358+0000","last_undegraded":"2024-05-10T09:54:50.765358+0000","last_fullsized":"2024-05-10T09:54:50.765358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.645524+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:54:51.645524+0000","last_peered":"2024-05-10T09:54:51.645524+0000","last_clean":"2024-05-10T09:54:51.645524+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:54:51.645524+0000","last_undegraded":"2024-05-10T09:54:51.645524+0000","last_fullsized":"2024-05-10T09:54:51.645524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752301+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:54:50.752301+0000","last_peered":"2024-05-10T09:54:50.752301+0000","last_clean":"2024-05-10T09:54:50.752301+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:54:50.752301+0000","last_undegraded":"2024-05-10T09:54:50.752301+0000","last_fullsized":"2024-05-10T09:54:50.752301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739146+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:54:50.739146+0000","last_peered":"2024-05-10T09:54:50.739146+0000","last_clean":"2024-05-10T09:54:50.739146+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:54:50.739146+0000","last_undegraded":"2024-05-10T09:54:50.739146+0000","last_fullsized":"2024-05-10T09:54:50.739146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753077+0000","last_change":"2024-05-10T09:54:41.676551+0000","last_active":"2024-05-10T09:54:50.753077+0000","last_peered":"2024-05-10T09:54:50.753077+0000","last_clean":"2024-05-10T09:54:50.753077+0000","last_became_active":"2024-05-10T09:54:41.675775+0000","last_became_peered":"2024-05-10T09:54:41.675775+0000","last_unstale":"2024-05-10T09:54:50.753077+0000","last_undegraded":"2024-05-10T09:54:50.753077+0000","last_fullsized":"2024-05-10T09:54:50.753077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:41.940007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719337+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:54:50.719337+0000","last_peered":"2024-05-10T09:54:50.719337+0000","last_clean":"2024-05-10T09:54:50.719337+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:54:50.719337+0000","last_undegraded":"2024-05-10T09:54:50.719337+0000","last_fullsized":"2024-05-10T09:54:50.719337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746345+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:54:50.746345+0000","last_peered":"2024-05-10T09:54:50.746345+0000","last_clean":"2024-05-10T09:54:50.746345+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:54:50.746345+0000","last_undegraded":"2024-05-10T09:54:50.746345+0000","last_fullsized":"2024-05-10T09:54:50.746345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720069+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:54:50.720069+0000","last_peered":"2024-05-10T09:54:50.720069+0000","last_clean":"2024-05-10T09:54:50.720069+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:54:50.720069+0000","last_undegraded":"2024-05-10T09:54:50.720069+0000","last_fullsized":"2024-05-10T09:54:50.720069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719619+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:54:50.719619+0000","last_peered":"2024-05-10T09:54:50.719619+0000","last_clean":"2024-05-10T09:54:50.719619+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:54:50.719619+0000","last_undegraded":"2024-05-10T09:54:50.719619+0000","last_fullsized":"2024-05-10T09:54:50.719619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.442182+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:54:51.442182+0000","last_peered":"2024-05-10T09:54:51.442182+0000","last_clean":"2024-05-10T09:54:51.442182+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:54:51.442182+0000","last_undegraded":"2024-05-10T09:54:51.442182+0000","last_fullsized":"2024-05-10T09:54:51.442182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756199+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:54:50.756199+0000","last_peered":"2024-05-10T09:54:50.756199+0000","last_clean":"2024-05-10T09:54:50.756199+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:54:50.756199+0000","last_undegraded":"2024-05-10T09:54:50.756199+0000","last_fullsized":"2024-05-10T09:54:50.756199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751326+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:54:50.751326+0000","last_peered":"2024-05-10T09:54:50.751326+0000","last_clean":"2024-05-10T09:54:50.751326+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:54:50.751326+0000","last_undegraded":"2024-05-10T09:54:50.751326+0000","last_fullsized":"2024-05-10T09:54:50.751326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757545+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:54:50.757545+0000","last_peered":"2024-05-10T09:54:50.757545+0000","last_clean":"2024-05-10T09:54:50.757545+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:54:50.757545+0000","last_undegraded":"2024-05-10T09:54:50.757545+0000","last_fullsized":"2024-05-10T09:54:50.757545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719083+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:54:50.719083+0000","last_peered":"2024-05-10T09:54:50.719083+0000","last_clean":"2024-05-10T09:54:50.719083+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:54:50.719083+0000","last_undegraded":"2024-05-10T09:54:50.719083+0000","last_fullsized":"2024-05-10T09:54:50.719083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754790+0000","last_change":"2024-05-10T09:54:39.641338+0000","last_active":"2024-05-10T09:54:50.754790+0000","last_peered":"2024-05-10T09:54:50.754790+0000","last_clean":"2024-05-10T09:54:50.754790+0000","last_became_active":"2024-05-10T09:54:39.641097+0000","last_became_peered":"2024-05-10T09:54:39.641097+0000","last_unstale":"2024-05-10T09:54:50.754790+0000","last_undegraded":"2024-05-10T09:54:50.754790+0000","last_fullsized":"2024-05-10T09:54:50.754790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748558+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:54:50.748558+0000","last_peered":"2024-05-10T09:54:50.748558+0000","last_clean":"2024-05-10T09:54:50.748558+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:54:50.748558+0000","last_undegraded":"2024-05-10T09:54:50.748558+0000","last_fullsized":"2024-05-10T09:54:50.748558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.634261+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:54:51.634261+0000","last_peered":"2024-05-10T09:54:51.634261+0000","last_clean":"2024-05-10T09:54:51.634261+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:54:51.634261+0000","last_undegraded":"2024-05-10T09:54:51.634261+0000","last_fullsized":"2024-05-10T09:54:51.634261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719841+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:54:50.719841+0000","last_peered":"2024-05-10T09:54:50.719841+0000","last_clean":"2024-05-10T09:54:50.719841+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:54:50.719841+0000","last_undegraded":"2024-05-10T09:54:50.719841+0000","last_fullsized":"2024-05-10T09:54:50.719841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.738909+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:54:50.738909+0000","last_peered":"2024-05-10T09:54:50.738909+0000","last_clean":"2024-05-10T09:54:50.738909+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:54:50.738909+0000","last_undegraded":"2024-05-10T09:54:50.738909+0000","last_fullsized":"2024-05-10T09:54:50.738909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.741270+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:54:50.741270+0000","last_peered":"2024-05-10T09:54:50.741270+0000","last_clean":"2024-05-10T09:54:50.741270+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:54:50.741270+0000","last_undegraded":"2024-05-10T09:54:50.741270+0000","last_fullsized":"2024-05-10T09:54:50.741270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718701+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:54:50.718701+0000","last_peered":"2024-05-10T09:54:50.718701+0000","last_clean":"2024-05-10T09:54:50.718701+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:54:50.718701+0000","last_undegraded":"2024-05-10T09:54:50.718701+0000","last_fullsized":"2024-05-10T09:54:50.718701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.738763+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:54:50.738763+0000","last_peered":"2024-05-10T09:54:50.738763+0000","last_clean":"2024-05-10T09:54:50.738763+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:54:50.738763+0000","last_undegraded":"2024-05-10T09:54:50.738763+0000","last_fullsized":"2024-05-10T09:54:50.738763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.724077+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:54:50.724077+0000","last_peered":"2024-05-10T09:54:50.724077+0000","last_clean":"2024-05-10T09:54:50.724077+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:54:50.724077+0000","last_undegraded":"2024-05-10T09:54:50.724077+0000","last_fullsized":"2024-05-10T09:54:50.724077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.640862+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:54:51.640862+0000","last_peered":"2024-05-10T09:54:51.640862+0000","last_clean":"2024-05-10T09:54:51.640862+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:54:51.640862+0000","last_undegraded":"2024-05-10T09:54:51.640862+0000","last_fullsized":"2024-05-10T09:54:51.640862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755144+0000","last_change":"2024-05-10T09:54:47.692709+0000","last_active":"2024-05-10T09:54:50.755144+0000","last_peered":"2024-05-10T09:54:50.755144+0000","last_clean":"2024-05-10T09:54:50.755144+0000","last_became_active":"2024-05-10T09:54:47.691803+0000","last_became_peered":"2024-05-10T09:54:47.691803+0000","last_unstale":"2024-05-10T09:54:50.755144+0000","last_undegraded":"2024-05-10T09:54:50.755144+0000","last_fullsized":"2024-05-10T09:54:50.755144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720867+0000","last_change":"2024-05-10T09:54:49.720781+0000","last_active":"2024-05-10T09:54:50.720867+0000","last_peered":"2024-05-10T09:54:50.720867+0000","last_clean":"2024-05-10T09:54:50.720867+0000","last_became_active":"2024-05-10T09:54:49.719403+0000","last_became_peered":"2024-05-10T09:54:49.719403+0000","last_unstale":"2024-05-10T09:54:50.720867+0000","last_undegraded":"2024-05-10T09:54:50.720867+0000","last_fullsized":"2024-05-10T09:54:50.720867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:39.459750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739579+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:54:50.739579+0000","last_peered":"2024-05-10T09:54:50.739579+0000","last_clean":"2024-05-10T09:54:50.739579+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:54:50.739579+0000","last_undegraded":"2024-05-10T09:54:50.739579+0000","last_fullsized":"2024-05-10T09:54:50.739579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746987+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:54:50.746987+0000","last_peered":"2024-05-10T09:54:50.746987+0000","last_clean":"2024-05-10T09:54:50.746987+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:54:50.746987+0000","last_undegraded":"2024-05-10T09:54:50.746987+0000","last_fullsized":"2024-05-10T09:54:50.746987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764562+0000","last_change":"2024-05-10T09:54:39.625577+0000","last_active":"2024-05-10T09:54:50.764562+0000","last_peered":"2024-05-10T09:54:50.764562+0000","last_clean":"2024-05-10T09:54:50.764562+0000","last_became_active":"2024-05-10T09:54:39.624844+0000","last_became_peered":"2024-05-10T09:54:39.624844+0000","last_unstale":"2024-05-10T09:54:50.764562+0000","last_undegraded":"2024-05-10T09:54:50.764562+0000","last_fullsized":"2024-05-10T09:54:50.764562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:12.050190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755446+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:54:50.755446+0000","last_peered":"2024-05-10T09:54:50.755446+0000","last_clean":"2024-05-10T09:54:50.755446+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:54:50.755446+0000","last_undegraded":"2024-05-10T09:54:50.755446+0000","last_fullsized":"2024-05-10T09:54:50.755446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.475217+0000","last_change":"2024-05-10T09:54:45.683260+0000","last_active":"2024-05-10T09:54:51.475217+0000","last_peered":"2024-05-10T09:54:51.475217+0000","last_clean":"2024-05-10T09:54:51.475217+0000","last_became_active":"2024-05-10T09:54:45.682646+0000","last_became_peered":"2024-05-10T09:54:45.682646+0000","last_unstale":"2024-05-10T09:54:51.475217+0000","last_undegraded":"2024-05-10T09:54:51.475217+0000","last_fullsized":"2024-05-10T09:54:51.475217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:07.295363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753405+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:54:50.753405+0000","last_peered":"2024-05-10T09:54:50.753405+0000","last_clean":"2024-05-10T09:54:50.753405+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:54:50.753405+0000","last_undegraded":"2024-05-10T09:54:50.753405+0000","last_fullsized":"2024-05-10T09:54:50.753405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745339+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:54:50.745339+0000","last_peered":"2024-05-10T09:54:50.745339+0000","last_clean":"2024-05-10T09:54:50.745339+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:54:50.745339+0000","last_undegraded":"2024-05-10T09:54:50.745339+0000","last_fullsized":"2024-05-10T09:54:50.745339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739248+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:54:50.739248+0000","last_peered":"2024-05-10T09:54:50.739248+0000","last_clean":"2024-05-10T09:54:50.739248+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:54:50.739248+0000","last_undegraded":"2024-05-10T09:54:50.739248+0000","last_fullsized":"2024-05-10T09:54:50.739248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748444+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:54:50.748444+0000","last_peered":"2024-05-10T09:54:50.748444+0000","last_clean":"2024-05-10T09:54:50.748444+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:54:50.748444+0000","last_undegraded":"2024-05-10T09:54:50.748444+0000","last_fullsized":"2024-05-10T09:54:50.748444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740432+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:54:50.740432+0000","last_peered":"2024-05-10T09:54:50.740432+0000","last_clean":"2024-05-10T09:54:50.740432+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:54:50.740432+0000","last_undegraded":"2024-05-10T09:54:50.740432+0000","last_fullsized":"2024-05-10T09:54:50.740432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755055+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:54:50.755055+0000","last_peered":"2024-05-10T09:54:50.755055+0000","last_clean":"2024-05-10T09:54:50.755055+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:54:50.755055+0000","last_undegraded":"2024-05-10T09:54:50.755055+0000","last_fullsized":"2024-05-10T09:54:50.755055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.566196+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:54:51.566196+0000","last_peered":"2024-05-10T09:54:51.566196+0000","last_clean":"2024-05-10T09:54:51.566196+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:54:51.566196+0000","last_undegraded":"2024-05-10T09:54:51.566196+0000","last_fullsized":"2024-05-10T09:54:51.566196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763102+0000","last_change":"2024-05-10T09:54:47.714622+0000","last_active":"2024-05-10T09:54:50.763102+0000","last_peered":"2024-05-10T09:54:50.763102+0000","last_clean":"2024-05-10T09:54:50.763102+0000","last_became_active":"2024-05-10T09:54:47.713840+0000","last_became_peered":"2024-05-10T09:54:47.713840+0000","last_unstale":"2024-05-10T09:54:50.763102+0000","last_undegraded":"2024-05-10T09:54:50.763102+0000","last_fullsized":"2024-05-10T09:54:50.763102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755567+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:54:50.755567+0000","last_peered":"2024-05-10T09:54:50.755567+0000","last_clean":"2024-05-10T09:54:50.755567+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:54:50.755567+0000","last_undegraded":"2024-05-10T09:54:50.755567+0000","last_fullsized":"2024-05-10T09:54:50.755567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756379+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:54:50.756379+0000","last_peered":"2024-05-10T09:54:50.756379+0000","last_clean":"2024-05-10T09:54:50.756379+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:54:50.756379+0000","last_undegraded":"2024-05-10T09:54:50.756379+0000","last_fullsized":"2024-05-10T09:54:50.756379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739861+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:54:50.739861+0000","last_peered":"2024-05-10T09:54:50.739861+0000","last_clean":"2024-05-10T09:54:50.739861+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:54:50.739861+0000","last_undegraded":"2024-05-10T09:54:50.739861+0000","last_fullsized":"2024-05-10T09:54:50.739861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721293+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:54:50.721293+0000","last_peered":"2024-05-10T09:54:50.721293+0000","last_clean":"2024-05-10T09:54:50.721293+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:54:50.721293+0000","last_undegraded":"2024-05-10T09:54:50.721293+0000","last_fullsized":"2024-05-10T09:54:50.721293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751780+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:54:50.751780+0000","last_peered":"2024-05-10T09:54:50.751780+0000","last_clean":"2024-05-10T09:54:50.751780+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:54:50.751780+0000","last_undegraded":"2024-05-10T09:54:50.751780+0000","last_fullsized":"2024-05-10T09:54:50.751780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.667271+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:54:51.667271+0000","last_peered":"2024-05-10T09:54:51.667271+0000","last_clean":"2024-05-10T09:54:51.667271+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:54:51.667271+0000","last_undegraded":"2024-05-10T09:54:51.667271+0000","last_fullsized":"2024-05-10T09:54:51.667271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745849+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:54:50.745849+0000","last_peered":"2024-05-10T09:54:50.745849+0000","last_clean":"2024-05-10T09:54:50.745849+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:54:50.745849+0000","last_undegraded":"2024-05-10T09:54:50.745849+0000","last_fullsized":"2024-05-10T09:54:50.745849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723790+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:54:50.723790+0000","last_peered":"2024-05-10T09:54:50.723790+0000","last_clean":"2024-05-10T09:54:50.723790+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:54:50.723790+0000","last_undegraded":"2024-05-10T09:54:50.723790+0000","last_fullsized":"2024-05-10T09:54:50.723790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720235+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:54:50.720235+0000","last_peered":"2024-05-10T09:54:50.720235+0000","last_clean":"2024-05-10T09:54:50.720235+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:54:50.720235+0000","last_undegraded":"2024-05-10T09:54:50.720235+0000","last_fullsized":"2024-05-10T09:54:50.720235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723112+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:54:50.723112+0000","last_peered":"2024-05-10T09:54:50.723112+0000","last_clean":"2024-05-10T09:54:50.723112+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:54:50.723112+0000","last_undegraded":"2024-05-10T09:54:50.723112+0000","last_fullsized":"2024-05-10T09:54:50.723112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740990+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:54:50.740990+0000","last_peered":"2024-05-10T09:54:50.740990+0000","last_clean":"2024-05-10T09:54:50.740990+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:54:50.740990+0000","last_undegraded":"2024-05-10T09:54:50.740990+0000","last_fullsized":"2024-05-10T09:54:50.740990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763434+0000","last_change":"2024-05-10T09:54:43.675983+0000","last_active":"2024-05-10T09:54:50.763434+0000","last_peered":"2024-05-10T09:54:50.763434+0000","last_clean":"2024-05-10T09:54:50.763434+0000","last_became_active":"2024-05-10T09:54:43.675216+0000","last_became_peered":"2024-05-10T09:54:43.675216+0000","last_unstale":"2024-05-10T09:54:50.763434+0000","last_undegraded":"2024-05-10T09:54:50.763434+0000","last_fullsized":"2024-05-10T09:54:50.763434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:04.447968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.624986+0000","last_change":"2024-05-10T09:54:45.678454+0000","last_active":"2024-05-10T09:54:51.624986+0000","last_peered":"2024-05-10T09:54:51.624986+0000","last_clean":"2024-05-10T09:54:51.624986+0000","last_became_active":"2024-05-10T09:54:45.677332+0000","last_became_peered":"2024-05-10T09:54:45.677332+0000","last_unstale":"2024-05-10T09:54:51.624986+0000","last_undegraded":"2024-05-10T09:54:51.624986+0000","last_fullsized":"2024-05-10T09:54:51.624986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.722773+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:54:50.722773+0000","last_peered":"2024-05-10T09:54:50.722773+0000","last_clean":"2024-05-10T09:54:50.722773+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:54:50.722773+0000","last_undegraded":"2024-05-10T09:54:50.722773+0000","last_fullsized":"2024-05-10T09:54:50.722773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757211+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:54:50.757211+0000","last_peered":"2024-05-10T09:54:50.757211+0000","last_clean":"2024-05-10T09:54:50.757211+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:54:50.757211+0000","last_undegraded":"2024-05-10T09:54:50.757211+0000","last_fullsized":"2024-05-10T09:54:50.757211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763690+0000","last_change":"2024-05-10T09:54:41.666849+0000","last_active":"2024-05-10T09:54:50.763690+0000","last_peered":"2024-05-10T09:54:50.763690+0000","last_clean":"2024-05-10T09:54:50.763690+0000","last_became_active":"2024-05-10T09:54:41.666154+0000","last_became_peered":"2024-05-10T09:54:41.666154+0000","last_unstale":"2024-05-10T09:54:50.763690+0000","last_undegraded":"2024-05-10T09:54:50.763690+0000","last_fullsized":"2024-05-10T09:54:50.763690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:02.444561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757839+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:54:50.757839+0000","last_peered":"2024-05-10T09:54:50.757839+0000","last_clean":"2024-05-10T09:54:50.757839+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:54:50.757839+0000","last_undegraded":"2024-05-10T09:54:50.757839+0000","last_fullsized":"2024-05-10T09:54:50.757839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753758+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:54:50.753758+0000","last_peered":"2024-05-10T09:54:50.753758+0000","last_clean":"2024-05-10T09:54:50.753758+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:54:50.753758+0000","last_undegraded":"2024-05-10T09:54:50.753758+0000","last_fullsized":"2024-05-10T09:54:50.753758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719981+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:54:50.719981+0000","last_peered":"2024-05-10T09:54:50.719981+0000","last_clean":"2024-05-10T09:54:50.719981+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:54:50.719981+0000","last_undegraded":"2024-05-10T09:54:50.719981+0000","last_fullsized":"2024-05-10T09:54:50.719981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.602673+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:54:51.602673+0000","last_peered":"2024-05-10T09:54:51.602673+0000","last_clean":"2024-05-10T09:54:51.602673+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:54:51.602673+0000","last_undegraded":"2024-05-10T09:54:51.602673+0000","last_fullsized":"2024-05-10T09:54:51.602673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719504+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:54:50.719504+0000","last_peered":"2024-05-10T09:54:50.719504+0000","last_clean":"2024-05-10T09:54:50.719504+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:54:50.719504+0000","last_undegraded":"2024-05-10T09:54:50.719504+0000","last_fullsized":"2024-05-10T09:54:50.719504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747323+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:54:50.747323+0000","last_peered":"2024-05-10T09:54:50.747323+0000","last_clean":"2024-05-10T09:54:50.747323+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:54:50.747323+0000","last_undegraded":"2024-05-10T09:54:50.747323+0000","last_fullsized":"2024-05-10T09:54:50.747323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756018+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:54:50.756018+0000","last_peered":"2024-05-10T09:54:50.756018+0000","last_clean":"2024-05-10T09:54:50.756018+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:54:50.756018+0000","last_undegraded":"2024-05-10T09:54:50.756018+0000","last_fullsized":"2024-05-10T09:54:50.756018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764025+0000","last_change":"2024-05-10T09:54:41.679647+0000","last_active":"2024-05-10T09:54:50.764025+0000","last_peered":"2024-05-10T09:54:50.764025+0000","last_clean":"2024-05-10T09:54:50.764025+0000","last_became_active":"2024-05-10T09:54:41.676614+0000","last_became_peered":"2024-05-10T09:54:41.676614+0000","last_unstale":"2024-05-10T09:54:50.764025+0000","last_undegraded":"2024-05-10T09:54:50.764025+0000","last_fullsized":"2024-05-10T09:54:50.764025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764046+0000","last_change":"2024-05-10T09:54:39.641072+0000","last_active":"2024-05-10T09:54:50.764046+0000","last_peered":"2024-05-10T09:54:50.764046+0000","last_clean":"2024-05-10T09:54:50.764046+0000","last_became_active":"2024-05-10T09:54:39.632868+0000","last_became_peered":"2024-05-10T09:54:39.632868+0000","last_unstale":"2024-05-10T09:54:50.764046+0000","last_undegraded":"2024-05-10T09:54:50.764046+0000","last_fullsized":"2024-05-10T09:54:50.764046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739559+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:54:50.739559+0000","last_peered":"2024-05-10T09:54:50.739559+0000","last_clean":"2024-05-10T09:54:50.739559+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:54:50.739559+0000","last_undegraded":"2024-05-10T09:54:50.739559+0000","last_fullsized":"2024-05-10T09:54:50.739559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.674086+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:54:51.674086+0000","last_peered":"2024-05-10T09:54:51.674086+0000","last_clean":"2024-05-10T09:54:51.674086+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:54:51.674086+0000","last_undegraded":"2024-05-10T09:54:51.674086+0000","last_fullsized":"2024-05-10T09:54:51.674086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719379+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:54:50.719379+0000","last_peered":"2024-05-10T09:54:50.719379+0000","last_clean":"2024-05-10T09:54:50.719379+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:54:50.719379+0000","last_undegraded":"2024-05-10T09:54:50.719379+0000","last_fullsized":"2024-05-10T09:54:50.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.722967+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:54:50.722967+0000","last_peered":"2024-05-10T09:54:50.722967+0000","last_clean":"2024-05-10T09:54:50.722967+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:54:50.722967+0000","last_undegraded":"2024-05-10T09:54:50.722967+0000","last_fullsized":"2024-05-10T09:54:50.722967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739249+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:54:50.739249+0000","last_peered":"2024-05-10T09:54:50.739249+0000","last_clean":"2024-05-10T09:54:50.739249+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:54:50.739249+0000","last_undegraded":"2024-05-10T09:54:50.739249+0000","last_fullsized":"2024-05-10T09:54:50.739249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721061+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:54:50.721061+0000","last_peered":"2024-05-10T09:54:50.721061+0000","last_clean":"2024-05-10T09:54:50.721061+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:54:50.721061+0000","last_undegraded":"2024-05-10T09:54:50.721061+0000","last_fullsized":"2024-05-10T09:54:50.721061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720538+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:54:50.720538+0000","last_peered":"2024-05-10T09:54:50.720538+0000","last_clean":"2024-05-10T09:54:50.720538+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:54:50.720538+0000","last_undegraded":"2024-05-10T09:54:50.720538+0000","last_fullsized":"2024-05-10T09:54:50.720538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.119315+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:54:51.119315+0000","last_peered":"2024-05-10T09:54:51.119315+0000","last_clean":"2024-05-10T09:54:51.119315+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:54:51.119315+0000","last_undegraded":"2024-05-10T09:54:51.119315+0000","last_fullsized":"2024-05-10T09:54:51.119315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720138+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:54:50.720138+0000","last_peered":"2024-05-10T09:54:50.720138+0000","last_clean":"2024-05-10T09:54:50.720138+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:54:50.720138+0000","last_undegraded":"2024-05-10T09:54:50.720138+0000","last_fullsized":"2024-05-10T09:54:50.720138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755260+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:54:50.755260+0000","last_peered":"2024-05-10T09:54:50.755260+0000","last_clean":"2024-05-10T09:54:50.755260+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:54:50.755260+0000","last_undegraded":"2024-05-10T09:54:50.755260+0000","last_fullsized":"2024-05-10T09:54:50.755260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720944+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:54:50.720944+0000","last_peered":"2024-05-10T09:54:50.720944+0000","last_clean":"2024-05-10T09:54:50.720944+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:54:50.720944+0000","last_undegraded":"2024-05-10T09:54:50.720944+0000","last_fullsized":"2024-05-10T09:54:50.720944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747657+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:54:50.747657+0000","last_peered":"2024-05-10T09:54:50.747657+0000","last_clean":"2024-05-10T09:54:50.747657+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:54:50.747657+0000","last_undegraded":"2024-05-10T09:54:50.747657+0000","last_fullsized":"2024-05-10T09:54:50.747657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718422+0000","last_change":"2024-05-10T09:54:43.676605+0000","last_active":"2024-05-10T09:54:50.718422+0000","last_peered":"2024-05-10T09:54:50.718422+0000","last_clean":"2024-05-10T09:54:50.718422+0000","last_became_active":"2024-05-10T09:54:43.675860+0000","last_became_peered":"2024-05-10T09:54:43.675860+0000","last_unstale":"2024-05-10T09:54:50.718422+0000","last_undegraded":"2024-05-10T09:54:50.718422+0000","last_fullsized":"2024-05-10T09:54:50.718422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:50.004032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.580244+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:54:51.580244+0000","last_peered":"2024-05-10T09:54:51.580244+0000","last_clean":"2024-05-10T09:54:51.580244+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:54:51.580244+0000","last_undegraded":"2024-05-10T09:54:51.580244+0000","last_fullsized":"2024-05-10T09:54:51.580244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751716+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:54:50.751716+0000","last_peered":"2024-05-10T09:54:50.751716+0000","last_clean":"2024-05-10T09:54:50.751716+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:54:50.751716+0000","last_undegraded":"2024-05-10T09:54:50.751716+0000","last_fullsized":"2024-05-10T09:54:50.751716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746582+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:54:50.746582+0000","last_peered":"2024-05-10T09:54:50.746582+0000","last_clean":"2024-05-10T09:54:50.746582+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:54:50.746582+0000","last_undegraded":"2024-05-10T09:54:50.746582+0000","last_fullsized":"2024-05-10T09:54:50.746582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720395+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:54:50.720395+0000","last_peered":"2024-05-10T09:54:50.720395+0000","last_clean":"2024-05-10T09:54:50.720395+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:54:50.720395+0000","last_undegraded":"2024-05-10T09:54:50.720395+0000","last_fullsized":"2024-05-10T09:54:50.720395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757657+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:54:50.757657+0000","last_peered":"2024-05-10T09:54:50.757657+0000","last_clean":"2024-05-10T09:54:50.757657+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:54:50.757657+0000","last_undegraded":"2024-05-10T09:54:50.757657+0000","last_fullsized":"2024-05-10T09:54:50.757657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751710+0000","last_change":"2024-05-10T09:54:43.676597+0000","last_active":"2024-05-10T09:54:50.751710+0000","last_peered":"2024-05-10T09:54:50.751710+0000","last_clean":"2024-05-10T09:54:50.751710+0000","last_became_active":"2024-05-10T09:54:43.675870+0000","last_became_peered":"2024-05-10T09:54:43.675870+0000","last_unstale":"2024-05-10T09:54:50.751710+0000","last_undegraded":"2024-05-10T09:54:50.751710+0000","last_fullsized":"2024-05-10T09:54:50.751710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:56.842817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.357729+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:54:51.357729+0000","last_peered":"2024-05-10T09:54:51.357729+0000","last_clean":"2024-05-10T09:54:51.357729+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:54:51.357729+0000","last_undegraded":"2024-05-10T09:54:51.357729+0000","last_fullsized":"2024-05-10T09:54:51.357729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754310+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:54:50.754310+0000","last_peered":"2024-05-10T09:54:50.754310+0000","last_clean":"2024-05-10T09:54:50.754310+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:54:50.754310+0000","last_undegraded":"2024-05-10T09:54:50.754310+0000","last_fullsized":"2024-05-10T09:54:50.754310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753689+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:54:50.753689+0000","last_peered":"2024-05-10T09:54:50.753689+0000","last_clean":"2024-05-10T09:54:50.753689+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:54:50.753689+0000","last_undegraded":"2024-05-10T09:54:50.753689+0000","last_fullsized":"2024-05-10T09:54:50.753689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720639+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:54:50.720639+0000","last_peered":"2024-05-10T09:54:50.720639+0000","last_clean":"2024-05-10T09:54:50.720639+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:54:50.720639+0000","last_undegraded":"2024-05-10T09:54:50.720639+0000","last_fullsized":"2024-05-10T09:54:50.720639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756512+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:54:50.756512+0000","last_peered":"2024-05-10T09:54:50.756512+0000","last_clean":"2024-05-10T09:54:50.756512+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:54:50.756512+0000","last_undegraded":"2024-05-10T09:54:50.756512+0000","last_fullsized":"2024-05-10T09:54:50.756512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.700835+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:54:51.700835+0000","last_peered":"2024-05-10T09:54:51.700835+0000","last_clean":"2024-05-10T09:54:51.700835+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:54:51.700835+0000","last_undegraded":"2024-05-10T09:54:51.700835+0000","last_fullsized":"2024-05-10T09:54:51.700835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747249+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:54:50.747249+0000","last_peered":"2024-05-10T09:54:50.747249+0000","last_clean":"2024-05-10T09:54:50.747249+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:54:50.747249+0000","last_undegraded":"2024-05-10T09:54:50.747249+0000","last_fullsized":"2024-05-10T09:54:50.747249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719677+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:54:50.719677+0000","last_peered":"2024-05-10T09:54:50.719677+0000","last_clean":"2024-05-10T09:54:50.719677+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:54:50.719677+0000","last_undegraded":"2024-05-10T09:54:50.719677+0000","last_fullsized":"2024-05-10T09:54:50.719677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757407+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:54:50.757407+0000","last_peered":"2024-05-10T09:54:50.757407+0000","last_clean":"2024-05-10T09:54:50.757407+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:54:50.757407+0000","last_undegraded":"2024-05-10T09:54:50.757407+0000","last_fullsized":"2024-05-10T09:54:50.757407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739821+0000","last_change":"2024-05-10T09:54:39.633485+0000","last_active":"2024-05-10T09:54:50.739821+0000","last_peered":"2024-05-10T09:54:50.739821+0000","last_clean":"2024-05-10T09:54:50.739821+0000","last_became_active":"2024-05-10T09:54:39.632122+0000","last_became_peered":"2024-05-10T09:54:39.632122+0000","last_unstale":"2024-05-10T09:54:50.739821+0000","last_undegraded":"2024-05-10T09:54:50.739821+0000","last_fullsized":"2024-05-10T09:54:50.739821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:29.992178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753490+0000","last_change":"2024-05-10T09:54:43.674945+0000","last_active":"2024-05-10T09:54:50.753490+0000","last_peered":"2024-05-10T09:54:50.753490+0000","last_clean":"2024-05-10T09:54:50.753490+0000","last_became_active":"2024-05-10T09:54:43.673932+0000","last_became_peered":"2024-05-10T09:54:43.673932+0000","last_unstale":"2024-05-10T09:54:50.753490+0000","last_undegraded":"2024-05-10T09:54:50.753490+0000","last_fullsized":"2024-05-10T09:54:50.753490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:00.830106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.482577+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:54:51.482577+0000","last_peered":"2024-05-10T09:54:51.482577+0000","last_clean":"2024-05-10T09:54:51.482577+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:54:51.482577+0000","last_undegraded":"2024-05-10T09:54:51.482577+0000","last_fullsized":"2024-05-10T09:54:51.482577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740103+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:54:50.740103+0000","last_peered":"2024-05-10T09:54:50.740103+0000","last_clean":"2024-05-10T09:54:50.740103+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:54:50.740103+0000","last_undegraded":"2024-05-10T09:54:50.740103+0000","last_fullsized":"2024-05-10T09:54:50.740103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751619+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:54:50.751619+0000","last_peered":"2024-05-10T09:54:50.751619+0000","last_clean":"2024-05-10T09:54:50.751619+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:54:50.751619+0000","last_undegraded":"2024-05-10T09:54:50.751619+0000","last_fullsized":"2024-05-10T09:54:50.751619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.722697+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:54:50.722697+0000","last_peered":"2024-05-10T09:54:50.722697+0000","last_clean":"2024-05-10T09:54:50.722697+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:54:50.722697+0000","last_undegraded":"2024-05-10T09:54:50.722697+0000","last_fullsized":"2024-05-10T09:54:50.722697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764581+0000","last_change":"2024-05-10T09:54:39.632152+0000","last_active":"2024-05-10T09:54:50.764581+0000","last_peered":"2024-05-10T09:54:50.764581+0000","last_clean":"2024-05-10T09:54:50.764581+0000","last_became_active":"2024-05-10T09:54:39.630880+0000","last_became_peered":"2024-05-10T09:54:39.630880+0000","last_unstale":"2024-05-10T09:54:50.764581+0000","last_undegraded":"2024-05-10T09:54:50.764581+0000","last_fullsized":"2024-05-10T09:54:50.764581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.311278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765474+0000","last_change":"2024-05-10T09:54:43.671543+0000","last_active":"2024-05-10T09:54:50.765474+0000","last_peered":"2024-05-10T09:54:50.765474+0000","last_clean":"2024-05-10T09:54:50.765474+0000","last_became_active":"2024-05-10T09:54:43.670617+0000","last_became_peered":"2024-05-10T09:54:43.670617+0000","last_unstale":"2024-05-10T09:54:50.765474+0000","last_undegraded":"2024-05-10T09:54:50.765474+0000","last_fullsized":"2024-05-10T09:54:50.765474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:57.236607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.680471+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:54:51.680471+0000","last_peered":"2024-05-10T09:54:51.680471+0000","last_clean":"2024-05-10T09:54:51.680471+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:54:51.680471+0000","last_undegraded":"2024-05-10T09:54:51.680471+0000","last_fullsized":"2024-05-10T09:54:51.680471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739322+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:54:50.739322+0000","last_peered":"2024-05-10T09:54:50.739322+0000","last_clean":"2024-05-10T09:54:50.739322+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:54:50.739322+0000","last_undegraded":"2024-05-10T09:54:50.739322+0000","last_fullsized":"2024-05-10T09:54:50.739322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745700+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:54:50.745700+0000","last_peered":"2024-05-10T09:54:50.745700+0000","last_clean":"2024-05-10T09:54:50.745700+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:54:50.745700+0000","last_undegraded":"2024-05-10T09:54:50.745700+0000","last_fullsized":"2024-05-10T09:54:50.745700+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720233+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:54:50.720233+0000","last_peered":"2024-05-10T09:54:50.720233+0000","last_clean":"2024-05-10T09:54:50.720233+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:54:50.720233+0000","last_undegraded":"2024-05-10T09:54:50.720233+0000","last_fullsized":"2024-05-10T09:54:50.720233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754615+0000","last_change":"2024-05-10T09:54:39.639964+0000","last_active":"2024-05-10T09:54:50.754615+0000","last_peered":"2024-05-10T09:54:50.754615+0000","last_clean":"2024-05-10T09:54:50.754615+0000","last_became_active":"2024-05-10T09:54:39.639586+0000","last_became_peered":"2024-05-10T09:54:39.639586+0000","last_unstale":"2024-05-10T09:54:50.754615+0000","last_undegraded":"2024-05-10T09:54:50.754615+0000","last_fullsized":"2024-05-10T09:54:50.754615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740416+0000","last_change":"2024-05-10T09:54:43.673579+0000","last_active":"2024-05-10T09:54:50.740416+0000","last_peered":"2024-05-10T09:54:50.740416+0000","last_clean":"2024-05-10T09:54:50.740416+0000","last_became_active":"2024-05-10T09:54:43.671699+0000","last_became_peered":"2024-05-10T09:54:43.671699+0000","last_unstale":"2024-05-10T09:54:50.740416+0000","last_undegraded":"2024-05-10T09:54:50.740416+0000","last_fullsized":"2024-05-10T09:54:50.740416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.679507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.660355+0000","last_change":"2024-05-10T09:54:46.137228+0000","last_active":"2024-05-10T09:54:51.660355+0000","last_peered":"2024-05-10T09:54:51.660355+0000","last_clean":"2024-05-10T09:54:51.660355+0000","last_became_active":"2024-05-10T09:54:46.136461+0000","last_became_peered":"2024-05-10T09:54:46.136461+0000","last_unstale":"2024-05-10T09:54:51.660355+0000","last_undegraded":"2024-05-10T09:54:51.660355+0000","last_fullsized":"2024-05-10T09:54:51.660355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753320+0000","last_change":"2024-05-10T09:54:47.703168+0000","last_active":"2024-05-10T09:54:50.753320+0000","last_peered":"2024-05-10T09:54:50.753320+0000","last_clean":"2024-05-10T09:54:50.753320+0000","last_became_active":"2024-05-10T09:54:47.702370+0000","last_became_peered":"2024-05-10T09:54:47.702370+0000","last_unstale":"2024-05-10T09:54:50.753320+0000","last_undegraded":"2024-05-10T09:54:50.753320+0000","last_fullsized":"2024-05-10T09:54:50.753320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:23.880405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718606+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:54:50.718606+0000","last_peered":"2024-05-10T09:54:50.718606+0000","last_clean":"2024-05-10T09:54:50.718606+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:54:50.718606+0000","last_undegraded":"2024-05-10T09:54:50.718606+0000","last_fullsized":"2024-05-10T09:54:50.718606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763758+0000","last_change":"2024-05-10T09:54:41.660113+0000","last_active":"2024-05-10T09:54:50.763758+0000","last_peered":"2024-05-10T09:54:50.763758+0000","last_clean":"2024-05-10T09:54:50.763758+0000","last_became_active":"2024-05-10T09:54:41.659372+0000","last_became_peered":"2024-05-10T09:54:41.659372+0000","last_unstale":"2024-05-10T09:54:50.763758+0000","last_undegraded":"2024-05-10T09:54:50.763758+0000","last_fullsized":"2024-05-10T09:54:50.763758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747811+0000","last_change":"2024-05-10T09:54:39.665209+0000","last_active":"2024-05-10T09:54:50.747811+0000","last_peered":"2024-05-10T09:54:50.747811+0000","last_clean":"2024-05-10T09:54:50.747811+0000","last_became_active":"2024-05-10T09:54:39.664624+0000","last_became_peered":"2024-05-10T09:54:39.664624+0000","last_unstale":"2024-05-10T09:54:50.747811+0000","last_undegraded":"2024-05-10T09:54:50.747811+0000","last_fullsized":"2024-05-10T09:54:50.747811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:14.288277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719056+0000","last_change":"2024-05-10T09:54:43.676730+0000","last_active":"2024-05-10T09:54:50.719056+0000","last_peered":"2024-05-10T09:54:50.719056+0000","last_clean":"2024-05-10T09:54:50.719056+0000","last_became_active":"2024-05-10T09:54:43.676001+0000","last_became_peered":"2024-05-10T09:54:43.676001+0000","last_unstale":"2024-05-10T09:54:50.719056+0000","last_undegraded":"2024-05-10T09:54:50.719056+0000","last_fullsized":"2024-05-10T09:54:50.719056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:53.463036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.694505+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:54:51.694505+0000","last_peered":"2024-05-10T09:54:51.694505+0000","last_clean":"2024-05-10T09:54:51.694505+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:54:51.694505+0000","last_undegraded":"2024-05-10T09:54:51.694505+0000","last_fullsized":"2024-05-10T09:54:51.694505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753491+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:54:50.753491+0000","last_peered":"2024-05-10T09:54:50.753491+0000","last_clean":"2024-05-10T09:54:50.753491+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:54:50.753491+0000","last_undegraded":"2024-05-10T09:54:50.753491+0000","last_fullsized":"2024-05-10T09:54:50.753491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721196+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:54:50.721196+0000","last_peered":"2024-05-10T09:54:50.721196+0000","last_clean":"2024-05-10T09:54:50.721196+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:54:50.721196+0000","last_undegraded":"2024-05-10T09:54:50.721196+0000","last_fullsized":"2024-05-10T09:54:50.721196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764251+0000","last_change":"2024-05-10T09:54:41.661977+0000","last_active":"2024-05-10T09:54:50.764251+0000","last_peered":"2024-05-10T09:54:50.764251+0000","last_clean":"2024-05-10T09:54:50.764251+0000","last_became_active":"2024-05-10T09:54:41.661196+0000","last_became_peered":"2024-05-10T09:54:41.661196+0000","last_unstale":"2024-05-10T09:54:50.764251+0000","last_undegraded":"2024-05-10T09:54:50.764251+0000","last_fullsized":"2024-05-10T09:54:50.764251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748196+0000","last_change":"2024-05-10T09:54:39.660289+0000","last_active":"2024-05-10T09:54:50.748196+0000","last_peered":"2024-05-10T09:54:50.748196+0000","last_clean":"2024-05-10T09:54:50.748196+0000","last_became_active":"2024-05-10T09:54:39.659678+0000","last_became_peered":"2024-05-10T09:54:39.659678+0000","last_unstale":"2024-05-10T09:54:50.748196+0000","last_undegraded":"2024-05-10T09:54:50.748196+0000","last_fullsized":"2024-05-10T09:54:50.748196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746067+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:54:50.746067+0000","last_peered":"2024-05-10T09:54:50.746067+0000","last_clean":"2024-05-10T09:54:50.746067+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:54:50.746067+0000","last_undegraded":"2024-05-10T09:54:50.746067+0000","last_fullsized":"2024-05-10T09:54:50.746067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.062138+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:54:51.062138+0000","last_peered":"2024-05-10T09:54:51.062138+0000","last_clean":"2024-05-10T09:54:51.062138+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:54:51.062138+0000","last_undegraded":"2024-05-10T09:54:51.062138+0000","last_fullsized":"2024-05-10T09:54:51.062138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751323+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:54:50.751323+0000","last_peered":"2024-05-10T09:54:50.751323+0000","last_clean":"2024-05-10T09:54:50.751323+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:54:50.751323+0000","last_undegraded":"2024-05-10T09:54:50.751323+0000","last_fullsized":"2024-05-10T09:54:50.751323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723052+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:54:50.723052+0000","last_peered":"2024-05-10T09:54:50.723052+0000","last_clean":"2024-05-10T09:54:50.723052+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:54:50.723052+0000","last_undegraded":"2024-05-10T09:54:50.723052+0000","last_fullsized":"2024-05-10T09:54:50.723052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721310+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:54:50.721310+0000","last_peered":"2024-05-10T09:54:50.721310+0000","last_clean":"2024-05-10T09:54:50.721310+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:54:50.721310+0000","last_undegraded":"2024-05-10T09:54:50.721310+0000","last_fullsized":"2024-05-10T09:54:50.721310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723751+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:54:50.723751+0000","last_peered":"2024-05-10T09:54:50.723751+0000","last_clean":"2024-05-10T09:54:50.723751+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:54:50.723751+0000","last_undegraded":"2024-05-10T09:54:50.723751+0000","last_fullsized":"2024-05-10T09:54:50.723751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.762966+0000","last_change":"2024-05-10T09:54:43.671816+0000","last_active":"2024-05-10T09:54:50.762966+0000","last_peered":"2024-05-10T09:54:50.762966+0000","last_clean":"2024-05-10T09:54:50.762966+0000","last_became_active":"2024-05-10T09:54:43.670943+0000","last_became_peered":"2024-05-10T09:54:43.670943+0000","last_unstale":"2024-05-10T09:54:50.762966+0000","last_undegraded":"2024-05-10T09:54:50.762966+0000","last_fullsized":"2024-05-10T09:54:50.762966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.306302+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:54:51.306302+0000","last_peered":"2024-05-10T09:54:51.306302+0000","last_clean":"2024-05-10T09:54:51.306302+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:54:51.306302+0000","last_undegraded":"2024-05-10T09:54:51.306302+0000","last_fullsized":"2024-05-10T09:54:51.306302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763401+0000","last_change":"2024-05-10T09:54:47.699451+0000","last_active":"2024-05-10T09:54:50.763401+0000","last_peered":"2024-05-10T09:54:50.763401+0000","last_clean":"2024-05-10T09:54:50.763401+0000","last_became_active":"2024-05-10T09:54:47.698655+0000","last_became_peered":"2024-05-10T09:54:47.698655+0000","last_unstale":"2024-05-10T09:54:50.763401+0000","last_undegraded":"2024-05-10T09:54:50.763401+0000","last_fullsized":"2024-05-10T09:54:50.763401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720742+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:54:50.720742+0000","last_peered":"2024-05-10T09:54:50.720742+0000","last_clean":"2024-05-10T09:54:50.720742+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:54:50.720742+0000","last_undegraded":"2024-05-10T09:54:50.720742+0000","last_fullsized":"2024-05-10T09:54:50.720742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763464+0000","last_change":"2024-05-10T09:54:41.684964+0000","last_active":"2024-05-10T09:54:50.763464+0000","last_peered":"2024-05-10T09:54:50.763464+0000","last_clean":"2024-05-10T09:54:50.763464+0000","last_became_active":"2024-05-10T09:54:41.684444+0000","last_became_peered":"2024-05-10T09:54:41.684444+0000","last_unstale":"2024-05-10T09:54:50.763464+0000","last_undegraded":"2024-05-10T09:54:50.763464+0000","last_fullsized":"2024-05-10T09:54:50.763464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757419+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:54:50.757419+0000","last_peered":"2024-05-10T09:54:50.757419+0000","last_clean":"2024-05-10T09:54:50.757419+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:54:50.757419+0000","last_undegraded":"2024-05-10T09:54:50.757419+0000","last_fullsized":"2024-05-10T09:54:50.757419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.738452+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:54:50.738452+0000","last_peered":"2024-05-10T09:54:50.738452+0000","last_clean":"2024-05-10T09:54:50.738452+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:54:50.738452+0000","last_undegraded":"2024-05-10T09:54:50.738452+0000","last_fullsized":"2024-05-10T09:54:50.738452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.379206+0000","last_change":"2024-05-10T09:54:45.674702+0000","last_active":"2024-05-10T09:54:51.379206+0000","last_peered":"2024-05-10T09:54:51.379206+0000","last_clean":"2024-05-10T09:54:51.379206+0000","last_became_active":"2024-05-10T09:54:45.674013+0000","last_became_peered":"2024-05-10T09:54:45.674013+0000","last_unstale":"2024-05-10T09:54:51.379206+0000","last_undegraded":"2024-05-10T09:54:51.379206+0000","last_fullsized":"2024-05-10T09:54:51.379206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:07.295363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754225+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:54:50.754225+0000","last_peered":"2024-05-10T09:54:50.754225+0000","last_clean":"2024-05-10T09:54:50.754225+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:54:50.754225+0000","last_undegraded":"2024-05-10T09:54:50.754225+0000","last_fullsized":"2024-05-10T09:54:50.754225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765523+0000","last_change":"2024-05-10T09:54:49.704641+0000","last_active":"2024-05-10T09:54:50.765523+0000","last_peered":"2024-05-10T09:54:50.765523+0000","last_clean":"2024-05-10T09:54:50.765523+0000","last_became_active":"2024-05-10T09:54:49.703849+0000","last_became_peered":"2024-05-10T09:54:49.703849+0000","last_unstale":"2024-05-10T09:54:50.765523+0000","last_undegraded":"2024-05-10T09:54:50.765523+0000","last_fullsized":"2024-05-10T09:54:50.765523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.741079+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:54:50.741079+0000","last_peered":"2024-05-10T09:54:50.741079+0000","last_clean":"2024-05-10T09:54:50.741079+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:54:50.741079+0000","last_undegraded":"2024-05-10T09:54:50.741079+0000","last_fullsized":"2024-05-10T09:54:50.741079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751224+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:54:50.751224+0000","last_peered":"2024-05-10T09:54:50.751224+0000","last_clean":"2024-05-10T09:54:50.751224+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:54:50.751224+0000","last_undegraded":"2024-05-10T09:54:50.751224+0000","last_fullsized":"2024-05-10T09:54:50.751224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740651+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:54:50.740651+0000","last_peered":"2024-05-10T09:54:50.740651+0000","last_clean":"2024-05-10T09:54:50.740651+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:54:50.740651+0000","last_undegraded":"2024-05-10T09:54:50.740651+0000","last_fullsized":"2024-05-10T09:54:50.740651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718165+0000","last_change":"2024-05-10T09:54:39.661049+0000","last_active":"2024-05-10T09:54:50.718165+0000","last_peered":"2024-05-10T09:54:50.718165+0000","last_clean":"2024-05-10T09:54:50.718165+0000","last_became_active":"2024-05-10T09:54:39.660756+0000","last_became_peered":"2024-05-10T09:54:39.660756+0000","last_unstale":"2024-05-10T09:54:50.718165+0000","last_undegraded":"2024-05-10T09:54:50.718165+0000","last_fullsized":"2024-05-10T09:54:50.718165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:38.799039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747786+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:54:50.747786+0000","last_peered":"2024-05-10T09:54:50.747786+0000","last_clean":"2024-05-10T09:54:50.747786+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:54:50.747786+0000","last_undegraded":"2024-05-10T09:54:50.747786+0000","last_fullsized":"2024-05-10T09:54:50.747786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746930+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:54:50.746930+0000","last_peered":"2024-05-10T09:54:50.746930+0000","last_clean":"2024-05-10T09:54:50.746930+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:54:50.746930+0000","last_undegraded":"2024-05-10T09:54:50.746930+0000","last_fullsized":"2024-05-10T09:54:50.746930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739862+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:54:50.739862+0000","last_peered":"2024-05-10T09:54:50.739862+0000","last_clean":"2024-05-10T09:54:50.739862+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:54:50.739862+0000","last_undegraded":"2024-05-10T09:54:50.739862+0000","last_fullsized":"2024-05-10T09:54:50.739862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754960+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:54:50.754960+0000","last_peered":"2024-05-10T09:54:50.754960+0000","last_clean":"2024-05-10T09:54:50.754960+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:54:50.754960+0000","last_undegraded":"2024-05-10T09:54:50.754960+0000","last_fullsized":"2024-05-10T09:54:50.754960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721256+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:54:50.721256+0000","last_peered":"2024-05-10T09:54:50.721256+0000","last_clean":"2024-05-10T09:54:50.721256+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:54:50.721256+0000","last_undegraded":"2024-05-10T09:54:50.721256+0000","last_fullsized":"2024-05-10T09:54:50.721256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.724420+0000","last_change":"2024-05-10T09:54:39.617575+0000","last_active":"2024-05-10T09:54:50.724420+0000","last_peered":"2024-05-10T09:54:50.724420+0000","last_clean":"2024-05-10T09:54:50.724420+0000","last_became_active":"2024-05-10T09:54:39.617225+0000","last_became_peered":"2024-05-10T09:54:39.617225+0000","last_unstale":"2024-05-10T09:54:50.724420+0000","last_undegraded":"2024-05-10T09:54:50.724420+0000","last_fullsized":"2024-05-10T09:54:50.724420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764571+0000","last_change":"2024-05-10T09:54:41.685433+0000","last_active":"2024-05-10T09:54:50.764571+0000","last_peered":"2024-05-10T09:54:50.764571+0000","last_clean":"2024-05-10T09:54:50.764571+0000","last_became_active":"2024-05-10T09:54:41.684722+0000","last_became_peered":"2024-05-10T09:54:41.684722+0000","last_unstale":"2024-05-10T09:54:50.764571+0000","last_undegraded":"2024-05-10T09:54:50.764571+0000","last_fullsized":"2024-05-10T09:54:50.764571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740832+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:54:50.740832+0000","last_peered":"2024-05-10T09:54:50.740832+0000","last_clean":"2024-05-10T09:54:50.740832+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:54:50.740832+0000","last_undegraded":"2024-05-10T09:54:50.740832+0000","last_fullsized":"2024-05-10T09:54:50.740832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719377+0000","last_change":"2024-05-10T09:54:41.678687+0000","last_active":"2024-05-10T09:54:50.719377+0000","last_peered":"2024-05-10T09:54:50.719377+0000","last_clean":"2024-05-10T09:54:50.719377+0000","last_became_active":"2024-05-10T09:54:41.677440+0000","last_became_peered":"2024-05-10T09:54:41.677440+0000","last_unstale":"2024-05-10T09:54:50.719377+0000","last_undegraded":"2024-05-10T09:54:50.719377+0000","last_fullsized":"2024-05-10T09:54:50.719377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753366+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:54:50.753366+0000","last_peered":"2024-05-10T09:54:50.753366+0000","last_clean":"2024-05-10T09:54:50.753366+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:54:50.753366+0000","last_undegraded":"2024-05-10T09:54:50.753366+0000","last_fullsized":"2024-05-10T09:54:50.753366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751131+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:54:50.751131+0000","last_peered":"2024-05-10T09:54:50.751131+0000","last_clean":"2024-05-10T09:54:50.751131+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:54:50.751131+0000","last_undegraded":"2024-05-10T09:54:50.751131+0000","last_fullsized":"2024-05-10T09:54:50.751131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723560+0000","last_change":"2024-05-10T09:54:39.637008+0000","last_active":"2024-05-10T09:54:50.723560+0000","last_peered":"2024-05-10T09:54:50.723560+0000","last_clean":"2024-05-10T09:54:50.723560+0000","last_became_active":"2024-05-10T09:54:39.636614+0000","last_became_peered":"2024-05-10T09:54:39.636614+0000","last_unstale":"2024-05-10T09:54:50.723560+0000","last_undegraded":"2024-05-10T09:54:50.723560+0000","last_fullsized":"2024-05-10T09:54:50.723560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756619+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:54:50.756619+0000","last_peered":"2024-05-10T09:54:50.756619+0000","last_clean":"2024-05-10T09:54:50.756619+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:54:50.756619+0000","last_undegraded":"2024-05-10T09:54:50.756619+0000","last_fullsized":"2024-05-10T09:54:50.756619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746227+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:54:50.746227+0000","last_peered":"2024-05-10T09:54:50.746227+0000","last_clean":"2024-05-10T09:54:50.746227+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:54:50.746227+0000","last_undegraded":"2024-05-10T09:54:50.746227+0000","last_fullsized":"2024-05-10T09:54:50.746227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765569+0000","last_change":"2024-05-10T09:54:41.643172+0000","last_active":"2024-05-10T09:54:50.765569+0000","last_peered":"2024-05-10T09:54:50.765569+0000","last_clean":"2024-05-10T09:54:50.765569+0000","last_became_active":"2024-05-10T09:54:41.642434+0000","last_became_peered":"2024-05-10T09:54:41.642434+0000","last_unstale":"2024-05-10T09:54:50.765569+0000","last_undegraded":"2024-05-10T09:54:50.765569+0000","last_fullsized":"2024-05-10T09:54:50.765569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721539+0000","last_change":"2024-05-10T09:54:39.617844+0000","last_active":"2024-05-10T09:54:50.721539+0000","last_peered":"2024-05-10T09:54:50.721539+0000","last_clean":"2024-05-10T09:54:50.721539+0000","last_became_active":"2024-05-10T09:54:39.617265+0000","last_became_peered":"2024-05-10T09:54:39.617265+0000","last_unstale":"2024-05-10T09:54:50.721539+0000","last_undegraded":"2024-05-10T09:54:50.721539+0000","last_fullsized":"2024-05-10T09:54:50.721539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721156+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:54:50.721156+0000","last_peered":"2024-05-10T09:54:50.721156+0000","last_clean":"2024-05-10T09:54:50.721156+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:54:50.721156+0000","last_undegraded":"2024-05-10T09:54:50.721156+0000","last_fullsized":"2024-05-10T09:54:50.721156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746737+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:54:50.746737+0000","last_peered":"2024-05-10T09:54:50.746737+0000","last_clean":"2024-05-10T09:54:50.746737+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:54:50.746737+0000","last_undegraded":"2024-05-10T09:54:50.746737+0000","last_fullsized":"2024-05-10T09:54:50.746737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764962+0000","last_change":"2024-05-10T09:54:41.677847+0000","last_active":"2024-05-10T09:54:50.764962+0000","last_peered":"2024-05-10T09:54:50.764962+0000","last_clean":"2024-05-10T09:54:50.764962+0000","last_became_active":"2024-05-10T09:54:41.675368+0000","last_became_peered":"2024-05-10T09:54:41.675368+0000","last_unstale":"2024-05-10T09:54:50.764962+0000","last_undegraded":"2024-05-10T09:54:50.764962+0000","last_fullsized":"2024-05-10T09:54:50.764962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755258+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:54:50.755258+0000","last_peered":"2024-05-10T09:54:50.755258+0000","last_clean":"2024-05-10T09:54:50.755258+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:54:50.755258+0000","last_undegraded":"2024-05-10T09:54:50.755258+0000","last_fullsized":"2024-05-10T09:54:50.755258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719849+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:54:50.719849+0000","last_peered":"2024-05-10T09:54:50.719849+0000","last_clean":"2024-05-10T09:54:50.719849+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:54:50.719849+0000","last_undegraded":"2024-05-10T09:54:50.719849+0000","last_fullsized":"2024-05-10T09:54:50.719849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752862+0000","last_change":"2024-05-10T09:54:39.646096+0000","last_active":"2024-05-10T09:54:50.752862+0000","last_peered":"2024-05-10T09:54:50.752862+0000","last_clean":"2024-05-10T09:54:50.752862+0000","last_became_active":"2024-05-10T09:54:39.645148+0000","last_became_peered":"2024-05-10T09:54:39.645148+0000","last_unstale":"2024-05-10T09:54:50.752862+0000","last_undegraded":"2024-05-10T09:54:50.752862+0000","last_fullsized":"2024-05-10T09:54:50.752862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754379+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:54:50.754379+0000","last_peered":"2024-05-10T09:54:50.754379+0000","last_clean":"2024-05-10T09:54:50.754379+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:54:50.754379+0000","last_undegraded":"2024-05-10T09:54:50.754379+0000","last_fullsized":"2024-05-10T09:54:50.754379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721340+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:54:50.721340+0000","last_peered":"2024-05-10T09:54:50.721340+0000","last_clean":"2024-05-10T09:54:50.721340+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:54:50.721340+0000","last_undegraded":"2024-05-10T09:54:50.721340+0000","last_fullsized":"2024-05-10T09:54:50.721340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719574+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:54:50.719574+0000","last_peered":"2024-05-10T09:54:50.719574+0000","last_clean":"2024-05-10T09:54:50.719574+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:54:50.719574+0000","last_undegraded":"2024-05-10T09:54:50.719574+0000","last_fullsized":"2024-05-10T09:54:50.719574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.724644+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:54:50.724644+0000","last_peered":"2024-05-10T09:54:50.724644+0000","last_clean":"2024-05-10T09:54:50.724644+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:54:50.724644+0000","last_undegraded":"2024-05-10T09:54:50.724644+0000","last_fullsized":"2024-05-10T09:54:50.724644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718888+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:54:50.718888+0000","last_peered":"2024-05-10T09:54:50.718888+0000","last_clean":"2024-05-10T09:54:50.718888+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:54:50.718888+0000","last_undegraded":"2024-05-10T09:54:50.718888+0000","last_fullsized":"2024-05-10T09:54:50.718888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748785+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:54:50.748785+0000","last_peered":"2024-05-10T09:54:50.748785+0000","last_clean":"2024-05-10T09:54:50.748785+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:54:50.748785+0000","last_undegraded":"2024-05-10T09:54:50.748785+0000","last_fullsized":"2024-05-10T09:54:50.748785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746013+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:54:50.746013+0000","last_peered":"2024-05-10T09:54:50.746013+0000","last_clean":"2024-05-10T09:54:50.746013+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:54:50.746013+0000","last_undegraded":"2024-05-10T09:54:50.746013+0000","last_fullsized":"2024-05-10T09:54:50.746013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756318+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:54:50.756318+0000","last_peered":"2024-05-10T09:54:50.756318+0000","last_clean":"2024-05-10T09:54:50.756318+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:54:50.756318+0000","last_undegraded":"2024-05-10T09:54:50.756318+0000","last_fullsized":"2024-05-10T09:54:50.756318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739316+0000","last_change":"2024-05-10T09:54:39.644558+0000","last_active":"2024-05-10T09:54:50.739316+0000","last_peered":"2024-05-10T09:54:50.739316+0000","last_clean":"2024-05-10T09:54:50.739316+0000","last_became_active":"2024-05-10T09:54:39.644263+0000","last_became_peered":"2024-05-10T09:54:39.644263+0000","last_unstale":"2024-05-10T09:54:50.739316+0000","last_undegraded":"2024-05-10T09:54:50.739316+0000","last_fullsized":"2024-05-10T09:54:50.739316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:25.147666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747428+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:54:50.747428+0000","last_peered":"2024-05-10T09:54:50.747428+0000","last_clean":"2024-05-10T09:54:50.747428+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:54:50.747428+0000","last_undegraded":"2024-05-10T09:54:50.747428+0000","last_fullsized":"2024-05-10T09:54:50.747428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1028096,"data_stored":759625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":170026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":169425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":425984,"data_stored":168993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35728,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336112,"statfs":{"total":96636764160,"available":96600178688,"internally_reserved":0,"allocated":397312,"data_stored":168159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1011712,"data_stored":759467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":425984,"data_stored":168847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:54:57.654 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:54:58.037 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:58.043 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:54:58.055 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-10T09:54:56.176087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249740,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754724980,"statfs":{"total":773094113280,"available":772838379520,"internally_reserved":0,"allocated":4562944,"data_stored":2533630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":251055670},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.487858"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720450+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:54:50.720450+0000","last_peered":"2024-05-10T09:54:50.720450+0000","last_clean":"2024-05-10T09:54:50.720450+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:54:50.720450+0000","last_undegraded":"2024-05-10T09:54:50.720450+0000","last_fullsized":"2024-05-10T09:54:50.720450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745614+0000","last_change":"2024-05-10T09:54:41.667015+0000","last_active":"2024-05-10T09:54:50.745614+0000","last_peered":"2024-05-10T09:54:50.745614+0000","last_clean":"2024-05-10T09:54:50.745614+0000","last_became_active":"2024-05-10T09:54:41.666273+0000","last_became_peered":"2024-05-10T09:54:41.666273+0000","last_unstale":"2024-05-10T09:54:50.745614+0000","last_undegraded":"2024-05-10T09:54:50.745614+0000","last_fullsized":"2024-05-10T09:54:50.745614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740976+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:54:50.740976+0000","last_peered":"2024-05-10T09:54:50.740976+0000","last_clean":"2024-05-10T09:54:50.740976+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:54:50.740976+0000","last_undegraded":"2024-05-10T09:54:50.740976+0000","last_fullsized":"2024-05-10T09:54:50.740976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720154+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:54:50.720154+0000","last_peered":"2024-05-10T09:54:50.720154+0000","last_clean":"2024-05-10T09:54:50.720154+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:54:50.720154+0000","last_undegraded":"2024-05-10T09:54:50.720154+0000","last_fullsized":"2024-05-10T09:54:50.720154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755624+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:54:50.755624+0000","last_peered":"2024-05-10T09:54:50.755624+0000","last_clean":"2024-05-10T09:54:50.755624+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:54:50.755624+0000","last_undegraded":"2024-05-10T09:54:50.755624+0000","last_fullsized":"2024-05-10T09:54:50.755624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763861+0000","last_change":"2024-05-10T09:54:41.653638+0000","last_active":"2024-05-10T09:54:50.763861+0000","last_peered":"2024-05-10T09:54:50.763861+0000","last_clean":"2024-05-10T09:54:50.763861+0000","last_became_active":"2024-05-10T09:54:41.652899+0000","last_became_peered":"2024-05-10T09:54:41.652899+0000","last_unstale":"2024-05-10T09:54:50.763861+0000","last_undegraded":"2024-05-10T09:54:50.763861+0000","last_fullsized":"2024-05-10T09:54:50.763861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747577+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:54:50.747577+0000","last_peered":"2024-05-10T09:54:50.747577+0000","last_clean":"2024-05-10T09:54:50.747577+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:54:50.747577+0000","last_undegraded":"2024-05-10T09:54:50.747577+0000","last_fullsized":"2024-05-10T09:54:50.747577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754734+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:54:50.754734+0000","last_peered":"2024-05-10T09:54:50.754734+0000","last_clean":"2024-05-10T09:54:50.754734+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:54:50.754734+0000","last_undegraded":"2024-05-10T09:54:50.754734+0000","last_fullsized":"2024-05-10T09:54:50.754734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720668+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:54:50.720668+0000","last_peered":"2024-05-10T09:54:50.720668+0000","last_clean":"2024-05-10T09:54:50.720668+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:54:50.720668+0000","last_undegraded":"2024-05-10T09:54:50.720668+0000","last_fullsized":"2024-05-10T09:54:50.720668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752588+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:54:50.752588+0000","last_peered":"2024-05-10T09:54:50.752588+0000","last_clean":"2024-05-10T09:54:50.752588+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:54:50.752588+0000","last_undegraded":"2024-05-10T09:54:50.752588+0000","last_fullsized":"2024-05-10T09:54:50.752588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746293+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:54:50.746293+0000","last_peered":"2024-05-10T09:54:50.746293+0000","last_clean":"2024-05-10T09:54:50.746293+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:54:50.746293+0000","last_undegraded":"2024-05-10T09:54:50.746293+0000","last_fullsized":"2024-05-10T09:54:50.746293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765007+0000","last_change":"2024-05-10T09:54:41.653073+0000","last_active":"2024-05-10T09:54:50.765007+0000","last_peered":"2024-05-10T09:54:50.765007+0000","last_clean":"2024-05-10T09:54:50.765007+0000","last_became_active":"2024-05-10T09:54:41.652296+0000","last_became_peered":"2024-05-10T09:54:41.652296+0000","last_unstale":"2024-05-10T09:54:50.765007+0000","last_undegraded":"2024-05-10T09:54:50.765007+0000","last_fullsized":"2024-05-10T09:54:50.765007+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720393+0000","last_change":"2024-05-10T09:54:39.636608+0000","last_active":"2024-05-10T09:54:50.720393+0000","last_peered":"2024-05-10T09:54:50.720393+0000","last_clean":"2024-05-10T09:54:50.720393+0000","last_became_active":"2024-05-10T09:54:39.635348+0000","last_became_peered":"2024-05-10T09:54:39.635348+0000","last_unstale":"2024-05-10T09:54:50.720393+0000","last_undegraded":"2024-05-10T09:54:50.720393+0000","last_fullsized":"2024-05-10T09:54:50.720393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747138+0000","last_change":"2024-05-10T09:54:41.671781+0000","last_active":"2024-05-10T09:54:50.747138+0000","last_peered":"2024-05-10T09:54:50.747138+0000","last_clean":"2024-05-10T09:54:50.747138+0000","last_became_active":"2024-05-10T09:54:41.668302+0000","last_became_peered":"2024-05-10T09:54:41.668302+0000","last_unstale":"2024-05-10T09:54:50.747138+0000","last_undegraded":"2024-05-10T09:54:50.747138+0000","last_fullsized":"2024-05-10T09:54:50.747138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:51.449905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720507+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:54:50.720507+0000","last_peered":"2024-05-10T09:54:50.720507+0000","last_clean":"2024-05-10T09:54:50.720507+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:54:50.720507+0000","last_undegraded":"2024-05-10T09:54:50.720507+0000","last_fullsized":"2024-05-10T09:54:50.720507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.722234+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:54:50.722234+0000","last_peered":"2024-05-10T09:54:50.722234+0000","last_clean":"2024-05-10T09:54:50.722234+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:54:50.722234+0000","last_undegraded":"2024-05-10T09:54:50.722234+0000","last_fullsized":"2024-05-10T09:54:50.722234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763445+0000","last_change":"2024-05-10T09:54:41.650051+0000","last_active":"2024-05-10T09:54:50.763445+0000","last_peered":"2024-05-10T09:54:50.763445+0000","last_clean":"2024-05-10T09:54:50.763445+0000","last_became_active":"2024-05-10T09:54:41.649076+0000","last_became_peered":"2024-05-10T09:54:41.649076+0000","last_unstale":"2024-05-10T09:54:50.763445+0000","last_undegraded":"2024-05-10T09:54:50.763445+0000","last_fullsized":"2024-05-10T09:54:50.763445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720686+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:54:50.720686+0000","last_peered":"2024-05-10T09:54:50.720686+0000","last_clean":"2024-05-10T09:54:50.720686+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:54:50.720686+0000","last_undegraded":"2024-05-10T09:54:50.720686+0000","last_fullsized":"2024-05-10T09:54:50.720686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720314+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:54:50.720314+0000","last_peered":"2024-05-10T09:54:50.720314+0000","last_clean":"2024-05-10T09:54:50.720314+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:54:50.720314+0000","last_undegraded":"2024-05-10T09:54:50.720314+0000","last_fullsized":"2024-05-10T09:54:50.720314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753212+0000","last_change":"2024-05-10T09:54:39.661291+0000","last_active":"2024-05-10T09:54:50.753212+0000","last_peered":"2024-05-10T09:54:50.753212+0000","last_clean":"2024-05-10T09:54:50.753212+0000","last_became_active":"2024-05-10T09:54:39.660723+0000","last_became_peered":"2024-05-10T09:54:39.660723+0000","last_unstale":"2024-05-10T09:54:50.753212+0000","last_undegraded":"2024-05-10T09:54:50.753212+0000","last_fullsized":"2024-05-10T09:54:50.753212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746673+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:54:50.746673+0000","last_peered":"2024-05-10T09:54:50.746673+0000","last_clean":"2024-05-10T09:54:50.746673+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:54:50.746673+0000","last_undegraded":"2024-05-10T09:54:50.746673+0000","last_fullsized":"2024-05-10T09:54:50.746673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753336+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:54:50.753336+0000","last_peered":"2024-05-10T09:54:50.753336+0000","last_clean":"2024-05-10T09:54:50.753336+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:54:50.753336+0000","last_undegraded":"2024-05-10T09:54:50.753336+0000","last_fullsized":"2024-05-10T09:54:50.753336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719590+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:54:50.719590+0000","last_peered":"2024-05-10T09:54:50.719590+0000","last_clean":"2024-05-10T09:54:50.719590+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:54:50.719590+0000","last_undegraded":"2024-05-10T09:54:50.719590+0000","last_fullsized":"2024-05-10T09:54:50.719590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764291+0000","last_change":"2024-05-10T09:54:39.645559+0000","last_active":"2024-05-10T09:54:50.764291+0000","last_peered":"2024-05-10T09:54:50.764291+0000","last_clean":"2024-05-10T09:54:50.764291+0000","last_became_active":"2024-05-10T09:54:39.644846+0000","last_became_peered":"2024-05-10T09:54:39.644846+0000","last_unstale":"2024-05-10T09:54:50.764291+0000","last_undegraded":"2024-05-10T09:54:50.764291+0000","last_fullsized":"2024-05-10T09:54:50.764291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719996+0000","last_change":"2024-05-10T09:54:41.649115+0000","last_active":"2024-05-10T09:54:50.719996+0000","last_peered":"2024-05-10T09:54:50.719996+0000","last_clean":"2024-05-10T09:54:50.719996+0000","last_became_active":"2024-05-10T09:54:41.647430+0000","last_became_peered":"2024-05-10T09:54:41.647430+0000","last_unstale":"2024-05-10T09:54:50.719996+0000","last_undegraded":"2024-05-10T09:54:50.719996+0000","last_fullsized":"2024-05-10T09:54:50.719996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:42.765522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720277+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:54:50.720277+0000","last_peered":"2024-05-10T09:54:50.720277+0000","last_clean":"2024-05-10T09:54:50.720277+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:54:50.720277+0000","last_undegraded":"2024-05-10T09:54:50.720277+0000","last_fullsized":"2024-05-10T09:54:50.720277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765030+0000","last_change":"2024-05-10T09:54:41.682344+0000","last_active":"2024-05-10T09:54:50.765030+0000","last_peered":"2024-05-10T09:54:50.765030+0000","last_clean":"2024-05-10T09:54:50.765030+0000","last_became_active":"2024-05-10T09:54:41.681757+0000","last_became_peered":"2024-05-10T09:54:41.681757+0000","last_unstale":"2024-05-10T09:54:50.765030+0000","last_undegraded":"2024-05-10T09:54:50.765030+0000","last_fullsized":"2024-05-10T09:54:50.765030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755171+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:54:50.755171+0000","last_peered":"2024-05-10T09:54:50.755171+0000","last_clean":"2024-05-10T09:54:50.755171+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:54:50.755171+0000","last_undegraded":"2024-05-10T09:54:50.755171+0000","last_fullsized":"2024-05-10T09:54:50.755171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763158+0000","last_change":"2024-05-10T09:54:49.721834+0000","last_active":"2024-05-10T09:54:50.763158+0000","last_peered":"2024-05-10T09:54:50.763158+0000","last_clean":"2024-05-10T09:54:50.763158+0000","last_became_active":"2024-05-10T09:54:49.721053+0000","last_became_peered":"2024-05-10T09:54:49.721053+0000","last_unstale":"2024-05-10T09:54:50.763158+0000","last_undegraded":"2024-05-10T09:54:50.763158+0000","last_fullsized":"2024-05-10T09:54:50.763158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:57.380622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723802+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:54:50.723802+0000","last_peered":"2024-05-10T09:54:50.723802+0000","last_clean":"2024-05-10T09:54:50.723802+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:54:50.723802+0000","last_undegraded":"2024-05-10T09:54:50.723802+0000","last_fullsized":"2024-05-10T09:54:50.723802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720866+0000","last_change":"2024-05-10T09:54:39.650251+0000","last_active":"2024-05-10T09:54:50.720866+0000","last_peered":"2024-05-10T09:54:50.720866+0000","last_clean":"2024-05-10T09:54:50.720866+0000","last_became_active":"2024-05-10T09:54:39.649230+0000","last_became_peered":"2024-05-10T09:54:39.649230+0000","last_unstale":"2024-05-10T09:54:50.720866+0000","last_undegraded":"2024-05-10T09:54:50.720866+0000","last_fullsized":"2024-05-10T09:54:50.720866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747672+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:54:50.747672+0000","last_peered":"2024-05-10T09:54:50.747672+0000","last_clean":"2024-05-10T09:54:50.747672+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:54:50.747672+0000","last_undegraded":"2024-05-10T09:54:50.747672+0000","last_fullsized":"2024-05-10T09:54:50.747672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.151229+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:54:51.151229+0000","last_peered":"2024-05-10T09:54:51.151229+0000","last_clean":"2024-05-10T09:54:51.151229+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:54:51.151229+0000","last_undegraded":"2024-05-10T09:54:51.151229+0000","last_fullsized":"2024-05-10T09:54:51.151229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719952+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:54:50.719952+0000","last_peered":"2024-05-10T09:54:50.719952+0000","last_clean":"2024-05-10T09:54:50.719952+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:54:50.719952+0000","last_undegraded":"2024-05-10T09:54:50.719952+0000","last_fullsized":"2024-05-10T09:54:50.719952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745524+0000","last_change":"2024-05-10T09:54:49.714649+0000","last_active":"2024-05-10T09:54:50.745524+0000","last_peered":"2024-05-10T09:54:50.745524+0000","last_clean":"2024-05-10T09:54:50.745524+0000","last_became_active":"2024-05-10T09:54:49.713854+0000","last_became_peered":"2024-05-10T09:54:49.713854+0000","last_unstale":"2024-05-10T09:54:50.745524+0000","last_undegraded":"2024-05-10T09:54:50.745524+0000","last_fullsized":"2024-05-10T09:54:50.745524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748188+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:54:50.748188+0000","last_peered":"2024-05-10T09:54:50.748188+0000","last_clean":"2024-05-10T09:54:50.748188+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:54:50.748188+0000","last_undegraded":"2024-05-10T09:54:50.748188+0000","last_fullsized":"2024-05-10T09:54:50.748188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755849+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:54:50.755849+0000","last_peered":"2024-05-10T09:54:50.755849+0000","last_clean":"2024-05-10T09:54:50.755849+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:54:50.755849+0000","last_undegraded":"2024-05-10T09:54:50.755849+0000","last_fullsized":"2024-05-10T09:54:50.755849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723389+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:54:50.723389+0000","last_peered":"2024-05-10T09:54:50.723389+0000","last_clean":"2024-05-10T09:54:50.723389+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:54:50.723389+0000","last_undegraded":"2024-05-10T09:54:50.723389+0000","last_fullsized":"2024-05-10T09:54:50.723389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.552431+0000","last_change":"2024-05-10T09:54:45.672737+0000","last_active":"2024-05-10T09:54:51.552431+0000","last_peered":"2024-05-10T09:54:51.552431+0000","last_clean":"2024-05-10T09:54:51.552431+0000","last_became_active":"2024-05-10T09:54:45.671969+0000","last_became_peered":"2024-05-10T09:54:45.671969+0000","last_unstale":"2024-05-10T09:54:51.552431+0000","last_undegraded":"2024-05-10T09:54:51.552431+0000","last_fullsized":"2024-05-10T09:54:51.552431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765022+0000","last_change":"2024-05-10T09:54:47.705920+0000","last_active":"2024-05-10T09:54:50.765022+0000","last_peered":"2024-05-10T09:54:50.765022+0000","last_clean":"2024-05-10T09:54:50.765022+0000","last_became_active":"2024-05-10T09:54:47.705078+0000","last_became_peered":"2024-05-10T09:54:47.705078+0000","last_unstale":"2024-05-10T09:54:50.765022+0000","last_undegraded":"2024-05-10T09:54:50.765022+0000","last_fullsized":"2024-05-10T09:54:50.765022+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754437+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:54:50.754437+0000","last_peered":"2024-05-10T09:54:50.754437+0000","last_clean":"2024-05-10T09:54:50.754437+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:54:50.754437+0000","last_undegraded":"2024-05-10T09:54:50.754437+0000","last_fullsized":"2024-05-10T09:54:50.754437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757827+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:54:50.757827+0000","last_peered":"2024-05-10T09:54:50.757827+0000","last_clean":"2024-05-10T09:54:50.757827+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:54:50.757827+0000","last_undegraded":"2024-05-10T09:54:50.757827+0000","last_fullsized":"2024-05-10T09:54:50.757827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720453+0000","last_change":"2024-05-10T09:54:39.656953+0000","last_active":"2024-05-10T09:54:50.720453+0000","last_peered":"2024-05-10T09:54:50.720453+0000","last_clean":"2024-05-10T09:54:50.720453+0000","last_became_active":"2024-05-10T09:54:39.656385+0000","last_became_peered":"2024-05-10T09:54:39.656385+0000","last_unstale":"2024-05-10T09:54:50.720453+0000","last_undegraded":"2024-05-10T09:54:50.720453+0000","last_fullsized":"2024-05-10T09:54:50.720453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.724159+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:54:50.724159+0000","last_peered":"2024-05-10T09:54:50.724159+0000","last_clean":"2024-05-10T09:54:50.724159+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:54:50.724159+0000","last_undegraded":"2024-05-10T09:54:50.724159+0000","last_fullsized":"2024-05-10T09:54:50.724159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.610407+0000","last_change":"2024-05-10T09:54:45.682487+0000","last_active":"2024-05-10T09:54:51.610407+0000","last_peered":"2024-05-10T09:54:51.610407+0000","last_clean":"2024-05-10T09:54:51.610407+0000","last_became_active":"2024-05-10T09:54:45.681037+0000","last_became_peered":"2024-05-10T09:54:45.681037+0000","last_unstale":"2024-05-10T09:54:51.610407+0000","last_undegraded":"2024-05-10T09:54:51.610407+0000","last_fullsized":"2024-05-10T09:54:51.610407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.890143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719700+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:54:50.719700+0000","last_peered":"2024-05-10T09:54:50.719700+0000","last_clean":"2024-05-10T09:54:50.719700+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:54:50.719700+0000","last_undegraded":"2024-05-10T09:54:50.719700+0000","last_fullsized":"2024-05-10T09:54:50.719700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763932+0000","last_change":"2024-05-10T09:54:49.698020+0000","last_active":"2024-05-10T09:54:50.763932+0000","last_peered":"2024-05-10T09:54:50.763932+0000","last_clean":"2024-05-10T09:54:50.763932+0000","last_became_active":"2024-05-10T09:54:49.697266+0000","last_became_peered":"2024-05-10T09:54:49.697266+0000","last_unstale":"2024-05-10T09:54:50.763932+0000","last_undegraded":"2024-05-10T09:54:50.763932+0000","last_fullsized":"2024-05-10T09:54:50.763932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:03.046232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723440+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:54:50.723440+0000","last_peered":"2024-05-10T09:54:50.723440+0000","last_clean":"2024-05-10T09:54:50.723440+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:54:50.723440+0000","last_undegraded":"2024-05-10T09:54:50.723440+0000","last_fullsized":"2024-05-10T09:54:50.723440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751433+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:54:50.751433+0000","last_peered":"2024-05-10T09:54:50.751433+0000","last_clean":"2024-05-10T09:54:50.751433+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:54:50.751433+0000","last_undegraded":"2024-05-10T09:54:50.751433+0000","last_fullsized":"2024-05-10T09:54:50.751433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746878+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:54:50.746878+0000","last_peered":"2024-05-10T09:54:50.746878+0000","last_clean":"2024-05-10T09:54:50.746878+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:54:50.746878+0000","last_undegraded":"2024-05-10T09:54:50.746878+0000","last_fullsized":"2024-05-10T09:54:50.746878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.618251+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:54:51.618251+0000","last_peered":"2024-05-10T09:54:51.618251+0000","last_clean":"2024-05-10T09:54:51.618251+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:54:51.618251+0000","last_undegraded":"2024-05-10T09:54:51.618251+0000","last_fullsized":"2024-05-10T09:54:51.618251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723365+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:54:50.723365+0000","last_peered":"2024-05-10T09:54:50.723365+0000","last_clean":"2024-05-10T09:54:50.723365+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:54:50.723365+0000","last_undegraded":"2024-05-10T09:54:50.723365+0000","last_fullsized":"2024-05-10T09:54:50.723365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745997+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:54:50.745997+0000","last_peered":"2024-05-10T09:54:50.745997+0000","last_clean":"2024-05-10T09:54:50.745997+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:54:50.745997+0000","last_undegraded":"2024-05-10T09:54:50.745997+0000","last_fullsized":"2024-05-10T09:54:50.745997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720929+0000","last_change":"2024-05-10T09:54:39.655305+0000","last_active":"2024-05-10T09:54:50.720929+0000","last_peered":"2024-05-10T09:54:50.720929+0000","last_clean":"2024-05-10T09:54:50.720929+0000","last_became_active":"2024-05-10T09:54:39.654853+0000","last_became_peered":"2024-05-10T09:54:39.654853+0000","last_unstale":"2024-05-10T09:54:50.720929+0000","last_undegraded":"2024-05-10T09:54:50.720929+0000","last_fullsized":"2024-05-10T09:54:50.720929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718848+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:54:50.718848+0000","last_peered":"2024-05-10T09:54:50.718848+0000","last_clean":"2024-05-10T09:54:50.718848+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:54:50.718848+0000","last_undegraded":"2024-05-10T09:54:50.718848+0000","last_fullsized":"2024-05-10T09:54:50.718848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.714769+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:54:51.714769+0000","last_peered":"2024-05-10T09:54:51.714769+0000","last_clean":"2024-05-10T09:54:51.714769+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:54:51.714769+0000","last_undegraded":"2024-05-10T09:54:51.714769+0000","last_fullsized":"2024-05-10T09:54:51.714769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739335+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:54:50.739335+0000","last_peered":"2024-05-10T09:54:50.739335+0000","last_clean":"2024-05-10T09:54:50.739335+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:54:50.739335+0000","last_undegraded":"2024-05-10T09:54:50.739335+0000","last_fullsized":"2024-05-10T09:54:50.739335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747009+0000","last_change":"2024-05-10T09:54:49.714403+0000","last_active":"2024-05-10T09:54:50.747009+0000","last_peered":"2024-05-10T09:54:50.747009+0000","last_clean":"2024-05-10T09:54:50.747009+0000","last_became_active":"2024-05-10T09:54:49.713603+0000","last_became_peered":"2024-05-10T09:54:49.713603+0000","last_unstale":"2024-05-10T09:54:50.747009+0000","last_undegraded":"2024-05-10T09:54:50.747009+0000","last_fullsized":"2024-05-10T09:54:50.747009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763415+0000","last_change":"2024-05-10T09:54:41.679939+0000","last_active":"2024-05-10T09:54:50.763415+0000","last_peered":"2024-05-10T09:54:50.763415+0000","last_clean":"2024-05-10T09:54:50.763415+0000","last_became_active":"2024-05-10T09:54:41.677609+0000","last_became_peered":"2024-05-10T09:54:41.677609+0000","last_unstale":"2024-05-10T09:54:50.763415+0000","last_undegraded":"2024-05-10T09:54:50.763415+0000","last_fullsized":"2024-05-10T09:54:50.763415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:32.390355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720262+0000","last_change":"2024-05-10T09:54:39.653238+0000","last_active":"2024-05-10T09:54:50.720262+0000","last_peered":"2024-05-10T09:54:50.720262+0000","last_clean":"2024-05-10T09:54:50.720262+0000","last_became_active":"2024-05-10T09:54:39.652480+0000","last_became_peered":"2024-05-10T09:54:39.652480+0000","last_unstale":"2024-05-10T09:54:50.720262+0000","last_undegraded":"2024-05-10T09:54:50.720262+0000","last_fullsized":"2024-05-10T09:54:50.720262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:14.288277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718201+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:54:50.718201+0000","last_peered":"2024-05-10T09:54:50.718201+0000","last_clean":"2024-05-10T09:54:50.718201+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:54:50.718201+0000","last_undegraded":"2024-05-10T09:54:50.718201+0000","last_fullsized":"2024-05-10T09:54:50.718201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.587695+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:54:51.587695+0000","last_peered":"2024-05-10T09:54:51.587695+0000","last_clean":"2024-05-10T09:54:51.587695+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:54:51.587695+0000","last_undegraded":"2024-05-10T09:54:51.587695+0000","last_fullsized":"2024-05-10T09:54:51.587695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718942+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:54:50.718942+0000","last_peered":"2024-05-10T09:54:50.718942+0000","last_clean":"2024-05-10T09:54:50.718942+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:54:50.718942+0000","last_undegraded":"2024-05-10T09:54:50.718942+0000","last_fullsized":"2024-05-10T09:54:50.718942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752672+0000","last_change":"2024-05-10T09:54:49.713266+0000","last_active":"2024-05-10T09:54:50.752672+0000","last_peered":"2024-05-10T09:54:50.752672+0000","last_clean":"2024-05-10T09:54:50.752672+0000","last_became_active":"2024-05-10T09:54:49.712512+0000","last_became_peered":"2024-05-10T09:54:49.712512+0000","last_unstale":"2024-05-10T09:54:50.752672+0000","last_undegraded":"2024-05-10T09:54:50.752672+0000","last_fullsized":"2024-05-10T09:54:50.752672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:27:03.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752036+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:54:50.752036+0000","last_peered":"2024-05-10T09:54:50.752036+0000","last_clean":"2024-05-10T09:54:50.752036+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:54:50.752036+0000","last_undegraded":"2024-05-10T09:54:50.752036+0000","last_fullsized":"2024-05-10T09:54:50.752036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721044+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:54:50.721044+0000","last_peered":"2024-05-10T09:54:50.721044+0000","last_clean":"2024-05-10T09:54:50.721044+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:54:50.721044+0000","last_undegraded":"2024-05-10T09:54:50.721044+0000","last_fullsized":"2024-05-10T09:54:50.721044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720374+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:54:50.720374+0000","last_peered":"2024-05-10T09:54:50.720374+0000","last_clean":"2024-05-10T09:54:50.720374+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:54:50.720374+0000","last_undegraded":"2024-05-10T09:54:50.720374+0000","last_fullsized":"2024-05-10T09:54:50.720374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.502943+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:54:51.502943+0000","last_peered":"2024-05-10T09:54:51.502943+0000","last_clean":"2024-05-10T09:54:51.502943+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:54:51.502943+0000","last_undegraded":"2024-05-10T09:54:51.502943+0000","last_fullsized":"2024-05-10T09:54:51.502943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753947+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:54:50.753947+0000","last_peered":"2024-05-10T09:54:50.753947+0000","last_clean":"2024-05-10T09:54:50.753947+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:54:50.753947+0000","last_undegraded":"2024-05-10T09:54:50.753947+0000","last_fullsized":"2024-05-10T09:54:50.753947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756484+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:54:50.756484+0000","last_peered":"2024-05-10T09:54:50.756484+0000","last_clean":"2024-05-10T09:54:50.756484+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:54:50.756484+0000","last_undegraded":"2024-05-10T09:54:50.756484+0000","last_fullsized":"2024-05-10T09:54:50.756484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756292+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:54:50.756292+0000","last_peered":"2024-05-10T09:54:50.756292+0000","last_clean":"2024-05-10T09:54:50.756292+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:54:50.756292+0000","last_undegraded":"2024-05-10T09:54:50.756292+0000","last_fullsized":"2024-05-10T09:54:50.756292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748143+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:54:50.748143+0000","last_peered":"2024-05-10T09:54:50.748143+0000","last_clean":"2024-05-10T09:54:50.748143+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:54:50.748143+0000","last_undegraded":"2024-05-10T09:54:50.748143+0000","last_fullsized":"2024-05-10T09:54:50.748143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719170+0000","last_change":"2024-05-10T09:54:43.670736+0000","last_active":"2024-05-10T09:54:50.719170+0000","last_peered":"2024-05-10T09:54:50.719170+0000","last_clean":"2024-05-10T09:54:50.719170+0000","last_became_active":"2024-05-10T09:54:43.670051+0000","last_became_peered":"2024-05-10T09:54:43.670051+0000","last_unstale":"2024-05-10T09:54:50.719170+0000","last_undegraded":"2024-05-10T09:54:50.719170+0000","last_fullsized":"2024-05-10T09:54:50.719170+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:06.739493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.118485+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:54:51.118485+0000","last_peered":"2024-05-10T09:54:51.118485+0000","last_clean":"2024-05-10T09:54:51.118485+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:54:51.118485+0000","last_undegraded":"2024-05-10T09:54:51.118485+0000","last_fullsized":"2024-05-10T09:54:51.118485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718001+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:54:50.718001+0000","last_peered":"2024-05-10T09:54:50.718001+0000","last_clean":"2024-05-10T09:54:50.718001+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:54:50.718001+0000","last_undegraded":"2024-05-10T09:54:50.718001+0000","last_fullsized":"2024-05-10T09:54:50.718001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740565+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:54:50.740565+0000","last_peered":"2024-05-10T09:54:50.740565+0000","last_clean":"2024-05-10T09:54:50.740565+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:54:50.740565+0000","last_undegraded":"2024-05-10T09:54:50.740565+0000","last_fullsized":"2024-05-10T09:54:50.740565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764597+0000","last_change":"2024-05-10T09:54:41.660216+0000","last_active":"2024-05-10T09:54:50.764597+0000","last_peered":"2024-05-10T09:54:50.764597+0000","last_clean":"2024-05-10T09:54:50.764597+0000","last_became_active":"2024-05-10T09:54:41.659431+0000","last_became_peered":"2024-05-10T09:54:41.659431+0000","last_unstale":"2024-05-10T09:54:50.764597+0000","last_undegraded":"2024-05-10T09:54:50.764597+0000","last_fullsized":"2024-05-10T09:54:50.764597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719614+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:54:50.719614+0000","last_peered":"2024-05-10T09:54:50.719614+0000","last_clean":"2024-05-10T09:54:50.719614+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:54:50.719614+0000","last_undegraded":"2024-05-10T09:54:50.719614+0000","last_fullsized":"2024-05-10T09:54:50.719614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720635+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:54:50.720635+0000","last_peered":"2024-05-10T09:54:50.720635+0000","last_clean":"2024-05-10T09:54:50.720635+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:54:50.720635+0000","last_undegraded":"2024-05-10T09:54:50.720635+0000","last_fullsized":"2024-05-10T09:54:50.720635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.653243+0000","last_change":"2024-05-10T09:54:45.680787+0000","last_active":"2024-05-10T09:54:51.653243+0000","last_peered":"2024-05-10T09:54:51.653243+0000","last_clean":"2024-05-10T09:54:51.653243+0000","last_became_active":"2024-05-10T09:54:45.680051+0000","last_became_peered":"2024-05-10T09:54:45.680051+0000","last_unstale":"2024-05-10T09:54:51.653243+0000","last_undegraded":"2024-05-10T09:54:51.653243+0000","last_fullsized":"2024-05-10T09:54:51.653243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756300+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:54:50.756300+0000","last_peered":"2024-05-10T09:54:50.756300+0000","last_clean":"2024-05-10T09:54:50.756300+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:54:50.756300+0000","last_undegraded":"2024-05-10T09:54:50.756300+0000","last_fullsized":"2024-05-10T09:54:50.756300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719120+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:54:50.719120+0000","last_peered":"2024-05-10T09:54:50.719120+0000","last_clean":"2024-05-10T09:54:50.719120+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:54:50.719120+0000","last_undegraded":"2024-05-10T09:54:50.719120+0000","last_fullsized":"2024-05-10T09:54:50.719120+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765312+0000","last_change":"2024-05-10T09:54:41.642683+0000","last_active":"2024-05-10T09:54:50.765312+0000","last_peered":"2024-05-10T09:54:50.765312+0000","last_clean":"2024-05-10T09:54:50.765312+0000","last_became_active":"2024-05-10T09:54:41.641669+0000","last_became_peered":"2024-05-10T09:54:41.641669+0000","last_unstale":"2024-05-10T09:54:50.765312+0000","last_undegraded":"2024-05-10T09:54:50.765312+0000","last_fullsized":"2024-05-10T09:54:50.765312+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752255+0000","last_change":"2024-05-10T09:54:39.642724+0000","last_active":"2024-05-10T09:54:50.752255+0000","last_peered":"2024-05-10T09:54:50.752255+0000","last_clean":"2024-05-10T09:54:50.752255+0000","last_became_active":"2024-05-10T09:54:39.641876+0000","last_became_peered":"2024-05-10T09:54:39.641876+0000","last_unstale":"2024-05-10T09:54:50.752255+0000","last_undegraded":"2024-05-10T09:54:50.752255+0000","last_fullsized":"2024-05-10T09:54:50.752255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:46.367837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739272+0000","last_change":"2024-05-10T09:54:43.676085+0000","last_active":"2024-05-10T09:54:50.739272+0000","last_peered":"2024-05-10T09:54:50.739272+0000","last_clean":"2024-05-10T09:54:50.739272+0000","last_became_active":"2024-05-10T09:54:43.675436+0000","last_became_peered":"2024-05-10T09:54:43.675436+0000","last_unstale":"2024-05-10T09:54:50.739272+0000","last_undegraded":"2024-05-10T09:54:50.739272+0000","last_fullsized":"2024-05-10T09:54:50.739272+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:44.545569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.722350+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:54:51.722350+0000","last_peered":"2024-05-10T09:54:51.722350+0000","last_clean":"2024-05-10T09:54:51.722350+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:54:51.722350+0000","last_undegraded":"2024-05-10T09:54:51.722350+0000","last_fullsized":"2024-05-10T09:54:51.722350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723929+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:54:50.723929+0000","last_peered":"2024-05-10T09:54:50.723929+0000","last_clean":"2024-05-10T09:54:50.723929+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:54:50.723929+0000","last_undegraded":"2024-05-10T09:54:50.723929+0000","last_fullsized":"2024-05-10T09:54:50.723929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739804+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:54:50.739804+0000","last_peered":"2024-05-10T09:54:50.739804+0000","last_clean":"2024-05-10T09:54:50.739804+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:54:50.739804+0000","last_undegraded":"2024-05-10T09:54:50.739804+0000","last_fullsized":"2024-05-10T09:54:50.739804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765673+0000","last_change":"2024-05-10T09:54:41.679291+0000","last_active":"2024-05-10T09:54:50.765673+0000","last_peered":"2024-05-10T09:54:50.765673+0000","last_clean":"2024-05-10T09:54:50.765673+0000","last_became_active":"2024-05-10T09:54:41.678293+0000","last_became_peered":"2024-05-10T09:54:41.678293+0000","last_unstale":"2024-05-10T09:54:50.765673+0000","last_undegraded":"2024-05-10T09:54:50.765673+0000","last_fullsized":"2024-05-10T09:54:50.765673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:51.449905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764284+0000","last_change":"2024-05-10T09:54:39.616968+0000","last_active":"2024-05-10T09:54:50.764284+0000","last_peered":"2024-05-10T09:54:50.764284+0000","last_clean":"2024-05-10T09:54:50.764284+0000","last_became_active":"2024-05-10T09:54:39.616425+0000","last_became_peered":"2024-05-10T09:54:39.616425+0000","last_unstale":"2024-05-10T09:54:50.764284+0000","last_undegraded":"2024-05-10T09:54:50.764284+0000","last_fullsized":"2024-05-10T09:54:50.764284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:46.367837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747666+0000","last_change":"2024-05-10T09:54:43.678495+0000","last_active":"2024-05-10T09:54:50.747666+0000","last_peered":"2024-05-10T09:54:50.747666+0000","last_clean":"2024-05-10T09:54:50.747666+0000","last_became_active":"2024-05-10T09:54:43.677157+0000","last_became_peered":"2024-05-10T09:54:43.677157+0000","last_unstale":"2024-05-10T09:54:50.747666+0000","last_undegraded":"2024-05-10T09:54:50.747666+0000","last_fullsized":"2024-05-10T09:54:50.747666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:58.560484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.509551+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:54:51.509551+0000","last_peered":"2024-05-10T09:54:51.509551+0000","last_clean":"2024-05-10T09:54:51.509551+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:54:51.509551+0000","last_undegraded":"2024-05-10T09:54:51.509551+0000","last_fullsized":"2024-05-10T09:54:51.509551+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752855+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:54:50.752855+0000","last_peered":"2024-05-10T09:54:50.752855+0000","last_clean":"2024-05-10T09:54:50.752855+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:54:50.752855+0000","last_undegraded":"2024-05-10T09:54:50.752855+0000","last_fullsized":"2024-05-10T09:54:50.752855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763972+0000","last_change":"2024-05-10T09:54:49.702101+0000","last_active":"2024-05-10T09:54:50.763972+0000","last_peered":"2024-05-10T09:54:50.763972+0000","last_clean":"2024-05-10T09:54:50.763972+0000","last_became_active":"2024-05-10T09:54:49.701351+0000","last_became_peered":"2024-05-10T09:54:49.701351+0000","last_unstale":"2024-05-10T09:54:50.763972+0000","last_undegraded":"2024-05-10T09:54:50.763972+0000","last_fullsized":"2024-05-10T09:54:50.763972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.741091+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:54:50.741091+0000","last_peered":"2024-05-10T09:54:50.741091+0000","last_clean":"2024-05-10T09:54:50.741091+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:54:50.741091+0000","last_undegraded":"2024-05-10T09:54:50.741091+0000","last_fullsized":"2024-05-10T09:54:50.741091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720763+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:54:50.720763+0000","last_peered":"2024-05-10T09:54:50.720763+0000","last_clean":"2024-05-10T09:54:50.720763+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:54:50.720763+0000","last_undegraded":"2024-05-10T09:54:50.720763+0000","last_fullsized":"2024-05-10T09:54:50.720763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765358+0000","last_change":"2024-05-10T09:54:43.670667+0000","last_active":"2024-05-10T09:54:50.765358+0000","last_peered":"2024-05-10T09:54:50.765358+0000","last_clean":"2024-05-10T09:54:50.765358+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:54:50.765358+0000","last_undegraded":"2024-05-10T09:54:50.765358+0000","last_fullsized":"2024-05-10T09:54:50.765358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.645524+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:54:51.645524+0000","last_peered":"2024-05-10T09:54:51.645524+0000","last_clean":"2024-05-10T09:54:51.645524+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:54:51.645524+0000","last_undegraded":"2024-05-10T09:54:51.645524+0000","last_fullsized":"2024-05-10T09:54:51.645524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752301+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:54:50.752301+0000","last_peered":"2024-05-10T09:54:50.752301+0000","last_clean":"2024-05-10T09:54:50.752301+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:54:50.752301+0000","last_undegraded":"2024-05-10T09:54:50.752301+0000","last_fullsized":"2024-05-10T09:54:50.752301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739146+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:54:50.739146+0000","last_peered":"2024-05-10T09:54:50.739146+0000","last_clean":"2024-05-10T09:54:50.739146+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:54:50.739146+0000","last_undegraded":"2024-05-10T09:54:50.739146+0000","last_fullsized":"2024-05-10T09:54:50.739146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753077+0000","last_change":"2024-05-10T09:54:41.676551+0000","last_active":"2024-05-10T09:54:50.753077+0000","last_peered":"2024-05-10T09:54:50.753077+0000","last_clean":"2024-05-10T09:54:50.753077+0000","last_became_active":"2024-05-10T09:54:41.675775+0000","last_became_peered":"2024-05-10T09:54:41.675775+0000","last_unstale":"2024-05-10T09:54:50.753077+0000","last_undegraded":"2024-05-10T09:54:50.753077+0000","last_fullsized":"2024-05-10T09:54:50.753077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:41.940007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":134,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719337+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:54:50.719337+0000","last_peered":"2024-05-10T09:54:50.719337+0000","last_clean":"2024-05-10T09:54:50.719337+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:54:50.719337+0000","last_undegraded":"2024-05-10T09:54:50.719337+0000","last_fullsized":"2024-05-10T09:54:50.719337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746345+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:54:50.746345+0000","last_peered":"2024-05-10T09:54:50.746345+0000","last_clean":"2024-05-10T09:54:50.746345+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:54:50.746345+0000","last_undegraded":"2024-05-10T09:54:50.746345+0000","last_fullsized":"2024-05-10T09:54:50.746345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720069+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:54:50.720069+0000","last_peered":"2024-05-10T09:54:50.720069+0000","last_clean":"2024-05-10T09:54:50.720069+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:54:50.720069+0000","last_undegraded":"2024-05-10T09:54:50.720069+0000","last_fullsized":"2024-05-10T09:54:50.720069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719619+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:54:50.719619+0000","last_peered":"2024-05-10T09:54:50.719619+0000","last_clean":"2024-05-10T09:54:50.719619+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:54:50.719619+0000","last_undegraded":"2024-05-10T09:54:50.719619+0000","last_fullsized":"2024-05-10T09:54:50.719619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.442182+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:54:51.442182+0000","last_peered":"2024-05-10T09:54:51.442182+0000","last_clean":"2024-05-10T09:54:51.442182+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:54:51.442182+0000","last_undegraded":"2024-05-10T09:54:51.442182+0000","last_fullsized":"2024-05-10T09:54:51.442182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756199+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:54:50.756199+0000","last_peered":"2024-05-10T09:54:50.756199+0000","last_clean":"2024-05-10T09:54:50.756199+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:54:50.756199+0000","last_undegraded":"2024-05-10T09:54:50.756199+0000","last_fullsized":"2024-05-10T09:54:50.756199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751326+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:54:50.751326+0000","last_peered":"2024-05-10T09:54:50.751326+0000","last_clean":"2024-05-10T09:54:50.751326+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:54:50.751326+0000","last_undegraded":"2024-05-10T09:54:50.751326+0000","last_fullsized":"2024-05-10T09:54:50.751326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757545+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:54:50.757545+0000","last_peered":"2024-05-10T09:54:50.757545+0000","last_clean":"2024-05-10T09:54:50.757545+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:54:50.757545+0000","last_undegraded":"2024-05-10T09:54:50.757545+0000","last_fullsized":"2024-05-10T09:54:50.757545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719083+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:54:50.719083+0000","last_peered":"2024-05-10T09:54:50.719083+0000","last_clean":"2024-05-10T09:54:50.719083+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:54:50.719083+0000","last_undegraded":"2024-05-10T09:54:50.719083+0000","last_fullsized":"2024-05-10T09:54:50.719083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754790+0000","last_change":"2024-05-10T09:54:39.641338+0000","last_active":"2024-05-10T09:54:50.754790+0000","last_peered":"2024-05-10T09:54:50.754790+0000","last_clean":"2024-05-10T09:54:50.754790+0000","last_became_active":"2024-05-10T09:54:39.641097+0000","last_became_peered":"2024-05-10T09:54:39.641097+0000","last_unstale":"2024-05-10T09:54:50.754790+0000","last_undegraded":"2024-05-10T09:54:50.754790+0000","last_fullsized":"2024-05-10T09:54:50.754790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748558+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:54:50.748558+0000","last_peered":"2024-05-10T09:54:50.748558+0000","last_clean":"2024-05-10T09:54:50.748558+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:54:50.748558+0000","last_undegraded":"2024-05-10T09:54:50.748558+0000","last_fullsized":"2024-05-10T09:54:50.748558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.634261+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:54:51.634261+0000","last_peered":"2024-05-10T09:54:51.634261+0000","last_clean":"2024-05-10T09:54:51.634261+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:54:51.634261+0000","last_undegraded":"2024-05-10T09:54:51.634261+0000","last_fullsized":"2024-05-10T09:54:51.634261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719841+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:54:50.719841+0000","last_peered":"2024-05-10T09:54:50.719841+0000","last_clean":"2024-05-10T09:54:50.719841+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:54:50.719841+0000","last_undegraded":"2024-05-10T09:54:50.719841+0000","last_fullsized":"2024-05-10T09:54:50.719841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.738909+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:54:50.738909+0000","last_peered":"2024-05-10T09:54:50.738909+0000","last_clean":"2024-05-10T09:54:50.738909+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:54:50.738909+0000","last_undegraded":"2024-05-10T09:54:50.738909+0000","last_fullsized":"2024-05-10T09:54:50.738909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.741270+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:54:50.741270+0000","last_peered":"2024-05-10T09:54:50.741270+0000","last_clean":"2024-05-10T09:54:50.741270+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:54:50.741270+0000","last_undegraded":"2024-05-10T09:54:50.741270+0000","last_fullsized":"2024-05-10T09:54:50.741270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718701+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:54:50.718701+0000","last_peered":"2024-05-10T09:54:50.718701+0000","last_clean":"2024-05-10T09:54:50.718701+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:54:50.718701+0000","last_undegraded":"2024-05-10T09:54:50.718701+0000","last_fullsized":"2024-05-10T09:54:50.718701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.738763+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:54:50.738763+0000","last_peered":"2024-05-10T09:54:50.738763+0000","last_clean":"2024-05-10T09:54:50.738763+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:54:50.738763+0000","last_undegraded":"2024-05-10T09:54:50.738763+0000","last_fullsized":"2024-05-10T09:54:50.738763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.724077+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:54:50.724077+0000","last_peered":"2024-05-10T09:54:50.724077+0000","last_clean":"2024-05-10T09:54:50.724077+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:54:50.724077+0000","last_undegraded":"2024-05-10T09:54:50.724077+0000","last_fullsized":"2024-05-10T09:54:50.724077+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.640862+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:54:51.640862+0000","last_peered":"2024-05-10T09:54:51.640862+0000","last_clean":"2024-05-10T09:54:51.640862+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:54:51.640862+0000","last_undegraded":"2024-05-10T09:54:51.640862+0000","last_fullsized":"2024-05-10T09:54:51.640862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755144+0000","last_change":"2024-05-10T09:54:47.692709+0000","last_active":"2024-05-10T09:54:50.755144+0000","last_peered":"2024-05-10T09:54:50.755144+0000","last_clean":"2024-05-10T09:54:50.755144+0000","last_became_active":"2024-05-10T09:54:47.691803+0000","last_became_peered":"2024-05-10T09:54:47.691803+0000","last_unstale":"2024-05-10T09:54:50.755144+0000","last_undegraded":"2024-05-10T09:54:50.755144+0000","last_fullsized":"2024-05-10T09:54:50.755144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720867+0000","last_change":"2024-05-10T09:54:49.720781+0000","last_active":"2024-05-10T09:54:50.720867+0000","last_peered":"2024-05-10T09:54:50.720867+0000","last_clean":"2024-05-10T09:54:50.720867+0000","last_became_active":"2024-05-10T09:54:49.719403+0000","last_became_peered":"2024-05-10T09:54:49.719403+0000","last_unstale":"2024-05-10T09:54:50.720867+0000","last_undegraded":"2024-05-10T09:54:50.720867+0000","last_fullsized":"2024-05-10T09:54:50.720867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:39.459750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739579+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:54:50.739579+0000","last_peered":"2024-05-10T09:54:50.739579+0000","last_clean":"2024-05-10T09:54:50.739579+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:54:50.739579+0000","last_undegraded":"2024-05-10T09:54:50.739579+0000","last_fullsized":"2024-05-10T09:54:50.739579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746987+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:54:50.746987+0000","last_peered":"2024-05-10T09:54:50.746987+0000","last_clean":"2024-05-10T09:54:50.746987+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:54:50.746987+0000","last_undegraded":"2024-05-10T09:54:50.746987+0000","last_fullsized":"2024-05-10T09:54:50.746987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764562+0000","last_change":"2024-05-10T09:54:39.625577+0000","last_active":"2024-05-10T09:54:50.764562+0000","last_peered":"2024-05-10T09:54:50.764562+0000","last_clean":"2024-05-10T09:54:50.764562+0000","last_became_active":"2024-05-10T09:54:39.624844+0000","last_became_peered":"2024-05-10T09:54:39.624844+0000","last_unstale":"2024-05-10T09:54:50.764562+0000","last_undegraded":"2024-05-10T09:54:50.764562+0000","last_fullsized":"2024-05-10T09:54:50.764562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:12.050190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755446+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:54:50.755446+0000","last_peered":"2024-05-10T09:54:50.755446+0000","last_clean":"2024-05-10T09:54:50.755446+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:54:50.755446+0000","last_undegraded":"2024-05-10T09:54:50.755446+0000","last_fullsized":"2024-05-10T09:54:50.755446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.475217+0000","last_change":"2024-05-10T09:54:45.683260+0000","last_active":"2024-05-10T09:54:51.475217+0000","last_peered":"2024-05-10T09:54:51.475217+0000","last_clean":"2024-05-10T09:54:51.475217+0000","last_became_active":"2024-05-10T09:54:45.682646+0000","last_became_peered":"2024-05-10T09:54:45.682646+0000","last_unstale":"2024-05-10T09:54:51.475217+0000","last_undegraded":"2024-05-10T09:54:51.475217+0000","last_fullsized":"2024-05-10T09:54:51.475217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:07.295363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753405+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:54:50.753405+0000","last_peered":"2024-05-10T09:54:50.753405+0000","last_clean":"2024-05-10T09:54:50.753405+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:54:50.753405+0000","last_undegraded":"2024-05-10T09:54:50.753405+0000","last_fullsized":"2024-05-10T09:54:50.753405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745339+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:54:50.745339+0000","last_peered":"2024-05-10T09:54:50.745339+0000","last_clean":"2024-05-10T09:54:50.745339+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:54:50.745339+0000","last_undegraded":"2024-05-10T09:54:50.745339+0000","last_fullsized":"2024-05-10T09:54:50.745339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739248+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:54:50.739248+0000","last_peered":"2024-05-10T09:54:50.739248+0000","last_clean":"2024-05-10T09:54:50.739248+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:54:50.739248+0000","last_undegraded":"2024-05-10T09:54:50.739248+0000","last_fullsized":"2024-05-10T09:54:50.739248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748444+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:54:50.748444+0000","last_peered":"2024-05-10T09:54:50.748444+0000","last_clean":"2024-05-10T09:54:50.748444+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:54:50.748444+0000","last_undegraded":"2024-05-10T09:54:50.748444+0000","last_fullsized":"2024-05-10T09:54:50.748444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740432+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:54:50.740432+0000","last_peered":"2024-05-10T09:54:50.740432+0000","last_clean":"2024-05-10T09:54:50.740432+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:54:50.740432+0000","last_undegraded":"2024-05-10T09:54:50.740432+0000","last_fullsized":"2024-05-10T09:54:50.740432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755055+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:54:50.755055+0000","last_peered":"2024-05-10T09:54:50.755055+0000","last_clean":"2024-05-10T09:54:50.755055+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:54:50.755055+0000","last_undegraded":"2024-05-10T09:54:50.755055+0000","last_fullsized":"2024-05-10T09:54:50.755055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.566196+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:54:51.566196+0000","last_peered":"2024-05-10T09:54:51.566196+0000","last_clean":"2024-05-10T09:54:51.566196+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:54:51.566196+0000","last_undegraded":"2024-05-10T09:54:51.566196+0000","last_fullsized":"2024-05-10T09:54:51.566196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763102+0000","last_change":"2024-05-10T09:54:47.714622+0000","last_active":"2024-05-10T09:54:50.763102+0000","last_peered":"2024-05-10T09:54:50.763102+0000","last_clean":"2024-05-10T09:54:50.763102+0000","last_became_active":"2024-05-10T09:54:47.713840+0000","last_became_peered":"2024-05-10T09:54:47.713840+0000","last_unstale":"2024-05-10T09:54:50.763102+0000","last_undegraded":"2024-05-10T09:54:50.763102+0000","last_fullsized":"2024-05-10T09:54:50.763102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755567+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:54:50.755567+0000","last_peered":"2024-05-10T09:54:50.755567+0000","last_clean":"2024-05-10T09:54:50.755567+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:54:50.755567+0000","last_undegraded":"2024-05-10T09:54:50.755567+0000","last_fullsized":"2024-05-10T09:54:50.755567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756379+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:54:50.756379+0000","last_peered":"2024-05-10T09:54:50.756379+0000","last_clean":"2024-05-10T09:54:50.756379+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:54:50.756379+0000","last_undegraded":"2024-05-10T09:54:50.756379+0000","last_fullsized":"2024-05-10T09:54:50.756379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739861+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:54:50.739861+0000","last_peered":"2024-05-10T09:54:50.739861+0000","last_clean":"2024-05-10T09:54:50.739861+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:54:50.739861+0000","last_undegraded":"2024-05-10T09:54:50.739861+0000","last_fullsized":"2024-05-10T09:54:50.739861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721293+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:54:50.721293+0000","last_peered":"2024-05-10T09:54:50.721293+0000","last_clean":"2024-05-10T09:54:50.721293+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:54:50.721293+0000","last_undegraded":"2024-05-10T09:54:50.721293+0000","last_fullsized":"2024-05-10T09:54:50.721293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751780+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:54:50.751780+0000","last_peered":"2024-05-10T09:54:50.751780+0000","last_clean":"2024-05-10T09:54:50.751780+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:54:50.751780+0000","last_undegraded":"2024-05-10T09:54:50.751780+0000","last_fullsized":"2024-05-10T09:54:50.751780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.667271+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:54:51.667271+0000","last_peered":"2024-05-10T09:54:51.667271+0000","last_clean":"2024-05-10T09:54:51.667271+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:54:51.667271+0000","last_undegraded":"2024-05-10T09:54:51.667271+0000","last_fullsized":"2024-05-10T09:54:51.667271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745849+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:54:50.745849+0000","last_peered":"2024-05-10T09:54:50.745849+0000","last_clean":"2024-05-10T09:54:50.745849+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:54:50.745849+0000","last_undegraded":"2024-05-10T09:54:50.745849+0000","last_fullsized":"2024-05-10T09:54:50.745849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723790+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:54:50.723790+0000","last_peered":"2024-05-10T09:54:50.723790+0000","last_clean":"2024-05-10T09:54:50.723790+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:54:50.723790+0000","last_undegraded":"2024-05-10T09:54:50.723790+0000","last_fullsized":"2024-05-10T09:54:50.723790+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720235+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:54:50.720235+0000","last_peered":"2024-05-10T09:54:50.720235+0000","last_clean":"2024-05-10T09:54:50.720235+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:54:50.720235+0000","last_undegraded":"2024-05-10T09:54:50.720235+0000","last_fullsized":"2024-05-10T09:54:50.720235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723112+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:54:50.723112+0000","last_peered":"2024-05-10T09:54:50.723112+0000","last_clean":"2024-05-10T09:54:50.723112+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:54:50.723112+0000","last_undegraded":"2024-05-10T09:54:50.723112+0000","last_fullsized":"2024-05-10T09:54:50.723112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740990+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:54:50.740990+0000","last_peered":"2024-05-10T09:54:50.740990+0000","last_clean":"2024-05-10T09:54:50.740990+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:54:50.740990+0000","last_undegraded":"2024-05-10T09:54:50.740990+0000","last_fullsized":"2024-05-10T09:54:50.740990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763434+0000","last_change":"2024-05-10T09:54:43.675983+0000","last_active":"2024-05-10T09:54:50.763434+0000","last_peered":"2024-05-10T09:54:50.763434+0000","last_clean":"2024-05-10T09:54:50.763434+0000","last_became_active":"2024-05-10T09:54:43.675216+0000","last_became_peered":"2024-05-10T09:54:43.675216+0000","last_unstale":"2024-05-10T09:54:50.763434+0000","last_undegraded":"2024-05-10T09:54:50.763434+0000","last_fullsized":"2024-05-10T09:54:50.763434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:04.447968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.624986+0000","last_change":"2024-05-10T09:54:45.678454+0000","last_active":"2024-05-10T09:54:51.624986+0000","last_peered":"2024-05-10T09:54:51.624986+0000","last_clean":"2024-05-10T09:54:51.624986+0000","last_became_active":"2024-05-10T09:54:45.677332+0000","last_became_peered":"2024-05-10T09:54:45.677332+0000","last_unstale":"2024-05-10T09:54:51.624986+0000","last_undegraded":"2024-05-10T09:54:51.624986+0000","last_fullsized":"2024-05-10T09:54:51.624986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.722773+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:54:50.722773+0000","last_peered":"2024-05-10T09:54:50.722773+0000","last_clean":"2024-05-10T09:54:50.722773+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:54:50.722773+0000","last_undegraded":"2024-05-10T09:54:50.722773+0000","last_fullsized":"2024-05-10T09:54:50.722773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757211+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:54:50.757211+0000","last_peered":"2024-05-10T09:54:50.757211+0000","last_clean":"2024-05-10T09:54:50.757211+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:54:50.757211+0000","last_undegraded":"2024-05-10T09:54:50.757211+0000","last_fullsized":"2024-05-10T09:54:50.757211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763690+0000","last_change":"2024-05-10T09:54:41.666849+0000","last_active":"2024-05-10T09:54:50.763690+0000","last_peered":"2024-05-10T09:54:50.763690+0000","last_clean":"2024-05-10T09:54:50.763690+0000","last_became_active":"2024-05-10T09:54:41.666154+0000","last_became_peered":"2024-05-10T09:54:41.666154+0000","last_unstale":"2024-05-10T09:54:50.763690+0000","last_undegraded":"2024-05-10T09:54:50.763690+0000","last_fullsized":"2024-05-10T09:54:50.763690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:02.444561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757839+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:54:50.757839+0000","last_peered":"2024-05-10T09:54:50.757839+0000","last_clean":"2024-05-10T09:54:50.757839+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:54:50.757839+0000","last_undegraded":"2024-05-10T09:54:50.757839+0000","last_fullsized":"2024-05-10T09:54:50.757839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753758+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:54:50.753758+0000","last_peered":"2024-05-10T09:54:50.753758+0000","last_clean":"2024-05-10T09:54:50.753758+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:54:50.753758+0000","last_undegraded":"2024-05-10T09:54:50.753758+0000","last_fullsized":"2024-05-10T09:54:50.753758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719981+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:54:50.719981+0000","last_peered":"2024-05-10T09:54:50.719981+0000","last_clean":"2024-05-10T09:54:50.719981+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:54:50.719981+0000","last_undegraded":"2024-05-10T09:54:50.719981+0000","last_fullsized":"2024-05-10T09:54:50.719981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.602673+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:54:51.602673+0000","last_peered":"2024-05-10T09:54:51.602673+0000","last_clean":"2024-05-10T09:54:51.602673+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:54:51.602673+0000","last_undegraded":"2024-05-10T09:54:51.602673+0000","last_fullsized":"2024-05-10T09:54:51.602673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719504+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:54:50.719504+0000","last_peered":"2024-05-10T09:54:50.719504+0000","last_clean":"2024-05-10T09:54:50.719504+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:54:50.719504+0000","last_undegraded":"2024-05-10T09:54:50.719504+0000","last_fullsized":"2024-05-10T09:54:50.719504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747323+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:54:50.747323+0000","last_peered":"2024-05-10T09:54:50.747323+0000","last_clean":"2024-05-10T09:54:50.747323+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:54:50.747323+0000","last_undegraded":"2024-05-10T09:54:50.747323+0000","last_fullsized":"2024-05-10T09:54:50.747323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756018+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:54:50.756018+0000","last_peered":"2024-05-10T09:54:50.756018+0000","last_clean":"2024-05-10T09:54:50.756018+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:54:50.756018+0000","last_undegraded":"2024-05-10T09:54:50.756018+0000","last_fullsized":"2024-05-10T09:54:50.756018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764025+0000","last_change":"2024-05-10T09:54:41.679647+0000","last_active":"2024-05-10T09:54:50.764025+0000","last_peered":"2024-05-10T09:54:50.764025+0000","last_clean":"2024-05-10T09:54:50.764025+0000","last_became_active":"2024-05-10T09:54:41.676614+0000","last_became_peered":"2024-05-10T09:54:41.676614+0000","last_unstale":"2024-05-10T09:54:50.764025+0000","last_undegraded":"2024-05-10T09:54:50.764025+0000","last_fullsized":"2024-05-10T09:54:50.764025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764046+0000","last_change":"2024-05-10T09:54:39.641072+0000","last_active":"2024-05-10T09:54:50.764046+0000","last_peered":"2024-05-10T09:54:50.764046+0000","last_clean":"2024-05-10T09:54:50.764046+0000","last_became_active":"2024-05-10T09:54:39.632868+0000","last_became_peered":"2024-05-10T09:54:39.632868+0000","last_unstale":"2024-05-10T09:54:50.764046+0000","last_undegraded":"2024-05-10T09:54:50.764046+0000","last_fullsized":"2024-05-10T09:54:50.764046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739559+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:54:50.739559+0000","last_peered":"2024-05-10T09:54:50.739559+0000","last_clean":"2024-05-10T09:54:50.739559+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:54:50.739559+0000","last_undegraded":"2024-05-10T09:54:50.739559+0000","last_fullsized":"2024-05-10T09:54:50.739559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.674086+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:54:51.674086+0000","last_peered":"2024-05-10T09:54:51.674086+0000","last_clean":"2024-05-10T09:54:51.674086+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:54:51.674086+0000","last_undegraded":"2024-05-10T09:54:51.674086+0000","last_fullsized":"2024-05-10T09:54:51.674086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719379+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:54:50.719379+0000","last_peered":"2024-05-10T09:54:50.719379+0000","last_clean":"2024-05-10T09:54:50.719379+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:54:50.719379+0000","last_undegraded":"2024-05-10T09:54:50.719379+0000","last_fullsized":"2024-05-10T09:54:50.719379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.722967+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:54:50.722967+0000","last_peered":"2024-05-10T09:54:50.722967+0000","last_clean":"2024-05-10T09:54:50.722967+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:54:50.722967+0000","last_undegraded":"2024-05-10T09:54:50.722967+0000","last_fullsized":"2024-05-10T09:54:50.722967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739249+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:54:50.739249+0000","last_peered":"2024-05-10T09:54:50.739249+0000","last_clean":"2024-05-10T09:54:50.739249+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:54:50.739249+0000","last_undegraded":"2024-05-10T09:54:50.739249+0000","last_fullsized":"2024-05-10T09:54:50.739249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721061+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:54:50.721061+0000","last_peered":"2024-05-10T09:54:50.721061+0000","last_clean":"2024-05-10T09:54:50.721061+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:54:50.721061+0000","last_undegraded":"2024-05-10T09:54:50.721061+0000","last_fullsized":"2024-05-10T09:54:50.721061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720538+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:54:50.720538+0000","last_peered":"2024-05-10T09:54:50.720538+0000","last_clean":"2024-05-10T09:54:50.720538+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:54:50.720538+0000","last_undegraded":"2024-05-10T09:54:50.720538+0000","last_fullsized":"2024-05-10T09:54:50.720538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.119315+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:54:51.119315+0000","last_peered":"2024-05-10T09:54:51.119315+0000","last_clean":"2024-05-10T09:54:51.119315+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:54:51.119315+0000","last_undegraded":"2024-05-10T09:54:51.119315+0000","last_fullsized":"2024-05-10T09:54:51.119315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720138+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:54:50.720138+0000","last_peered":"2024-05-10T09:54:50.720138+0000","last_clean":"2024-05-10T09:54:50.720138+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:54:50.720138+0000","last_undegraded":"2024-05-10T09:54:50.720138+0000","last_fullsized":"2024-05-10T09:54:50.720138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755260+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:54:50.755260+0000","last_peered":"2024-05-10T09:54:50.755260+0000","last_clean":"2024-05-10T09:54:50.755260+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:54:50.755260+0000","last_undegraded":"2024-05-10T09:54:50.755260+0000","last_fullsized":"2024-05-10T09:54:50.755260+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720944+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:54:50.720944+0000","last_peered":"2024-05-10T09:54:50.720944+0000","last_clean":"2024-05-10T09:54:50.720944+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:54:50.720944+0000","last_undegraded":"2024-05-10T09:54:50.720944+0000","last_fullsized":"2024-05-10T09:54:50.720944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747657+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:54:50.747657+0000","last_peered":"2024-05-10T09:54:50.747657+0000","last_clean":"2024-05-10T09:54:50.747657+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:54:50.747657+0000","last_undegraded":"2024-05-10T09:54:50.747657+0000","last_fullsized":"2024-05-10T09:54:50.747657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718422+0000","last_change":"2024-05-10T09:54:43.676605+0000","last_active":"2024-05-10T09:54:50.718422+0000","last_peered":"2024-05-10T09:54:50.718422+0000","last_clean":"2024-05-10T09:54:50.718422+0000","last_became_active":"2024-05-10T09:54:43.675860+0000","last_became_peered":"2024-05-10T09:54:43.675860+0000","last_unstale":"2024-05-10T09:54:50.718422+0000","last_undegraded":"2024-05-10T09:54:50.718422+0000","last_fullsized":"2024-05-10T09:54:50.718422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:50.004032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.580244+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:54:51.580244+0000","last_peered":"2024-05-10T09:54:51.580244+0000","last_clean":"2024-05-10T09:54:51.580244+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:54:51.580244+0000","last_undegraded":"2024-05-10T09:54:51.580244+0000","last_fullsized":"2024-05-10T09:54:51.580244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751716+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:54:50.751716+0000","last_peered":"2024-05-10T09:54:50.751716+0000","last_clean":"2024-05-10T09:54:50.751716+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:54:50.751716+0000","last_undegraded":"2024-05-10T09:54:50.751716+0000","last_fullsized":"2024-05-10T09:54:50.751716+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746582+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:54:50.746582+0000","last_peered":"2024-05-10T09:54:50.746582+0000","last_clean":"2024-05-10T09:54:50.746582+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:54:50.746582+0000","last_undegraded":"2024-05-10T09:54:50.746582+0000","last_fullsized":"2024-05-10T09:54:50.746582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720395+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:54:50.720395+0000","last_peered":"2024-05-10T09:54:50.720395+0000","last_clean":"2024-05-10T09:54:50.720395+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:54:50.720395+0000","last_undegraded":"2024-05-10T09:54:50.720395+0000","last_fullsized":"2024-05-10T09:54:50.720395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757657+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:54:50.757657+0000","last_peered":"2024-05-10T09:54:50.757657+0000","last_clean":"2024-05-10T09:54:50.757657+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:54:50.757657+0000","last_undegraded":"2024-05-10T09:54:50.757657+0000","last_fullsized":"2024-05-10T09:54:50.757657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751710+0000","last_change":"2024-05-10T09:54:43.676597+0000","last_active":"2024-05-10T09:54:50.751710+0000","last_peered":"2024-05-10T09:54:50.751710+0000","last_clean":"2024-05-10T09:54:50.751710+0000","last_became_active":"2024-05-10T09:54:43.675870+0000","last_became_peered":"2024-05-10T09:54:43.675870+0000","last_unstale":"2024-05-10T09:54:50.751710+0000","last_undegraded":"2024-05-10T09:54:50.751710+0000","last_fullsized":"2024-05-10T09:54:50.751710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:56.842817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.357729+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:54:51.357729+0000","last_peered":"2024-05-10T09:54:51.357729+0000","last_clean":"2024-05-10T09:54:51.357729+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:54:51.357729+0000","last_undegraded":"2024-05-10T09:54:51.357729+0000","last_fullsized":"2024-05-10T09:54:51.357729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754310+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:54:50.754310+0000","last_peered":"2024-05-10T09:54:50.754310+0000","last_clean":"2024-05-10T09:54:50.754310+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:54:50.754310+0000","last_undegraded":"2024-05-10T09:54:50.754310+0000","last_fullsized":"2024-05-10T09:54:50.754310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753689+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:54:50.753689+0000","last_peered":"2024-05-10T09:54:50.753689+0000","last_clean":"2024-05-10T09:54:50.753689+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:54:50.753689+0000","last_undegraded":"2024-05-10T09:54:50.753689+0000","last_fullsized":"2024-05-10T09:54:50.753689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720639+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:54:50.720639+0000","last_peered":"2024-05-10T09:54:50.720639+0000","last_clean":"2024-05-10T09:54:50.720639+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:54:50.720639+0000","last_undegraded":"2024-05-10T09:54:50.720639+0000","last_fullsized":"2024-05-10T09:54:50.720639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756512+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:54:50.756512+0000","last_peered":"2024-05-10T09:54:50.756512+0000","last_clean":"2024-05-10T09:54:50.756512+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:54:50.756512+0000","last_undegraded":"2024-05-10T09:54:50.756512+0000","last_fullsized":"2024-05-10T09:54:50.756512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.700835+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:54:51.700835+0000","last_peered":"2024-05-10T09:54:51.700835+0000","last_clean":"2024-05-10T09:54:51.700835+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:54:51.700835+0000","last_undegraded":"2024-05-10T09:54:51.700835+0000","last_fullsized":"2024-05-10T09:54:51.700835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747249+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:54:50.747249+0000","last_peered":"2024-05-10T09:54:50.747249+0000","last_clean":"2024-05-10T09:54:50.747249+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:54:50.747249+0000","last_undegraded":"2024-05-10T09:54:50.747249+0000","last_fullsized":"2024-05-10T09:54:50.747249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719677+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:54:50.719677+0000","last_peered":"2024-05-10T09:54:50.719677+0000","last_clean":"2024-05-10T09:54:50.719677+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:54:50.719677+0000","last_undegraded":"2024-05-10T09:54:50.719677+0000","last_fullsized":"2024-05-10T09:54:50.719677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757407+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:54:50.757407+0000","last_peered":"2024-05-10T09:54:50.757407+0000","last_clean":"2024-05-10T09:54:50.757407+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:54:50.757407+0000","last_undegraded":"2024-05-10T09:54:50.757407+0000","last_fullsized":"2024-05-10T09:54:50.757407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739821+0000","last_change":"2024-05-10T09:54:39.633485+0000","last_active":"2024-05-10T09:54:50.739821+0000","last_peered":"2024-05-10T09:54:50.739821+0000","last_clean":"2024-05-10T09:54:50.739821+0000","last_became_active":"2024-05-10T09:54:39.632122+0000","last_became_peered":"2024-05-10T09:54:39.632122+0000","last_unstale":"2024-05-10T09:54:50.739821+0000","last_undegraded":"2024-05-10T09:54:50.739821+0000","last_fullsized":"2024-05-10T09:54:50.739821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:29.992178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753490+0000","last_change":"2024-05-10T09:54:43.674945+0000","last_active":"2024-05-10T09:54:50.753490+0000","last_peered":"2024-05-10T09:54:50.753490+0000","last_clean":"2024-05-10T09:54:50.753490+0000","last_became_active":"2024-05-10T09:54:43.673932+0000","last_became_peered":"2024-05-10T09:54:43.673932+0000","last_unstale":"2024-05-10T09:54:50.753490+0000","last_undegraded":"2024-05-10T09:54:50.753490+0000","last_fullsized":"2024-05-10T09:54:50.753490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:00.830106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.482577+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:54:51.482577+0000","last_peered":"2024-05-10T09:54:51.482577+0000","last_clean":"2024-05-10T09:54:51.482577+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:54:51.482577+0000","last_undegraded":"2024-05-10T09:54:51.482577+0000","last_fullsized":"2024-05-10T09:54:51.482577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740103+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:54:50.740103+0000","last_peered":"2024-05-10T09:54:50.740103+0000","last_clean":"2024-05-10T09:54:50.740103+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:54:50.740103+0000","last_undegraded":"2024-05-10T09:54:50.740103+0000","last_fullsized":"2024-05-10T09:54:50.740103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751619+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:54:50.751619+0000","last_peered":"2024-05-10T09:54:50.751619+0000","last_clean":"2024-05-10T09:54:50.751619+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:54:50.751619+0000","last_undegraded":"2024-05-10T09:54:50.751619+0000","last_fullsized":"2024-05-10T09:54:50.751619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.722697+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:54:50.722697+0000","last_peered":"2024-05-10T09:54:50.722697+0000","last_clean":"2024-05-10T09:54:50.722697+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:54:50.722697+0000","last_undegraded":"2024-05-10T09:54:50.722697+0000","last_fullsized":"2024-05-10T09:54:50.722697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764581+0000","last_change":"2024-05-10T09:54:39.632152+0000","last_active":"2024-05-10T09:54:50.764581+0000","last_peered":"2024-05-10T09:54:50.764581+0000","last_clean":"2024-05-10T09:54:50.764581+0000","last_became_active":"2024-05-10T09:54:39.630880+0000","last_became_peered":"2024-05-10T09:54:39.630880+0000","last_unstale":"2024-05-10T09:54:50.764581+0000","last_undegraded":"2024-05-10T09:54:50.764581+0000","last_fullsized":"2024-05-10T09:54:50.764581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.311278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765474+0000","last_change":"2024-05-10T09:54:43.671543+0000","last_active":"2024-05-10T09:54:50.765474+0000","last_peered":"2024-05-10T09:54:50.765474+0000","last_clean":"2024-05-10T09:54:50.765474+0000","last_became_active":"2024-05-10T09:54:43.670617+0000","last_became_peered":"2024-05-10T09:54:43.670617+0000","last_unstale":"2024-05-10T09:54:50.765474+0000","last_undegraded":"2024-05-10T09:54:50.765474+0000","last_fullsized":"2024-05-10T09:54:50.765474+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:57.236607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.680471+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:54:51.680471+0000","last_peered":"2024-05-10T09:54:51.680471+0000","last_clean":"2024-05-10T09:54:51.680471+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:54:51.680471+0000","last_undegraded":"2024-05-10T09:54:51.680471+0000","last_fullsized":"2024-05-10T09:54:51.680471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739322+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:54:50.739322+0000","last_peered":"2024-05-10T09:54:50.739322+0000","last_clean":"2024-05-10T09:54:50.739322+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:54:50.739322+0000","last_undegraded":"2024-05-10T09:54:50.739322+0000","last_fullsized":"2024-05-10T09:54:50.739322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.745700+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:54:50.745700+0000","last_peered":"2024-05-10T09:54:50.745700+0000","last_clean":"2024-05-10T09:54:50.745700+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:54:50.745700+0000","last_undegraded":"2024-05-10T09:54:50.745700+0000","last_fullsized":"2024-05-10T09:54:50.745700+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720233+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:54:50.720233+0000","last_peered":"2024-05-10T09:54:50.720233+0000","last_clean":"2024-05-10T09:54:50.720233+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:54:50.720233+0000","last_undegraded":"2024-05-10T09:54:50.720233+0000","last_fullsized":"2024-05-10T09:54:50.720233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754615+0000","last_change":"2024-05-10T09:54:39.639964+0000","last_active":"2024-05-10T09:54:50.754615+0000","last_peered":"2024-05-10T09:54:50.754615+0000","last_clean":"2024-05-10T09:54:50.754615+0000","last_became_active":"2024-05-10T09:54:39.639586+0000","last_became_peered":"2024-05-10T09:54:39.639586+0000","last_unstale":"2024-05-10T09:54:50.754615+0000","last_undegraded":"2024-05-10T09:54:50.754615+0000","last_fullsized":"2024-05-10T09:54:50.754615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740416+0000","last_change":"2024-05-10T09:54:43.673579+0000","last_active":"2024-05-10T09:54:50.740416+0000","last_peered":"2024-05-10T09:54:50.740416+0000","last_clean":"2024-05-10T09:54:50.740416+0000","last_became_active":"2024-05-10T09:54:43.671699+0000","last_became_peered":"2024-05-10T09:54:43.671699+0000","last_unstale":"2024-05-10T09:54:50.740416+0000","last_undegraded":"2024-05-10T09:54:50.740416+0000","last_fullsized":"2024-05-10T09:54:50.740416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.679507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.660355+0000","last_change":"2024-05-10T09:54:46.137228+0000","last_active":"2024-05-10T09:54:51.660355+0000","last_peered":"2024-05-10T09:54:51.660355+0000","last_clean":"2024-05-10T09:54:51.660355+0000","last_became_active":"2024-05-10T09:54:46.136461+0000","last_became_peered":"2024-05-10T09:54:46.136461+0000","last_unstale":"2024-05-10T09:54:51.660355+0000","last_undegraded":"2024-05-10T09:54:51.660355+0000","last_fullsized":"2024-05-10T09:54:51.660355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753320+0000","last_change":"2024-05-10T09:54:47.703168+0000","last_active":"2024-05-10T09:54:50.753320+0000","last_peered":"2024-05-10T09:54:50.753320+0000","last_clean":"2024-05-10T09:54:50.753320+0000","last_became_active":"2024-05-10T09:54:47.702370+0000","last_became_peered":"2024-05-10T09:54:47.702370+0000","last_unstale":"2024-05-10T09:54:50.753320+0000","last_undegraded":"2024-05-10T09:54:50.753320+0000","last_fullsized":"2024-05-10T09:54:50.753320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:23.880405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718606+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:54:50.718606+0000","last_peered":"2024-05-10T09:54:50.718606+0000","last_clean":"2024-05-10T09:54:50.718606+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:54:50.718606+0000","last_undegraded":"2024-05-10T09:54:50.718606+0000","last_fullsized":"2024-05-10T09:54:50.718606+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763758+0000","last_change":"2024-05-10T09:54:41.660113+0000","last_active":"2024-05-10T09:54:50.763758+0000","last_peered":"2024-05-10T09:54:50.763758+0000","last_clean":"2024-05-10T09:54:50.763758+0000","last_became_active":"2024-05-10T09:54:41.659372+0000","last_became_peered":"2024-05-10T09:54:41.659372+0000","last_unstale":"2024-05-10T09:54:50.763758+0000","last_undegraded":"2024-05-10T09:54:50.763758+0000","last_fullsized":"2024-05-10T09:54:50.763758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747811+0000","last_change":"2024-05-10T09:54:39.665209+0000","last_active":"2024-05-10T09:54:50.747811+0000","last_peered":"2024-05-10T09:54:50.747811+0000","last_clean":"2024-05-10T09:54:50.747811+0000","last_became_active":"2024-05-10T09:54:39.664624+0000","last_became_peered":"2024-05-10T09:54:39.664624+0000","last_unstale":"2024-05-10T09:54:50.747811+0000","last_undegraded":"2024-05-10T09:54:50.747811+0000","last_fullsized":"2024-05-10T09:54:50.747811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:14.288277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719056+0000","last_change":"2024-05-10T09:54:43.676730+0000","last_active":"2024-05-10T09:54:50.719056+0000","last_peered":"2024-05-10T09:54:50.719056+0000","last_clean":"2024-05-10T09:54:50.719056+0000","last_became_active":"2024-05-10T09:54:43.676001+0000","last_became_peered":"2024-05-10T09:54:43.676001+0000","last_unstale":"2024-05-10T09:54:50.719056+0000","last_undegraded":"2024-05-10T09:54:50.719056+0000","last_fullsized":"2024-05-10T09:54:50.719056+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:53.463036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.694505+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:54:51.694505+0000","last_peered":"2024-05-10T09:54:51.694505+0000","last_clean":"2024-05-10T09:54:51.694505+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:54:51.694505+0000","last_undegraded":"2024-05-10T09:54:51.694505+0000","last_fullsized":"2024-05-10T09:54:51.694505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753491+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:54:50.753491+0000","last_peered":"2024-05-10T09:54:50.753491+0000","last_clean":"2024-05-10T09:54:50.753491+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:54:50.753491+0000","last_undegraded":"2024-05-10T09:54:50.753491+0000","last_fullsized":"2024-05-10T09:54:50.753491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721196+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:54:50.721196+0000","last_peered":"2024-05-10T09:54:50.721196+0000","last_clean":"2024-05-10T09:54:50.721196+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:54:50.721196+0000","last_undegraded":"2024-05-10T09:54:50.721196+0000","last_fullsized":"2024-05-10T09:54:50.721196+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764251+0000","last_change":"2024-05-10T09:54:41.661977+0000","last_active":"2024-05-10T09:54:50.764251+0000","last_peered":"2024-05-10T09:54:50.764251+0000","last_clean":"2024-05-10T09:54:50.764251+0000","last_became_active":"2024-05-10T09:54:41.661196+0000","last_became_peered":"2024-05-10T09:54:41.661196+0000","last_unstale":"2024-05-10T09:54:50.764251+0000","last_undegraded":"2024-05-10T09:54:50.764251+0000","last_fullsized":"2024-05-10T09:54:50.764251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748196+0000","last_change":"2024-05-10T09:54:39.660289+0000","last_active":"2024-05-10T09:54:50.748196+0000","last_peered":"2024-05-10T09:54:50.748196+0000","last_clean":"2024-05-10T09:54:50.748196+0000","last_became_active":"2024-05-10T09:54:39.659678+0000","last_became_peered":"2024-05-10T09:54:39.659678+0000","last_unstale":"2024-05-10T09:54:50.748196+0000","last_undegraded":"2024-05-10T09:54:50.748196+0000","last_fullsized":"2024-05-10T09:54:50.748196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746067+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:54:50.746067+0000","last_peered":"2024-05-10T09:54:50.746067+0000","last_clean":"2024-05-10T09:54:50.746067+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:54:50.746067+0000","last_undegraded":"2024-05-10T09:54:50.746067+0000","last_fullsized":"2024-05-10T09:54:50.746067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.062138+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:54:51.062138+0000","last_peered":"2024-05-10T09:54:51.062138+0000","last_clean":"2024-05-10T09:54:51.062138+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:54:51.062138+0000","last_undegraded":"2024-05-10T09:54:51.062138+0000","last_fullsized":"2024-05-10T09:54:51.062138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751323+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:54:50.751323+0000","last_peered":"2024-05-10T09:54:50.751323+0000","last_clean":"2024-05-10T09:54:50.751323+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:54:50.751323+0000","last_undegraded":"2024-05-10T09:54:50.751323+0000","last_fullsized":"2024-05-10T09:54:50.751323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723052+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:54:50.723052+0000","last_peered":"2024-05-10T09:54:50.723052+0000","last_clean":"2024-05-10T09:54:50.723052+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:54:50.723052+0000","last_undegraded":"2024-05-10T09:54:50.723052+0000","last_fullsized":"2024-05-10T09:54:50.723052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721310+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:54:50.721310+0000","last_peered":"2024-05-10T09:54:50.721310+0000","last_clean":"2024-05-10T09:54:50.721310+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:54:50.721310+0000","last_undegraded":"2024-05-10T09:54:50.721310+0000","last_fullsized":"2024-05-10T09:54:50.721310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723751+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:54:50.723751+0000","last_peered":"2024-05-10T09:54:50.723751+0000","last_clean":"2024-05-10T09:54:50.723751+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:54:50.723751+0000","last_undegraded":"2024-05-10T09:54:50.723751+0000","last_fullsized":"2024-05-10T09:54:50.723751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.762966+0000","last_change":"2024-05-10T09:54:43.671816+0000","last_active":"2024-05-10T09:54:50.762966+0000","last_peered":"2024-05-10T09:54:50.762966+0000","last_clean":"2024-05-10T09:54:50.762966+0000","last_became_active":"2024-05-10T09:54:43.670943+0000","last_became_peered":"2024-05-10T09:54:43.670943+0000","last_unstale":"2024-05-10T09:54:50.762966+0000","last_undegraded":"2024-05-10T09:54:50.762966+0000","last_fullsized":"2024-05-10T09:54:50.762966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.306302+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:54:51.306302+0000","last_peered":"2024-05-10T09:54:51.306302+0000","last_clean":"2024-05-10T09:54:51.306302+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:54:51.306302+0000","last_undegraded":"2024-05-10T09:54:51.306302+0000","last_fullsized":"2024-05-10T09:54:51.306302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763401+0000","last_change":"2024-05-10T09:54:47.699451+0000","last_active":"2024-05-10T09:54:50.763401+0000","last_peered":"2024-05-10T09:54:50.763401+0000","last_clean":"2024-05-10T09:54:50.763401+0000","last_became_active":"2024-05-10T09:54:47.698655+0000","last_became_peered":"2024-05-10T09:54:47.698655+0000","last_unstale":"2024-05-10T09:54:50.763401+0000","last_undegraded":"2024-05-10T09:54:50.763401+0000","last_fullsized":"2024-05-10T09:54:50.763401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.720742+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:54:50.720742+0000","last_peered":"2024-05-10T09:54:50.720742+0000","last_clean":"2024-05-10T09:54:50.720742+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:54:50.720742+0000","last_undegraded":"2024-05-10T09:54:50.720742+0000","last_fullsized":"2024-05-10T09:54:50.720742+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.763464+0000","last_change":"2024-05-10T09:54:41.684964+0000","last_active":"2024-05-10T09:54:50.763464+0000","last_peered":"2024-05-10T09:54:50.763464+0000","last_clean":"2024-05-10T09:54:50.763464+0000","last_became_active":"2024-05-10T09:54:41.684444+0000","last_became_peered":"2024-05-10T09:54:41.684444+0000","last_unstale":"2024-05-10T09:54:50.763464+0000","last_undegraded":"2024-05-10T09:54:50.763464+0000","last_fullsized":"2024-05-10T09:54:50.763464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.757419+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:54:50.757419+0000","last_peered":"2024-05-10T09:54:50.757419+0000","last_clean":"2024-05-10T09:54:50.757419+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:54:50.757419+0000","last_undegraded":"2024-05-10T09:54:50.757419+0000","last_fullsized":"2024-05-10T09:54:50.757419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.738452+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:54:50.738452+0000","last_peered":"2024-05-10T09:54:50.738452+0000","last_clean":"2024-05-10T09:54:50.738452+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:54:50.738452+0000","last_undegraded":"2024-05-10T09:54:50.738452+0000","last_fullsized":"2024-05-10T09:54:50.738452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:51.379206+0000","last_change":"2024-05-10T09:54:45.674702+0000","last_active":"2024-05-10T09:54:51.379206+0000","last_peered":"2024-05-10T09:54:51.379206+0000","last_clean":"2024-05-10T09:54:51.379206+0000","last_became_active":"2024-05-10T09:54:45.674013+0000","last_became_peered":"2024-05-10T09:54:45.674013+0000","last_unstale":"2024-05-10T09:54:51.379206+0000","last_undegraded":"2024-05-10T09:54:51.379206+0000","last_fullsized":"2024-05-10T09:54:51.379206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:07.295363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754225+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:54:50.754225+0000","last_peered":"2024-05-10T09:54:50.754225+0000","last_clean":"2024-05-10T09:54:50.754225+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:54:50.754225+0000","last_undegraded":"2024-05-10T09:54:50.754225+0000","last_fullsized":"2024-05-10T09:54:50.754225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765523+0000","last_change":"2024-05-10T09:54:49.704641+0000","last_active":"2024-05-10T09:54:50.765523+0000","last_peered":"2024-05-10T09:54:50.765523+0000","last_clean":"2024-05-10T09:54:50.765523+0000","last_became_active":"2024-05-10T09:54:49.703849+0000","last_became_peered":"2024-05-10T09:54:49.703849+0000","last_unstale":"2024-05-10T09:54:50.765523+0000","last_undegraded":"2024-05-10T09:54:50.765523+0000","last_fullsized":"2024-05-10T09:54:50.765523+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.741079+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:54:50.741079+0000","last_peered":"2024-05-10T09:54:50.741079+0000","last_clean":"2024-05-10T09:54:50.741079+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:54:50.741079+0000","last_undegraded":"2024-05-10T09:54:50.741079+0000","last_fullsized":"2024-05-10T09:54:50.741079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751224+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:54:50.751224+0000","last_peered":"2024-05-10T09:54:50.751224+0000","last_clean":"2024-05-10T09:54:50.751224+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:54:50.751224+0000","last_undegraded":"2024-05-10T09:54:50.751224+0000","last_fullsized":"2024-05-10T09:54:50.751224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740651+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:54:50.740651+0000","last_peered":"2024-05-10T09:54:50.740651+0000","last_clean":"2024-05-10T09:54:50.740651+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:54:50.740651+0000","last_undegraded":"2024-05-10T09:54:50.740651+0000","last_fullsized":"2024-05-10T09:54:50.740651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718165+0000","last_change":"2024-05-10T09:54:39.661049+0000","last_active":"2024-05-10T09:54:50.718165+0000","last_peered":"2024-05-10T09:54:50.718165+0000","last_clean":"2024-05-10T09:54:50.718165+0000","last_became_active":"2024-05-10T09:54:39.660756+0000","last_became_peered":"2024-05-10T09:54:39.660756+0000","last_unstale":"2024-05-10T09:54:50.718165+0000","last_undegraded":"2024-05-10T09:54:50.718165+0000","last_fullsized":"2024-05-10T09:54:50.718165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:38.799039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747786+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:54:50.747786+0000","last_peered":"2024-05-10T09:54:50.747786+0000","last_clean":"2024-05-10T09:54:50.747786+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:54:50.747786+0000","last_undegraded":"2024-05-10T09:54:50.747786+0000","last_fullsized":"2024-05-10T09:54:50.747786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746930+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:54:50.746930+0000","last_peered":"2024-05-10T09:54:50.746930+0000","last_clean":"2024-05-10T09:54:50.746930+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:54:50.746930+0000","last_undegraded":"2024-05-10T09:54:50.746930+0000","last_fullsized":"2024-05-10T09:54:50.746930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739862+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:54:50.739862+0000","last_peered":"2024-05-10T09:54:50.739862+0000","last_clean":"2024-05-10T09:54:50.739862+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:54:50.739862+0000","last_undegraded":"2024-05-10T09:54:50.739862+0000","last_fullsized":"2024-05-10T09:54:50.739862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754960+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:54:50.754960+0000","last_peered":"2024-05-10T09:54:50.754960+0000","last_clean":"2024-05-10T09:54:50.754960+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:54:50.754960+0000","last_undegraded":"2024-05-10T09:54:50.754960+0000","last_fullsized":"2024-05-10T09:54:50.754960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721256+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:54:50.721256+0000","last_peered":"2024-05-10T09:54:50.721256+0000","last_clean":"2024-05-10T09:54:50.721256+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:54:50.721256+0000","last_undegraded":"2024-05-10T09:54:50.721256+0000","last_fullsized":"2024-05-10T09:54:50.721256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.724420+0000","last_change":"2024-05-10T09:54:39.617575+0000","last_active":"2024-05-10T09:54:50.724420+0000","last_peered":"2024-05-10T09:54:50.724420+0000","last_clean":"2024-05-10T09:54:50.724420+0000","last_became_active":"2024-05-10T09:54:39.617225+0000","last_became_peered":"2024-05-10T09:54:39.617225+0000","last_unstale":"2024-05-10T09:54:50.724420+0000","last_undegraded":"2024-05-10T09:54:50.724420+0000","last_fullsized":"2024-05-10T09:54:50.724420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764571+0000","last_change":"2024-05-10T09:54:41.685433+0000","last_active":"2024-05-10T09:54:50.764571+0000","last_peered":"2024-05-10T09:54:50.764571+0000","last_clean":"2024-05-10T09:54:50.764571+0000","last_became_active":"2024-05-10T09:54:41.684722+0000","last_became_peered":"2024-05-10T09:54:41.684722+0000","last_unstale":"2024-05-10T09:54:50.764571+0000","last_undegraded":"2024-05-10T09:54:50.764571+0000","last_fullsized":"2024-05-10T09:54:50.764571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.740832+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:54:50.740832+0000","last_peered":"2024-05-10T09:54:50.740832+0000","last_clean":"2024-05-10T09:54:50.740832+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:54:50.740832+0000","last_undegraded":"2024-05-10T09:54:50.740832+0000","last_fullsized":"2024-05-10T09:54:50.740832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719377+0000","last_change":"2024-05-10T09:54:41.678687+0000","last_active":"2024-05-10T09:54:50.719377+0000","last_peered":"2024-05-10T09:54:50.719377+0000","last_clean":"2024-05-10T09:54:50.719377+0000","last_became_active":"2024-05-10T09:54:41.677440+0000","last_became_peered":"2024-05-10T09:54:41.677440+0000","last_unstale":"2024-05-10T09:54:50.719377+0000","last_undegraded":"2024-05-10T09:54:50.719377+0000","last_fullsized":"2024-05-10T09:54:50.719377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.753366+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:54:50.753366+0000","last_peered":"2024-05-10T09:54:50.753366+0000","last_clean":"2024-05-10T09:54:50.753366+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:54:50.753366+0000","last_undegraded":"2024-05-10T09:54:50.753366+0000","last_fullsized":"2024-05-10T09:54:50.753366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.751131+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:54:50.751131+0000","last_peered":"2024-05-10T09:54:50.751131+0000","last_clean":"2024-05-10T09:54:50.751131+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:54:50.751131+0000","last_undegraded":"2024-05-10T09:54:50.751131+0000","last_fullsized":"2024-05-10T09:54:50.751131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.723560+0000","last_change":"2024-05-10T09:54:39.637008+0000","last_active":"2024-05-10T09:54:50.723560+0000","last_peered":"2024-05-10T09:54:50.723560+0000","last_clean":"2024-05-10T09:54:50.723560+0000","last_became_active":"2024-05-10T09:54:39.636614+0000","last_became_peered":"2024-05-10T09:54:39.636614+0000","last_unstale":"2024-05-10T09:54:50.723560+0000","last_undegraded":"2024-05-10T09:54:50.723560+0000","last_fullsized":"2024-05-10T09:54:50.723560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756619+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:54:50.756619+0000","last_peered":"2024-05-10T09:54:50.756619+0000","last_clean":"2024-05-10T09:54:50.756619+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:54:50.756619+0000","last_undegraded":"2024-05-10T09:54:50.756619+0000","last_fullsized":"2024-05-10T09:54:50.756619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746227+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:54:50.746227+0000","last_peered":"2024-05-10T09:54:50.746227+0000","last_clean":"2024-05-10T09:54:50.746227+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:54:50.746227+0000","last_undegraded":"2024-05-10T09:54:50.746227+0000","last_fullsized":"2024-05-10T09:54:50.746227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.765569+0000","last_change":"2024-05-10T09:54:41.643172+0000","last_active":"2024-05-10T09:54:50.765569+0000","last_peered":"2024-05-10T09:54:50.765569+0000","last_clean":"2024-05-10T09:54:50.765569+0000","last_became_active":"2024-05-10T09:54:41.642434+0000","last_became_peered":"2024-05-10T09:54:41.642434+0000","last_unstale":"2024-05-10T09:54:50.765569+0000","last_undegraded":"2024-05-10T09:54:50.765569+0000","last_fullsized":"2024-05-10T09:54:50.765569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721539+0000","last_change":"2024-05-10T09:54:39.617844+0000","last_active":"2024-05-10T09:54:50.721539+0000","last_peered":"2024-05-10T09:54:50.721539+0000","last_clean":"2024-05-10T09:54:50.721539+0000","last_became_active":"2024-05-10T09:54:39.617265+0000","last_became_peered":"2024-05-10T09:54:39.617265+0000","last_unstale":"2024-05-10T09:54:50.721539+0000","last_undegraded":"2024-05-10T09:54:50.721539+0000","last_fullsized":"2024-05-10T09:54:50.721539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721156+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:54:50.721156+0000","last_peered":"2024-05-10T09:54:50.721156+0000","last_clean":"2024-05-10T09:54:50.721156+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:54:50.721156+0000","last_undegraded":"2024-05-10T09:54:50.721156+0000","last_fullsized":"2024-05-10T09:54:50.721156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746737+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:54:50.746737+0000","last_peered":"2024-05-10T09:54:50.746737+0000","last_clean":"2024-05-10T09:54:50.746737+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:54:50.746737+0000","last_undegraded":"2024-05-10T09:54:50.746737+0000","last_fullsized":"2024-05-10T09:54:50.746737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.764962+0000","last_change":"2024-05-10T09:54:41.677847+0000","last_active":"2024-05-10T09:54:50.764962+0000","last_peered":"2024-05-10T09:54:50.764962+0000","last_clean":"2024-05-10T09:54:50.764962+0000","last_became_active":"2024-05-10T09:54:41.675368+0000","last_became_peered":"2024-05-10T09:54:41.675368+0000","last_unstale":"2024-05-10T09:54:50.764962+0000","last_undegraded":"2024-05-10T09:54:50.764962+0000","last_fullsized":"2024-05-10T09:54:50.764962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.755258+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:54:50.755258+0000","last_peered":"2024-05-10T09:54:50.755258+0000","last_clean":"2024-05-10T09:54:50.755258+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:54:50.755258+0000","last_undegraded":"2024-05-10T09:54:50.755258+0000","last_fullsized":"2024-05-10T09:54:50.755258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719849+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:54:50.719849+0000","last_peered":"2024-05-10T09:54:50.719849+0000","last_clean":"2024-05-10T09:54:50.719849+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:54:50.719849+0000","last_undegraded":"2024-05-10T09:54:50.719849+0000","last_fullsized":"2024-05-10T09:54:50.719849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.752862+0000","last_change":"2024-05-10T09:54:39.646096+0000","last_active":"2024-05-10T09:54:50.752862+0000","last_peered":"2024-05-10T09:54:50.752862+0000","last_clean":"2024-05-10T09:54:50.752862+0000","last_became_active":"2024-05-10T09:54:39.645148+0000","last_became_peered":"2024-05-10T09:54:39.645148+0000","last_unstale":"2024-05-10T09:54:50.752862+0000","last_undegraded":"2024-05-10T09:54:50.752862+0000","last_fullsized":"2024-05-10T09:54:50.752862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.754379+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:54:50.754379+0000","last_peered":"2024-05-10T09:54:50.754379+0000","last_clean":"2024-05-10T09:54:50.754379+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:54:50.754379+0000","last_undegraded":"2024-05-10T09:54:50.754379+0000","last_fullsized":"2024-05-10T09:54:50.754379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.721340+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:54:50.721340+0000","last_peered":"2024-05-10T09:54:50.721340+0000","last_clean":"2024-05-10T09:54:50.721340+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:54:50.721340+0000","last_undegraded":"2024-05-10T09:54:50.721340+0000","last_fullsized":"2024-05-10T09:54:50.721340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.719574+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:54:50.719574+0000","last_peered":"2024-05-10T09:54:50.719574+0000","last_clean":"2024-05-10T09:54:50.719574+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:54:50.719574+0000","last_undegraded":"2024-05-10T09:54:50.719574+0000","last_fullsized":"2024-05-10T09:54:50.719574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.724644+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:54:50.724644+0000","last_peered":"2024-05-10T09:54:50.724644+0000","last_clean":"2024-05-10T09:54:50.724644+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:54:50.724644+0000","last_undegraded":"2024-05-10T09:54:50.724644+0000","last_fullsized":"2024-05-10T09:54:50.724644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.718888+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:54:50.718888+0000","last_peered":"2024-05-10T09:54:50.718888+0000","last_clean":"2024-05-10T09:54:50.718888+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:54:50.718888+0000","last_undegraded":"2024-05-10T09:54:50.718888+0000","last_fullsized":"2024-05-10T09:54:50.718888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.748785+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:54:50.748785+0000","last_peered":"2024-05-10T09:54:50.748785+0000","last_clean":"2024-05-10T09:54:50.748785+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:54:50.748785+0000","last_undegraded":"2024-05-10T09:54:50.748785+0000","last_fullsized":"2024-05-10T09:54:50.748785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.746013+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:54:50.746013+0000","last_peered":"2024-05-10T09:54:50.746013+0000","last_clean":"2024-05-10T09:54:50.746013+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:54:50.746013+0000","last_undegraded":"2024-05-10T09:54:50.746013+0000","last_fullsized":"2024-05-10T09:54:50.746013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.756318+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:54:50.756318+0000","last_peered":"2024-05-10T09:54:50.756318+0000","last_clean":"2024-05-10T09:54:50.756318+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:54:50.756318+0000","last_undegraded":"2024-05-10T09:54:50.756318+0000","last_fullsized":"2024-05-10T09:54:50.756318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.739316+0000","last_change":"2024-05-10T09:54:39.644558+0000","last_active":"2024-05-10T09:54:50.739316+0000","last_peered":"2024-05-10T09:54:50.739316+0000","last_clean":"2024-05-10T09:54:50.739316+0000","last_became_active":"2024-05-10T09:54:39.644263+0000","last_became_peered":"2024-05-10T09:54:39.644263+0000","last_unstale":"2024-05-10T09:54:50.739316+0000","last_undegraded":"2024-05-10T09:54:50.739316+0000","last_fullsized":"2024-05-10T09:54:50.739316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:25.147666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-10T09:54:50.747428+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:54:50.747428+0000","last_peered":"2024-05-10T09:54:50.747428+0000","last_clean":"2024-05-10T09:54:50.747428+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:54:50.747428+0000","last_undegraded":"2024-05-10T09:54:50.747428+0000","last_fullsized":"2024-05-10T09:54:50.747428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1028096,"data_stored":759625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":170026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":169425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":425984,"data_stored":168993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35728,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336112,"statfs":{"total":96636764160,"available":96600178688,"internally_reserved":0,"allocated":397312,"data_stored":168159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1011712,"data_stored":759467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":425984,"data_stored":168847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:54:58.063 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T09:54:58.064 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-05-10T09:54:58.403 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 35 2024-05-10T09:54:58.403 INFO:teuthology.orchestra.run.smithi042.stdout:fsid 7e1d9b5a-9708-485a-8c63-703e41c4a829 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-05-10T09:54:13.508887+0000 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:modified 2024-05-10T09:54:50.705647+0000 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:crush_version 5 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:full_ratio 0.95 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:backfillfull_ratio 0.9 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:nearfull_ratio 0.85 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:require_min_compat_client luminous 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:min_compat_client jewel 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:require_osd_release squid 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:stretch_mode_enabled false 2024-05-10T09:54:58.404 INFO:teuthology.orchestra.run.smithi042.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 29 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 31 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 33 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 35 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:max_osd 8 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6800/3913515164,v1:172.21.15.42:6801/3913515164] [v2:172.21.15.42:6802/3913515164,v1:172.21.15.42:6803/3913515164] exists,up 897c58ab-70e9-4a8d-b51f-cf9dc6cedd29 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6809/2743871003,v1:172.21.15.42:6811/2743871003] [v2:172.21.15.42:6813/2743871003,v1:172.21.15.42:6815/2743871003] exists,up fc75a63e-e69c-4efb-89cb-b599f6ded234 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6808/3683869396,v1:172.21.15.42:6810/3683869396] [v2:172.21.15.42:6812/3683869396,v1:172.21.15.42:6814/3683869396] exists,up 18889f8e-3a4e-4ea7-b9b6-af9547e84e85 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6824/125865404,v1:172.21.15.42:6825/125865404] [v2:172.21.15.42:6826/125865404,v1:172.21.15.42:6827/125865404] exists,up a2720077-7595-48e4-9f86-60cd449b0d90 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6823/74015139,v1:172.21.15.181:6825/74015139] [v2:172.21.15.181:6826/74015139,v1:172.21.15.181:6827/74015139] exists,up c271ae7d-8d4d-46a6-9273-8a52de33dd30 2024-05-10T09:54:58.405 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6809/893112190,v1:172.21.15.181:6812/893112190] [v2:172.21.15.181:6814/893112190,v1:172.21.15.181:6816/893112190] exists,up 8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b 2024-05-10T09:54:58.406 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/1622048387,v1:172.21.15.181:6802/1622048387] [v2:172.21.15.181:6804/1622048387,v1:172.21.15.181:6807/1622048387] exists,up 6fa08610-ff9d-41d0-af8a-06d46f3388d7 2024-05-10T09:54:58.406 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6801/3508953868,v1:172.21.15.181:6803/3508953868] [v2:172.21.15.181:6805/3508953868,v1:172.21.15.181:6806/3508953868] exists,up 86869483-0d84-4d13-b78e-3bac8ac2ff03 2024-05-10T09:54:58.421 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6800/3913515164,v1:172.21.15.42:6801/3913515164] [v2:172.21.15.42:6802/3913515164,v1:172.21.15.42:6803/3913515164] exists,up 897c58ab-70e9-4a8d-b51f-cf9dc6cedd29', 'osd.1 up in weight 1 up_from 14 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6809/2743871003,v1:172.21.15.42:6811/2743871003] [v2:172.21.15.42:6813/2743871003,v1:172.21.15.42:6815/2743871003] exists,up fc75a63e-e69c-4efb-89cb-b599f6ded234', 'osd.2 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6808/3683869396,v1:172.21.15.42:6810/3683869396] [v2:172.21.15.42:6812/3683869396,v1:172.21.15.42:6814/3683869396] exists,up 18889f8e-3a4e-4ea7-b9b6-af9547e84e85', 'osd.3 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.42:6824/125865404,v1:172.21.15.42:6825/125865404] [v2:172.21.15.42:6826/125865404,v1:172.21.15.42:6827/125865404] exists,up a2720077-7595-48e4-9f86-60cd449b0d90', 'osd.4 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6823/74015139,v1:172.21.15.181:6825/74015139] [v2:172.21.15.181:6826/74015139,v1:172.21.15.181:6827/74015139] exists,up c271ae7d-8d4d-46a6-9273-8a52de33dd30', 'osd.5 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6809/893112190,v1:172.21.15.181:6812/893112190] [v2:172.21.15.181:6814/893112190,v1:172.21.15.181:6816/893112190] exists,up 8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b', 'osd.6 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6800/1622048387,v1:172.21.15.181:6802/1622048387] [v2:172.21.15.181:6804/1622048387,v1:172.21.15.181:6807/1622048387] exists,up 6fa08610-ff9d-41d0-af8a-06d46f3388d7', 'osd.7 up in weight 1 up_from 15 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.181:6801/3508953868,v1:172.21.15.181:6803/3508953868] [v2:172.21.15.181:6805/3508953868,v1:172.21.15.181:6806/3508953868] exists,up 86869483-0d84-4d13-b78e-3bac8ac2ff03'] 2024-05-10T09:54:58.422 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "name": "mon.a", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster": "ceph", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "admin_socket_mode": "", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_client_required": "cephx, none", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_cluster_required": "cephx", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_debug": "true", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-05-10T09:54:58.543 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_service_required": "cephx", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_service_ticket_ttl": "240.000000", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "auth_supported": "cephx", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_aio": "true", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_aio_max_queue_depth": "1024", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_aio_poll_ms": "250", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_aio_reap_max": "16", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_async_discard_threads": "0", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_block_size": "4096", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_debug_aio": "false", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_debug_inflight_ios": "false", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_enable_discard": "false", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_flock_retry": "3", 2024-05-10T09:54:58.544 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_flock_retry_interval": "0.100000", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_inject_crash": "0", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_inject_crash_flush_delay": "2", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_ioring": "false", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_ioring_hipri": "false", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_ioring_sqthread_poll": "false", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_read_buffer_alignment": "4096", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bdev_type": "", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_alloc_size": "1048576", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_allocator": "hybrid", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_buffered_io": "true", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_check_for_zeros": "false", 2024-05-10T09:54:58.545 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_check_volume_selector_often": "false", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_compact_log_sync": "false", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_log_compact_min_size": "16777216", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_log_replay_check_allocations": "true", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_max_log_runway": "4194304", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_max_prefetch": "1048576", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_min_flush_size": "524288", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_min_log_runway": "1048576", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_replay_recovery": "false", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_shared_alloc_size": "65536", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluefs_sync_write": "false", 2024-05-10T09:54:58.546 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_allocation_from_file": "true", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_allocator": "hybrid", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_blobid_prealloc": "10240", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_create": "true", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_db_create": "false", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_db_path": "", 2024-05-10T09:54:58.547 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_db_size": "0", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_path": "", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_preallocate_file": "false", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_size": "107374182400", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_wal_create": "false", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_wal_path": "", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_block_wal_size": "100663296", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_bluefs": "true", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_bluefs_env_mirror": "false", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-05-10T09:54:58.548 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_autotune": "true", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_size": "0", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cache_type": "2q", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-05-10T09:54:58.549 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_clone_cow": "true", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_algorithm": "snappy", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_max_blob_size": "0", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_min_blob_size": "0", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_mode": "none", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_csum_type": "crc32c", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_enforce_settings": "default", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_freelist": "false", 2024-05-10T09:54:58.550 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_fsck_abort": "false", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_inject_read_err": "false", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_legacy_omap": "false", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_prefill": "0.000000", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_small_allocations": "0", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-05-10T09:54:58.551 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_default_buffered_read": "true", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_default_buffered_write": "false", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_deferred_batch_ops": "0", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_elastic_shared_blobs": "true", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fail_eio": "false", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-05-10T09:54:58.552 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_on_mkfs": "true", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_on_mount": "false", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_on_umount": "false", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-05-10T09:54:58.553 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_ignore_data_csum": "false", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_kvbackend": "rocksdb", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_log_op_age": "5.000000", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_max_alloc_size": "0", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_max_blob_size": "0", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_max_defer_interval": "3.000000", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_max_deferred_txc": "32", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_min_alloc_size": "0", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-05-10T09:54:58.554 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_nid_prealloc": "1024", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_prefer_deferred_size": "0", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_qfsck_on_mount": "true", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_retry_disk_reads": "3", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_rocksdb_cf": "true", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_rocksdb_options_annex": "", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_spdk_coremask": "0x1", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_spdk_io_sleep": "5", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_spdk_max_io_completion": "0", 2024-05-10T09:54:58.555 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_spdk_mem": "512", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_sync_submit_transaction": "false", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_throttle_bytes": "67108864", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_throttle_cost_per_io": "0", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_tracing": "false", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_volume_selection_reserved": "0", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-05-10T09:54:58.556 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "bluestore_zero_block_detection": "false", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_action_update_interval": "2", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_mount_timeout": "10", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-05-10T09:54:58.557 INFO:teuthology.orchestra.run.smithi042.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephx_cluster_require_signatures": "false", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephx_cluster_require_version": "2", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephx_require_signatures": "false", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephx_require_version": "2", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephx_service_require_signatures": "false", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephx_service_require_version": "2", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "cephx_sign_messages": "true", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "chdir": "", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "client_acl_type": "", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "client_asio_thread_count": "2", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "client_cache_mid": "0.750000", 2024-05-10T09:54:58.558 INFO:teuthology.orchestra.run.smithi042.stdout: "client_cache_size": "16384", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_caps_release_delay": "5", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_check_pool_perm": "true", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_collect_and_send_global_metrics": "false", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_debug_force_sync_read": "false", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_debug_getattr_caps": "false", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_debug_inject_tick_delay": "0", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_die_on_failed_remount": "false", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_dirsize_rbytes": "true", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_force_lazyio": "false", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_fs": "", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_inject_fixed_oldest_tid": "false", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_inject_release_failure": "false", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_max_inline_size": "4096", 2024-05-10T09:54:58.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_max_retries_on_remount_failure": "5", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_mds_namespace": "", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_metadata": "", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_mount_gid": "-1", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_mount_timeout": "300", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_mount_uid": "-1", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_mountpoint": "/", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_notify_timeout": "10", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_oc": "true", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_oc_max_dirty": "104857600", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_oc_max_dirty_age": "5.000000", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_oc_max_objects": "1000", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_oc_size": "209715200", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_oc_target_dirty": "8388608", 2024-05-10T09:54:58.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_permissions": "true", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_quota": "true", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_quota_df": "true", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_readahead_max_bytes": "0", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_readahead_max_periods": "4", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_readahead_min": "131072", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_reconnect_stale": "false", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_shutdown_timeout": "30", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_snapdir": ".snap", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_tick_interval": "1", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_trace": "", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_try_dentry_invalidate": "false", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_use_faked_inos": "false", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "client_use_random_mds": "false", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "clog_to_graylog": "false", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-05-10T09:54:58.561 INFO:teuthology.orchestra.run.smithi042.stdout: "clog_to_graylog_port": "12201", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "clog_to_monitors": "default=true", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "clog_to_syslog": "false", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "clog_to_syslog_level": "info", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "-", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_network": "", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_network_interface": "", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "compressor_zlib_isal": "false", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "compressor_zlib_level": "5", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "compressor_zlib_winsize": "-15", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "compressor_zstd_level": "1", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-05-10T09:54:58.562 INFO:teuthology.orchestra.run.smithi042.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crimson_alien_op_num_threads": "6", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crimson_alien_thread_cpu_cores": "", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crimson_osd_obc_lru_size": "512", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crimson_osd_stat_interval": "0", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crimson_seastar_cpu_cores": "", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_location": "", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_location_hook": "", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_location_hook_timeout": "10", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "daemonize": "false", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "daos_pool": "tank", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-05-10T09:54:58.563 INFO:teuthology.orchestra.run.smithi042.stdout: "dbstore_db_name_prefix": "dbstore", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_alienstore": "0/5", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_allow_any_pool_priority": "false", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_asok": "1/5", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_asok_assert_abort": "false", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_asserts_on_shutdown": "true", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_auth": "20/20", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_bdev": "1/3", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_bluefs": "1/5", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_bluestore": "1/5", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_buffer": "0/1", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_ceph_dedup": "0/5", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_ceph_exporter": "1/5", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_cephfs_mirror": "0/5", 2024-05-10T09:54:58.564 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_cephsqlite": "0/5", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_client": "0/5", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_compressor": "1/5", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_context": "0/1", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_crimson_interrupt": "0/5", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_crush": "1/1", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_crypto": "1/5", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_cyanstore": "0/5", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_deliberately_leak_memory": "false", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_disable_randomized_ping": "false", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_dpdk": "1/5", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_eventtrace": "1/5", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_filer": "0/1", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_filestore": "1/3", 2024-05-10T09:54:58.565 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_finisher": "1/1", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_fuse": "1/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_heartbeat_testing_span": "0", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_heartbeatmap": "1/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_immutable_obj_cache": "0/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_javaclient": "1/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_journal": "1/3", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_journaler": "0/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_kstore": "1/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_lockdep": "0/1", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mclock": "1/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mds": "1/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mds_balancer": "1/5", 2024-05-10T09:54:58.566 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mds_locker": "1/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mds_log": "1/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mds_log_expire": "1/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mds_migrator": "1/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mds_quiesce": "3/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_memstore": "1/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mgr": "2/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mgrc": "1/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_mon": "20/20", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_monc": "0/10", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_ms": "1/1", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_none": "0/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_objclass": "0/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_objectcacher": "0/5", 2024-05-10T09:54:58.567 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_objecter": "0/1", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_optracker": "0/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_osd": "1/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_paxos": "20/20", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_perfcounter": "1/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_prioritycache": "1/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rados": "0/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rbd": "0/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rbd_mirror": "0/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rbd_pwl": "0/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rbd_replay": "0/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_refs": "0/0", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_reserver": "1/1", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rgw": "1/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rgw_access": "1/5", 2024-05-10T09:54:58.568 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rgw_datacache": "1/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rgw_dbstore": "1/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rgw_flight": "1/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rgw_lifecycle": "1/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rgw_notification": "1/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rgw_sync": "1/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_rocksdb": "4/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore": "0/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_backref": "0/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_cache": "0/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_cleaner": "0/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_device": "0/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_epm": "0/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-05-10T09:54:58.569 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_journal": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_lba": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_odata": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_omap": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_onode": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_t": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_seastore_tm": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_striper": "0/1", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_test": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_throttle": "1/1", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_timer": "0/1", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_tp": "0/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "debug_trace": "1/5", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-05-10T09:54:58.570 INFO:teuthology.orchestra.run.smithi042.stdout: "device_failure_prediction_mode": "none", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "err_to_graylog": "false", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "err_to_journald": "false", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "err_to_stderr": "true", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "err_to_syslog": "false", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event_tracing": "false", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "exporter_addr": "0.0.0.0", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "exporter_http_port": "9926", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "exporter_prio_limit": "5", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "exporter_sort_metrics": "true", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "exporter_stats_period": "5", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "fake_statfs_for_testing": "0", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "fatal_signal_handlers": "true", 2024-05-10T09:54:58.571 INFO:teuthology.orchestra.run.smithi042.stdout: "filer_max_purge_ops": "10", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filer_max_truncate_ops": "128", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_apply_finisher_threads": "1", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_blackhole": "false", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_btrfs_clone_range": "true", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_btrfs_snap": "true", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_caller_concurrency": "10", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_collect_device_partition_information": "true", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_commit_timeout": "600.000000", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_debug_inject_read_err": "false", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_debug_omap_check": "false", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_debug_verify_split": "false", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_dump_file": "", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-05-10T09:54:58.572 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_fadvise": "true", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_fail_eio": "true", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_fd_cache_shards": "16", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_fd_cache_size": "128", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_fiemap": "false", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_fiemap_threshold": "4096", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_index_retry_probability": "0.000000", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_inject_stall": "0", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_journal_parallel": "false", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_journal_trailing": "false", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_journal_writeahead": "false", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_kill_at": "0", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_inline_xattr_size": "0", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-05-10T09:54:58.573 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_inline_xattrs": "0", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_inline_xattrs_other": "2", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_sync_interval": "5.000000", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_xattr_value_size": "0", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_merge_threshold": "-10", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_min_sync_interval": "0.010000", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_odsync_write": "false", 2024-05-10T09:54:58.574 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_omap_backend": "rocksdb", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_omap_backend_path": "", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_omap_header_cache_size": "1024", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_ondisk_finisher_threads": "1", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_op_thread_timeout": "60", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_op_threads": "2", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_punch_hole": "false", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_max_bytes": "104857600", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-05-10T09:54:58.575 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_queue_max_ops": "50", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_seek_data_hole": "false", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_sloppy_crc": "false", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_splice": "false", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_split_multiple": "2", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_split_rand_factor": "20", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_update_to": "1000", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-05-10T09:54:58.576 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_enable": "true", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_xfs_extsize": "false", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "filestore_zfs_snap": "false", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "fio_dir": "/tmp/fio", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "fsid": "7e1d9b5a-9708-485a-8c63-703e41c4a829", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_allow_other": "true", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_atomic_o_trunc": "true", 2024-05-10T09:54:58.577 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_big_writes": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_debug": "false", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_default_permissions": "false", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_disable_pagecache": "false", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_max_write": "0", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_multithreaded": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_require_active_mds": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_set_user_groups": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_splice_move": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_splice_read": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_splice_write": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_syncfs_on_mksnap": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "fuse_use_invalidate_cb": "true", 2024-05-10T09:54:58.578 INFO:teuthology.orchestra.run.smithi042.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "gss_target_name": "ceph", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_file": "", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_inject_failure": "0", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_interval": "5", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "host": "smithi042", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_max_size": "1073741824", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-05-10T09:54:58.579 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "immutable_object_cache_watermark": "0.900000", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "inject_early_sigterm": "false", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "jaeger_agent_port": "6799", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "jaeger_tracing_enable": "false", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_aio": "true", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_align_min_size": "65536", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_block_align": "true", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_block_size": "4096", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_dio": "true", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_discard": "false", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_force_aio": "false", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_ignore_corruption": "false", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_max_write_bytes": "10485760", 2024-05-10T09:54:58.580 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_max_write_entries": "100", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_replay_from": "0", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_throttle_high_multiple": "0.000000", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_throttle_max_multiple": "0.000000", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_write_header_frequency": "0", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journal_zero_on_create": "false", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journaler_prefetch_periods": "10", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journaler_prezero_periods": "5", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "journaler_write_head_interval": "15", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "key": "", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "keyfile": "", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_backend": "rocksdb", 2024-05-10T09:54:58.581 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_default_stripe_size": "65536", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_fsck_on_mount": "false", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_fsck_on_mount_deep": "true", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_max_bytes": "67108864", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_max_ops": "512", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_nid_prealloc": "1024", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_onode_map_size": "1024", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_sync_submit_transaction": "false", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "kstore_sync_transaction": "false", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "librados_thread_count": "2", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "lockdep": "false", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "lockdep_force_backtrace": "false", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "log_coarse_timestamps": "true", 2024-05-10T09:54:58.582 INFO:teuthology.orchestra.run.smithi042.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_flush_on_exit": "false", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_graylog_host": "127.0.0.1", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_graylog_port": "12201", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_max_new": "1000", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_max_recent": "10000", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_stderr_prefix": "", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_stop_at_utilization": "0.970000", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_file": "true", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_graylog": "false", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_journald": "false", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_stderr": "false", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "log_to_syslog": "false", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "max_rotating_auth_attempts": "10", 2024-05-10T09:54:58.583 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_action_on_write_error": "1", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_alternate_name_max": "8192", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_asio_thread_count": "2", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_export_pin": "true", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_fragment_dirs": "true", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_fragment_interval": "5", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_fragment_size_max": "100000", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_idle_threshold": "0.000000", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_interval": "10", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_max": "-1", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_max_until": "-1", 2024-05-10T09:54:58.584 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_merge_size": "50", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_midchunk": "0.300000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_min_rebalance": "0.100000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_min_start": "0.200000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_minchunk": "0.001000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_mode": "0", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_need_max": "1.200000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_need_min": "0.800000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_overload_epochs": "2", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_sample_interval": "3.000000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_split_bits": "3", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_split_rd": "25000.000000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_split_size": "10000", 2024-05-10T09:54:58.585 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_split_wr": "10000.000000", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_target_decay": "10.000000", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_beacon_grace": "15.000000", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_beacon_interval": "4.000000", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_beacon_mon_down_grace": "60", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_memory_limit": "4294967296", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_mid": "0.700000", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_quiesce_delay": "0", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_quiesce_sleep": "200", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_quiesce_splitauth": "true", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_quiesce_threshold": "524288", 2024-05-10T09:54:58.586 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_release_free_interval": "10", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_reservation": "0.050000", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_trim_interval": "1", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cache_trim_threshold": "262144", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_client_delegate_inos_pct": "50", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_client_prealloc_inos": "1000", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_connect_bootstrapping": "false", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_damage_table_max_entries": "10000", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_debug_auth_pins": "false", 2024-05-10T09:54:58.587 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_debug_frag": "false", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_debug_scatterstat": "false", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_debug_subtrees": "false", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_decay_halflife": "5.000000", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_default_dir_hash": "2", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_defer_session_stale": "true", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_deny_all_reconnect": "false", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dir_keys_per_op": "16384", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dir_max_commit_size": "10", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dir_max_entries": "0", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dir_prefetch": "true", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dirstat_min_interval": "1.000000", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dump_cache_after_rejoin": "false", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dump_cache_on_map": "false", 2024-05-10T09:54:58.588 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dump_cache_threshold_file": "0", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_early_reply": "true", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_enable_op_tracker": "true", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_enforce_unique_name": "true", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_export_ephemeral_distributed": "true", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_export_ephemeral_random": "true", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_forward_all_requests_to_auth": "false", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-05-10T09:54:58.589 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_health_cache_threshold": "1.500000", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_health_summarize_threshold": "10", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_heartbeat_grace": "15.000000", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_heartbeat_reset_grace": "1000", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_inject_health_dummy": "false", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_inject_migrator_session_race": "false", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_join_fs": "", 2024-05-10T09:54:58.590 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_journal_format": "1", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_create_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_export_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_import_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_journal_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_journal_expire_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_journal_replay_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_link_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_mdstable_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_openc_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_rename_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_kill_shutdown_at": "0", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_event_large_threshold": "524288", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_events_per_segment": "1024", 2024-05-10T09:54:58.591 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_major_segment_event_ratio": "12", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_max_events": "-1", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_max_segments": "128", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_pause": "false", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_segment_size": "0", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_skip_corrupt_events": "false", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_skip_unbounded_events": "false", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_trim_threshold": "128", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_log_warn_factor": "2.000000", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_caps_per_client": "1048576", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_completed_flushes": "100000", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_completed_requests": "100000", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_export_size": "20971520", 2024-05-10T09:54:58.592 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_file_recover": "32", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_purge_files": "64", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_purge_ops": "8192", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_max_snaps_per_dir": "100", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_metrics_update_interval": "2", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_min_caps_per_client": "100", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_min_caps_working_set": "10000", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_numa_node": "-1", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_op_complaint_time": "30.000000", 2024-05-10T09:54:58.593 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_op_history_duration": "600", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_op_history_size": "20", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_op_history_slow_op_size": "20", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_op_history_slow_op_threshold": "10", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_op_log_threshold": "5", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_ping_grace": "15", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_ping_interval": "5", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_recall_max_caps": "30000", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_recall_max_decay_threshold": "131072", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_recall_warning_threshold": "262144", 2024-05-10T09:54:58.594 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_reconnect_timeout": "45.000000", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_replay_interval": "1.000000", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_root_ino_gid": "0", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_root_ino_uid": "0", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_session_blocklist_on_evict": "true", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_session_blocklist_on_timeout": "true", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-05-10T09:54:58.595 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_session_metadata_threshold": "16777216", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_shutdown_check": "0", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_skip_ino": "0", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_sleep_rank_change": "0.000000", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_snap_max_uid": "4294967294", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_snap_min_uid": "0", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_snap_rstat": "false", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_standby_replay_damaged": "false", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_symlink_recovery": "true", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_task_status_update_interval": "2.000000", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_thrash_exports": "0", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_thrash_fragments": "0", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_tick_interval": "5.000000", 2024-05-10T09:54:58.596 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_valgrind_exit": "false", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_verify_backtrace": "1", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_verify_scatter": "false", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_wipe_ino_prealloc": "false", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_wipe_sessions": "false", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mempool_debug": "false", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "memstore_debug_omit_block_device_write": "false", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "memstore_device_bytes": "1073741824", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "memstore_page_set": "false", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "memstore_page_size": "65536", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_client_bytes": "134217728", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_client_messages": "512", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_connect_retry_interval": "1.000000", 2024-05-10T09:54:58.597 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_disabled_modules": "", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_enable_op_tracker": "true", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_max_pg_creating": "1024", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_max_pg_num_change": "128", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_mds_bytes": "134217728", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_mds_messages": "128", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_mon_bytes": "134217728", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_mon_messages": "128", 2024-05-10T09:54:58.598 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_num_op_tracker_shard": "32", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_op_complaint_time": "30.000000", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_op_history_duration": "600", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_op_history_size": "20", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_op_history_slow_op_size": "20", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_op_log_threshold": "5", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_osd_bytes": "536870912", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_osd_messages": "8192", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_pool": "true", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_service_beacon_grace": "60.000000", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_standby_modules": "true", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_stats_period": "5", 2024-05-10T09:54:58.599 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_stats_threshold": "5", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_tick_period": "2", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_accept_timeout_factor": "2.000000", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_allow_pool_delete": "true", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_allow_pool_size_one": "true", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_auth_validate_all_caps": "true", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_bytes": "104857600", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_directed_command_retry": "2", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_hunt_interval": "3.000000", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-05-10T09:54:58.600 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_hunt_parallel": "3", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_log_interval": "1.000000", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_ping_interval": "10.000000", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_ping_timeout": "30.000000", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_client_target_rank": "-1", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_clock_drift_allowed": "1.000000", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_level": "debug", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_to_file": "true", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_to_graylog": "false", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-05-10T09:54:58.601 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_to_journald": "false", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_to_stderr": "false", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_compact_on_bootstrap": "false", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_compact_on_start": "false", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_compact_on_trim": "true", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_con_tracker_persist_interval": "10", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_con_tracker_score_halflife": "43200", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_config_key_max_entry_size": "65536", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_cpu_threads": "4", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_crush_min_required_version": "hammer", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_daemon_bytes": "419430400", 2024-05-10T09:54:58.602 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_data_avail_crit": "5", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_data_avail_warn": "5", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_data_size_warn": "16106127360", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_block_osdmap_trim": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_dump_json": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_dump_transactions": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_extra_checks": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_no_require_reef": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_no_require_squid": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_delta_reset_interval": "10.000000", 2024-05-10T09:54:58.603 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_dns_srv_name": "ceph-mon", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_down_mkfs_grace": "120", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_down_uptime_grace": "60", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_election_default_strategy": "1", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_election_timeout": "5.000000", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_elector_ping_divisor": "2", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_elector_ping_timeout": "2.000000", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_enable_op_tracker": "true", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_fake_pool_delete": "false", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_force_quorum_join": "false", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_globalid_prealloc": "10000", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_health_detail_to_clog": "false", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_health_log_update_period": "5", 2024-05-10T09:54:58.604 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_health_max_detail": "50", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_health_to_clog": "true", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_health_to_clog_interval": "600", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_host": "172.21.15.42,[v2:172.21.15.42:3301,v1:172.21.15.42:6790],172.21.15.181", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_host_override": "", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_initial_members": "", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_keyvaluedb": "rocksdb", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_lease": "5.000000", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-05-10T09:54:58.605 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_log_full_interval": "50", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_log_max": "10000", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_log_max_summary": "50", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_max_log_entries_per_event": "4096", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_max_log_epochs": "500", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_max_mdsmap_epochs": "500", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_max_mgrmap_epochs": "500", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_max_osd": "10000", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_max_pg_per_osd": "10000", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_max_pool_pg_num": "65536", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mds_force_trim_to": "0", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mds_skip_sanity": "false", 2024-05-10T09:54:58.606 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_memory_autotune": "true", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_memory_target": "2147483648", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mgr_beacon_grace": "30", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mgr_digest_period": "5", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mgr_inactive_grace": "60", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mgr_mkfs_grace": "240", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_min_osdmap_epochs": "500", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_op_complaint_time": "30", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_op_history_duration": "600", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_op_history_size": "20", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_op_history_slow_op_size": "20", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_op_history_slow_op_threshold": "10", 2024-05-10T09:54:58.607 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_op_log_threshold": "5", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_auto_mark_in": "false", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_auto_mark_new_in": "true", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_cache_size": "500", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_cache_size_min": "134217728", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_crush_smoke_test": "true", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_destroyed_out_interval": "600", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_down_out_interval": "600", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-05-10T09:54:58.608 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_force_trim_to": "0", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_full_ratio": "0.950000", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_laggy_halflife": "3600", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_laggy_max_interval": "300", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_laggy_weight": "0.300000", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_max_initial_pgs": "1024", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_min_down_reporters": "2", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_prime_pg_temp": "true", 2024-05-10T09:54:58.609 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_report_timeout": "900", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_warn_num_repaired": "10", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osd_warn_op_age": "32.000000", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osdmap_full_prune_interval": "10", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osdmap_full_prune_min": "10000", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_pg_stuck_threshold": "60", 2024-05-10T09:54:58.610 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_pg_warn_min_objects": "10000", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_pg_warn_min_per_osd": "0", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_pool_quota_crit_threshold": "0", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_pool_quota_warn_threshold": "0", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_probe_timeout": "2.000000", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_reweight_max_change": "0.050000", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_reweight_max_osds": "4", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-05-10T09:54:58.611 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_scrub_interval": "86400", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_scrub_max_keys": "100", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_scrub_timeout": "300", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_session_timeout": "300", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_smart_report_timeout": "5", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_stat_smooth_intervals": "6", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_stretch_pool_min_size": "2", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_stretch_pool_size": "4", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_subscribe_interval": "86400.000000", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_sync_debug": "false", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_sync_max_payload_keys": "2000", 2024-05-10T09:54:58.612 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_sync_max_payload_size": "1048576", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_sync_provider_kill_at": "0", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_sync_requester_kill_at": "0", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_sync_timeout": "60.000000", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_target_pg_per_osd": "100", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_tick_interval": "5", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_timecheck_interval": "300.000000", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_use_min_delay_socket": "false", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_older_version_delay": "604800", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_filestore_osds": "false", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-05-10T09:54:58.613 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_misplaced": "false", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_older_version": "true", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_pool_no_app": "true", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_on_too_few_osds": "false", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "monmap": "", 2024-05-10T09:54:58.614 INFO:teuthology.orchestra.run.smithi042.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "motr_tracing_enabled": "false", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_op_threads": "3", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_buffer_size": "131072", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_cm": "false", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_device_name": "", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_dscp": "96", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_gid_idx": "0", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_local_gid": "", 2024-05-10T09:54:58.615 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_polling_us": "1000", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_port_num": "1", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_roce_ver": "1", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_send_buffers": "1024", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_sl": "3", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_support_srq": "true", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_rdma_type": "ib", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_async_reap_threshold": "5", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_before_connect": "false", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_ipv4": "true", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_ipv6": "false", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_msgr1": "true", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_msgr2": "true", 2024-05-10T09:54:58.616 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_port_max": "7568", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_port_min": "6800", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_prefer_ipv4": "false", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_retry_count": "3", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_bind_retry_delay": "5", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_blackhole_client": "false", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_blackhole_mds": "false", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_blackhole_mgr": "false", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_blackhole_mon": "false", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_blackhole_osd": "false", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_client_mode": "crc secure", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_cluster_mode": "crc secure", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_cluster_type": "", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_compress_secure": "false", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_connection_idle_timeout": "900", 2024-05-10T09:54:58.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_connection_ready_timeout": "10", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_crc_data": "true", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_crc_header": "true", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_die_on_bad_msg": "false", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_die_on_bug": "true", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_die_on_old_message": "true", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_die_on_skipped_message": "false", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_die_on_unhandled_msg": "false", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_coremask": "0xF", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_devs_allowlist": "", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_enable_tso": "true", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-05-10T09:54:58.618 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_hugepages": "", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_hw_flow_control": "true", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_lro": "true", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_memory_channel": "4", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_pmd": "", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_port_id": "0", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dump_corrupt_message_level": "1", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_dump_on_send": "false", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_initial_backoff": "0.200000", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_inject_delay_max": "1.000000", 2024-05-10T09:54:58.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_inject_delay_probability": "0.000000", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_inject_delay_type": "", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_inject_internal_delays": "0.000000", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_inject_network_congestion": "0", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_inject_socket_failures": "0", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_learn_addr_from_peer": "true", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_max_accept_failures": "4", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_max_backoff": "15.000000", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_mon_client_mode": "secure crc", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_mon_cluster_mode": "secure crc", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_mon_service_mode": "secure crc", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_osd_compress_min_size": "1024", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_osd_compress_mode": "none", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_osd_compression_algorithm": "snappy", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-05-10T09:54:58.620 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_pq_min_cost": "65536", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_public_type": "", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_service_mode": "crc secure", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_tcp_listen_backlog": "512", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_tcp_nodelay": "true", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_tcp_rcvbuf": "0", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "ms_type": "async+posix", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "no_config_file": "false", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter_completion_locks_per_session": "32", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter_debug_inject_relock_delay": "false", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter_inflight_op_bytes": "104857600", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter_inflight_ops": "1024", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter_inject_no_watch_ping": "false", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter_tick_interval": "5.000000", 2024-05-10T09:54:58.621 INFO:teuthology.orchestra.run.smithi042.stdout: "objecter_timeout": "10.000000", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "objectstore_blackhole": "false", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "openssl_engine_opts": "", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_agent_delay_time": "5.000000", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_agent_hist_halflife": "1000", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_agent_max_low_ops": "2", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_agent_max_ops": "4", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_agent_quantize_effort": "0.100000", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_agent_slop": "0.020000", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_allow_recovery_below_min_size": "true", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_asio_thread_count": "2", 2024-05-10T09:54:58.622 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_async_recovery_min_cost": "100", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_auto_mark_unfound_lost": "false", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_backfill_retry_interval": "30.000000", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_backfill_scan_max": "512", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_backfill_scan_min": "64", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_backoff_on_degraded": "false", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_backoff_on_peering": "false", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_backoff_on_unfound": "true", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_beacon_report_interval": "300", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bench_duration": "30", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bench_max_block_size": "67108864", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_bench_small_size_max_iops": "100", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_blkin_trace_all": "false", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_blocked_scrub_grace_period": "120", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-05-10T09:54:58.623 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_check_for_log_corruption": "false", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_class_update_on_start": "true", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_client_message_cap": "256", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_client_message_size_cap": "524288000", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_client_op_priority": "63", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_client_watch_timeout": "30", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_command_max_records": "256", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_compact_on_start": "false", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_crush_chooseleaf_type": "0", 2024-05-10T09:54:58.624 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_crush_initial_weight": "-1.000000", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_crush_update_on_start": "true", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_crush_update_weight_set": "true", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_drop_ping_duration": "0", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_feed_pullee": "-1", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_misdirected_ops": "false", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_no_acting_change": "false", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_no_purge_strays": "false", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_op_order": "false", 2024-05-10T09:54:58.625 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_pg_log_writeout": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_pretend_recovery_active": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_shutdown": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_trim_objects": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_verify_cached_snaps": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_verify_missing_on_start": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_verify_snaps": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-05-10T09:54:58.626 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_deep_scrub_keys": "1024", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_deep_scrub_stride": "524288", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_default_data_pool_replay_window": "5", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_default_notify_timeout": "30", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_delete_sleep": "0.000000", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_discard_disconnected_ops": "true", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_enable_op_tracker": "true", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-05-10T09:54:58.627 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_extblkdev_plugins": "vdo", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_fast_info": "true", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_fast_shutdown": "true", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_fast_shutdown_timeout": "15", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_function_tracing": "false", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_heartbeat_grace": "20", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_heartbeat_interval": "6", 2024-05-10T09:54:58.628 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_heartbeat_min_peers": "10", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_heartbeat_min_size": "2000", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_heartbeat_stale": "600", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_hit_set_max_size": "100000", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_hit_set_min_size": "1000", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_journal_flush_on_shutdown": "true", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_journal_size": "5120", 2024-05-10T09:54:58.629 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_kill_backfill_at": "0", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_loop_before_reset_tphandle": "64", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_map_cache_size": "50", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_map_dedup": "true", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_map_message_max": "40", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_map_message_max_bytes": "10485760", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_map_share_max_epochs": "40", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_attr_name_len": "100", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_attr_size": "0", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_backfills": "1", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_markdown_count": "5", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_markdown_period": "600", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_object_name_len": "2048", 2024-05-10T09:54:58.630 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_object_namespace_len": "256", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_object_size": "134217728", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_omap_entries_per_request": "1024", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_pg_blocked_by": "16", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_pg_log_entries": "10000", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_pgls": "1024", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_push_cost": "8388608", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_push_objects": "10", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_scrubs": "3", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_trimming_pgs": "2", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_write_op_reply_len": "64", 2024-05-10T09:54:58.631 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_max_write_size": "90", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_override_recovery_settings": "false", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_profile": "balanced", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-05-10T09:54:58.632 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mclock_skip_benchmark": "false", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_memory_base": "805306368", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_memory_cache_min": "134217728", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_memory_target": "4294967296", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_memory_target_autotune": "false", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_min_pg_log_entries": "250", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_min_recovery_priority": "0", 2024-05-10T09:54:58.633 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mon_heartbeat_interval": "30", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mon_report_interval": "5", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mon_report_max_in_flight": "2", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_num_cache_shards": "32", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_num_op_tracker_shard": "32", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_numa_auto_affinity": "true", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_numa_node": "-1", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_numa_prefer_iface": "true", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_objecter_finishers": "1", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_objectstore": "bluestore", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_objectstore_fuse": "false", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_objectstore_tracing": "false", 2024-05-10T09:54:58.634 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_complaint_time": "30.000000", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_history_duration": "600", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_history_size": "20", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_history_slow_op_size": "20", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_log_threshold": "5", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_num_shards": "0", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_num_shards_hdd": "5", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_num_shards_ssd": "8", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_num_threads_per_shard": "0", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_pq_min_cost": "65536", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_queue": "mclock_scheduler", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_queue_cut_off": "high", 2024-05-10T09:54:58.635 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_thread_suicide_timeout": "150", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_op_thread_timeout": "15", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_open_classes_on_start": "true", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_os_flags": "0", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_peering_op_priority": "255", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_delete_cost": "1048576", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_delete_priority": "5", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_log_dups_tracked": "3000", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_log_trim_max": "10000", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_log_trim_min": "100", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_object_context_cache_count": "64", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-05-10T09:54:58.636 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_crimson": "false", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_crush_rule": "-1", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_ec_fast_read": "false", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_flag_bulk": "false", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_flag_nodelete": "false", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-05-10T09:54:58.637 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_flags": "0", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_min_size": "0", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_pg_num": "32", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_pgp_num": "0", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_read_ratio": "70", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_size": "2", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_default_type": "replicated", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-05-10T09:54:58.638 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_pool_use_gmt_hitset": "true", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_push_per_object_cost": "1000", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_read_ec_check_for_errors": "false", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recover_clone_overlap": "true", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recover_clone_overlap_limit": "10", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_cost": "20971520", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_delay_start": "0.000000", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_max_active": "0", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_max_active_hdd": "3", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_max_active_ssd": "10", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_max_chunk": "8388608", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_max_single_start": "1", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_op_priority": "3", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_op_warn_multiple": "16", 2024-05-10T09:54:58.639 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_priority": "5", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_retry_interval": "30.000000", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_sleep": "0.000000", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_repair_during_recovery": "false", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_requested_scrub_priority": "120", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_rollback_to_cluster_snap": "", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_auto_repair": "false", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_begin_hour": "0", 2024-05-10T09:54:58.640 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_begin_week_day": "0", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_chunk_max": "25", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_chunk_min": "5", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_cost": "52428800", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_during_recovery": "false", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_end_hour": "0", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_end_week_day": "0", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_event_cost": "4096", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_invalid_stats": "true", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_load_threshold": "0.500000", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_max_interval": "604800.000000", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_max_preemptions": "5", 2024-05-10T09:54:58.641 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_min_interval": "86400.000000", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_priority": "5", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_reservation_timeout": "300000", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_scrub_sleep": "0.000000", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_shutdown_pgref_assert": "false", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_skip_data_digest": "false", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_smart_report_timeout": "5", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_snap_trim_cost": "1048576", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_snap_trim_priority": "5", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_snap_trim_sleep": "0.000000", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-05-10T09:54:58.642 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_stats_update_period_scrubbing": "15", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_target_transaction_size": "30", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_default_cache_mode": "writeback", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-05-10T09:54:58.643 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_tracing": "false", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_use_stale_snap": "false", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "osdc_blkin_trace_all": "false", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_kill_at": "0", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_max_join_drift": "10", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_min": "500", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_min_wait": "0.050000", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_propose_interval": "1.000000", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_service_trim_max": "500", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_service_trim_max_multiplier": "20", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_service_trim_min": "250", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_stash_full_interval": "25", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_trim_max": "500", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "paxos_trim_min": "250", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "perf": "true", 2024-05-10T09:54:58.644 INFO:teuthology.orchestra.run.smithi042.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "plugin_dir": "/usr/lib/ceph", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "-", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrv": "", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "public_bind_addr": "-", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "public_network": "", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "public_network_interface": "", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "qat_compressor_enabled": "false", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "qat_compressor_session_max_number": "256", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "rados_mon_op_timeout": "0", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "rados_osd_op_timeout": "0", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "rados_tracing": "false", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_atime_update_interval": "60", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_balance_parent_reads": "false", 2024-05-10T09:54:58.645 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_balance_snap_reads": "false", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_blkin_trace_all": "false", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_blocklist_expire_seconds": "0", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_blocklist_on_break_lock": "true", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache": "true", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache_block_writes_upfront": "false", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache_max_dirty": "25165824", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache_max_dirty_object": "0", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache_policy": "writearound", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache_size": "33554432", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache_target_dirty": "16777216", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_clone_copy_on_read": "false", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_compression_hint": "none", 2024-05-10T09:54:58.646 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_concurrent_management_ops": "10", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_clone_format": "auto", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_data_pool": "", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_features": "61", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_format": "2", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_map_options": "", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_order": "22", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_pool": "rbd", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_stripe_count": "0", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_default_stripe_unit": "0", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_disable_zero_copy_writes": "true", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_discard_granularity_bytes": "65536", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_enable_alloc_hint": "true", 2024-05-10T09:54:58.647 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_io_scheduler": "simple", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_commit_age": "5.000000", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_object_flush_interval": "0", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_order": "24", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_pool": "", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_journal_splay_width": "4", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_localize_parent_reads": "false", 2024-05-10T09:54:58.648 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_localize_snap_reads": "false", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_image_policy_type": "simple", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-05-10T09:54:58.649 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_memory_autotune": "true", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_memory_base": "805306368", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_memory_target": "4294967296", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirroring_delete_delay": "0", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirroring_replay_delay": "0", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-05-10T09:54:58.650 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_move_to_trash_on_remove": "false", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_mtime_update_interval": "60", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_non_blocking_aio": "true", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_op_thread_timeout": "60", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_op_threads": "1", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_parent_cache_enabled": "false", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_persistent_cache_mode": "disabled", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_persistent_cache_path": "/tmp", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_persistent_cache_size": "1073741824", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_plugins": "", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_bps_burst": "0", 2024-05-10T09:54:58.651 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_bps_limit": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_exclude_ops": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_iops_burst": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_iops_limit": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_read_bps_burst": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_read_bps_limit": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_read_iops_burst": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_read_iops_limit": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_schedule_tick_min": "50", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_write_bps_burst": "0", 2024-05-10T09:54:58.652 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_write_bps_limit": "0", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_write_iops_burst": "0", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_qos_write_iops_limit": "0", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_quiesce_notification_attempts": "10", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_read_from_replica_policy": "default", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_readahead_max_bytes": "524288", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_readahead_trigger_requests": "10", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_request_timed_out_seconds": "30", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_skip_partial_discard": "true", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_tracing": "false", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_validate_names": "true", 2024-05-10T09:54:58.653 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd_validate_pool": "true", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "restapi_base_url": "", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "restapi_log_level": "", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_account_default_quota_max_size": "-1", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_acl_grants_max_num": "100", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_admin_entry": "admin", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_backend_store": "rados", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_barbican_url": "", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_beast_enable_async": "true", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_counters_cache": "false", 2024-05-10T09:54:58.654 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_index_max_aio": "128", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_quota_ttl": "600", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_cache_enabled": "true", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_cache_expiry_interval": "900", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_cache_lru_size": "25000", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_config_store": "rados", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_content_length_compat": "false", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_copy_obj_progress": "true", 2024-05-10T09:54:58.655 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_cors_rules_max_num": "100", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_cross_domain_policy": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_default_encryption_key": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_kmip_addr": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_kmip_ca_path": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_kmip_client_cert": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_kmip_client_key": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_kmip_password": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_kmip_username": "", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_require_ssl": "true", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-05-10T09:54:58.656 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_suppress_logs": "true", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_addr": "", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_auth": "token", 2024-05-10T09:54:58.657 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_namespace": "", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_prefix": "", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_token_file": "", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_curl_buffersize": "524288", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_curl_low_speed_limit": "1024", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_curl_low_speed_time": "300", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_curl_tcp_keepalive": "0", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-05-10T09:54:58.658 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d3n_l1_fadvise": "4", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d4n_host": "127.0.0.1", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d4n_l1_fadvise": "4", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_d4n_port": "6379", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-05-10T09:54:58.659 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_data_log_changes_size": "1000", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_data_log_num_shards": "128", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_data_log_window": "30", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_data_notify_interval_msec": "0", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_data_sync_poll_interval": "20", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_data_sync_spawn_window": "20", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_default_data_log_backing": "fifo", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_default_region_info_oid": "default.region", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_defer_to_bucket_acls": "", 2024-05-10T09:54:58.660 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_data_res": "500.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-05-10T09:54:58.661 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dns_name": "", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dns_s3website_name": "", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_dynamic_resharding": "true", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_enable_gc_threads": "true", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_enable_lc_threads": "true", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_enable_ops_log": "false", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_enable_quota_threads": "true", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_enable_static_website": "false", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_enable_usage_log": "false", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_enforce_swift_acls": "true", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_exit_timeout_secs": "120", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_expose_bucket": "false", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_extended_http_attrs": "", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_filter": "none", 2024-05-10T09:54:58.662 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_frontends": "beast port=7480", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_max_concurrent_io": "10", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_max_deferred": "50", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_max_objs": "32", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_max_queue_size": "134213632", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_max_trim_chunk": "16", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_obj_min_wait": "7200", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_processor_max_time": "3600", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_gc_processor_period": "3600", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_get_obj_window_size": "16777216", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_healthcheck_disabling_path": "", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ignore_get_invalid_range": "false", 2024-05-10T09:54:58.663 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_init_timeout": "300", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_kafka_connection_idle": "300", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_kafka_message_timeout": "5000", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_kafka_sleep_timeout": "10", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_admin_domain": "", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_admin_password": "", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_admin_password_path": "", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_admin_project": "", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_admin_tenant": "", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_admin_token": "", 2024-05-10T09:54:58.664 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_admin_token_path": "", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_admin_user": "", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_api_version": "2", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_barbican_domain": "", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_barbican_password": "", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_barbican_project": "", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_barbican_tenant": "", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_barbican_user": "", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_implicit_tenants": "false", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_service_token_enabled": "false", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_token_cache_size": "10000", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_url": "", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_keystone_verify_ssl": "true", 2024-05-10T09:54:58.665 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lc_debug_interval": "-1", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lc_lock_max_time": "90", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lc_max_objs": "32", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lc_max_rules": "1000", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lc_max_worker": "3", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lc_max_wp_worker": "3", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lc_thread_delay": "0", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ldap_dnattr": "uid", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ldap_searchfilter": "", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ldap_uri": "", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lfuda_sync_frequency": "60", 2024-05-10T09:54:58.666 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_log_http_headers": "", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_log_nonexistent_bucket": "false", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_log_object_name_utc": "false", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_attr_name_len": "0", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_attr_size": "0", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_attrs_num_in_req": "0", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_chunk_size": "4194304", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_concurrent_requests": "1024", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-05-10T09:54:58.667 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_dynamic_shards": "1999", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_listing_results": "1000", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_notify_retries": "10", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_objs_per_shard": "100000", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_put_param_size": "1048576", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_put_size": "5368709120", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_max_slo_entries": "1000", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_md_log_max_shards": "64", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_md_notify_interval_msec": "200", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_meta_sync_poll_interval": "20", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_meta_sync_spawn_window": "20", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_mp_lock_max_time": "600", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_multipart_min_part_size": "5242880", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-05-10T09:54:58.668 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_fhcache_size": "2017", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_lru_lanes": "5", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_max_gc": "300", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_run_gc_threads": "false", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_run_lc_threads": "false", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_run_quota_threads": "false", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_run_sync_thread": "false", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_num_async_rados_threads": "32", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_num_control_oids": "8", 2024-05-10T09:54:58.669 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_numa_node": "-1", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_obj_stripe_size": "4194304", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_objexp_chunk_size": "100", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_objexp_gc_interval": "600", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_objexp_hints_num_shards": "127", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_op_thread_timeout": "600", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_op_tracing": "false", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_opa_token": "", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_opa_url": "", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_opa_verify_ssl": "true", 2024-05-10T09:54:58.670 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ops_log_rados": "false", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_ops_log_socket_path": "", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_period_push_interval": "2.000000", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_period_push_interval_max": "30.000000", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_period_root_pool": ".rgw.root", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_posix_cache_lanes": "3", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_posix_cache_max_buckets": "100", 2024-05-10T09:54:58.671 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_posix_cache_partitions": "3", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_print_continue": "true", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_print_prohibited_content_length": "false", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_rados_tracing": "false", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_realm": "", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_realm_id": "", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_region": "", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_region_root_pool": ".rgw.root", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_relaxed_region_enforcement": "false", 2024-05-10T09:54:58.672 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_request_uri": "", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_reshard_batch_size": "64", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_reshard_max_aio": "128", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_reshard_num_logs": "16", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_reshard_thread_interval": "600", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_resolve_cname": "false", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_rest_getusage_op_compat": "false", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_run_sync_thread": "true", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_s3_auth_use_keystone": "false", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_s3_auth_use_ldap": "false", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_s3_auth_use_rados": "true", 2024-05-10T09:54:58.673 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_s3_auth_use_sts": "false", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_s3_success_create_obj_status": "0", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_scheduler_type": "throttler", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_script_uri": "", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_service_provider_name": "", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sts_client_id": "", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sts_client_secret": "", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sts_entry": "sts", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sts_key": "sts", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sts_max_session_duration": "43200", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sts_min_session_duration": "900", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sts_token_introspection_url": "", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_account_in_url": "false", 2024-05-10T09:54:58.674 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_auth_entry": "auth", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_auth_url": "", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_custom_header": "", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_enforce_content_length": "false", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_need_stats": "true", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_tenant_name": "", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_token_expiration": "86400", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_url": "", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_url_prefix": "swift", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_swift_versioning_enabled": "false", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_lease_period": "120", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_log_trim_interval": "1200", 2024-05-10T09:54:58.675 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_obj_etag_verify": "false", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_trace_history_size": "4096", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_thread_pool_size": "512", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_topic_persistency_max_retries": "0", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_topic_require_publish_policy": "false", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_torrent_comment": "", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_torrent_createby": "", 2024-05-10T09:54:58.676 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_torrent_encoding": "", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_torrent_flag": "false", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_torrent_max_size": "5368709120", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_torrent_origin": "", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_torrent_sha_unit": "524288", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_torrent_tracker": "", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_trust_forwarded_https": "false", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_usage_log_tick_interval": "30", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_usage_max_shards": "32", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_usage_max_user_shards": "1", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_use_opa_authz": "false", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_counters_cache": "false", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_counters_cache_size": "10000", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-05-10T09:54:58.677 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_default_quota_max_size": "-1", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_max_buckets": "1000", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_policies_max_num": "100", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_quota_sync_interval": "86400", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_user_unique_email": "true", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_verify_ssl": "true", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_website_routing_rules_max_num": "50", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_zone": "", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_zone_id": "", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_zonegroup": "", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_zonegroup_id": "", 2024-05-10T09:54:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rgwlc_auto_session_clear": "true", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rgwlc_skip_bucket_step": "false", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_block_size": "4096", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cache_shard_bits": "4", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cache_size": "536870912", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cache_type": "binned_lru", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_collect_compaction_stats": "false", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_collect_extended_stats": "false", 2024-05-10T09:54:58.679 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_collect_memory_stats": "false", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_index_type": "binary_search", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_log_to_ceph_log": "true", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_metadata_block_size": "4096", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_partition_filters": "false", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_perf": "false", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "rotating_keys_renewal_timeout": "10", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "run_dir": "/var/run/ceph", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_block_create": "true", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_cache_lru_size": "67108864", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_cbjournal_size": "5368709120", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_data_delta_based_overwrite": "0", 2024-05-10T09:54:58.680 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_default_max_object_size": "16777216", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_device_size": "53687091200", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_full_integrity_check": "false", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_journal_batch_capacity": "16", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_journal_iodepth_limit": "5", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_main_device_type": "SSD", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_max_concurrent_transactions": "8", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_max_data_allocation_size": "32768", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "seastore_segment_size": "67108864", 2024-05-10T09:54:58.681 INFO:teuthology.orchestra.run.smithi042.stdout: "set_keepcaps": "false", 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout: "setgroup": "", 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout: "setuser": "", 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout: "setuser_match_path": "", 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_misplaced_ratio": "0.050000", 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout: "thp": "false", 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout: "threadpool_default_timeout": "60", 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout: "threadpool_empty_queue_max_wait": "2", 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout: "throttler_perf_counter": "true" 2024-05-10T09:54:58.682 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:54:58.684 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-05-10T09:54:58.832 INFO:teuthology.orchestra.run.smithi042.stdout:mon.a: {} 2024-05-10T09:54:58.832 INFO:teuthology.orchestra.run.smithi042.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T09:54:58.845 INFO:teuthology.orchestra.run.smithi042.stdout:mon.b: {} 2024-05-10T09:54:58.845 INFO:teuthology.orchestra.run.smithi042.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T09:54:58.854 INFO:teuthology.orchestra.run.smithi042.stdout:mon.c: {} 2024-05-10T09:54:58.854 INFO:teuthology.orchestra.run.smithi042.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T09:54:58.870 DEBUG:teuthology.orchestra.run.smithi042:> type ceph-objectstore-tool 2024-05-10T09:54:58.874 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-10T09:54:58.874 DEBUG:teuthology.orchestra.run.smithi181:> type ceph-objectstore-tool 2024-05-10T09:54:58.880 INFO:teuthology.orchestra.run.smithi181.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-10T09:54:58.881 INFO:teuthology.run_tasks:Running task workunit... 2024-05-10T09:54:58.893 INFO:tasks.workunit:Pulling workunits from ref 5be95034c7c2ad8a0361951b19205b782eb6be06 2024-05-10T09:54:58.893 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-10T09:54:58.894 DEBUG:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-10T09:54:58.894 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-05-10T09:54:58.894 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T09:54:58.894 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T09:54:58.894 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-05-10T09:54:58.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-05-10T09:54:58.895 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-05-10T09:54:58.895 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-05-10T09:54:58.895 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:54:58.895 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-05-10T09:54:58.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:54:58.896 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-05-10T09:54:58.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:54:58.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:54:58.923 INFO:teuthology.orchestra.run.smithi042.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-10T09:54:58.923 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-10T09:54:58.925 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:54:58.925+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:54:58.974 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-10T09:54:58.974 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-10T09:54:59.017 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:54:59.017+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:54:59.021 INFO:tasks.workunit:timeout=3h 2024-05-10T09:54:59.021 INFO:tasks.workunit:cleanup=True 2024-05-10T09:54:59.022 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5be95034c7c2ad8a0361951b19205b782eb6be06 2024-05-10T09:54:59.041 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:54:59.041 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:54:59.041 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:54:59.041 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:54:59.046 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-10T09:54:59.053 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:54:59.053 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:54:59.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:54:59.071 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:54:59.072 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:54:59.092 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:54:59.093 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:54:59.098 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:54:59.097+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:54:59.110 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:54:59.110 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:54:59.131 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:54:59.131 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:54:59.166 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:54:59.166 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:54:59.187 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:54:59.187 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:54:59.193 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:54:59.193 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:54:59.199 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:54:59.197+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:54:59.207 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:54:59.222 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:54:59.223 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:moved 0 / 530 (0%) 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:avg 66.25 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:stddev 9.7179 -> 9.7179 (expected baseline 7.61372) 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:min osd.2 with 47 -> 47 pgs (0.709434 -> 0.709434 * mean) 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:max osd.3 with 81 -> 81 pgs (1.22264 -> 1.22264 * mean) 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:oload 1000 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:max_change 0.05 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:max_change_osds 4 2024-05-10T09:54:59.228 INFO:teuthology.orchestra.run.smithi042.stdout:average_utilization 0.0003 2024-05-10T09:54:59.229 INFO:teuthology.orchestra.run.smithi042.stdout:overload_utilization 0.0033 2024-05-10T09:54:59.229 INFO:teuthology.orchestra.run.smithi042.stderr:no change 2024-05-10T09:54:59.250 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-05-10T09:54:59.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-05-10T09:54:59.301 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:54:59.301+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:54:59.337 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:54:59.337 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:54:59.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:54:59.401 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:54:59.401+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:54:59.466 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:54:59.466 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:54:59.480 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:54:59.529 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:54:59.529+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:54:59.577 INFO:tasks.ceph.mgr.x.smithi181.stderr:2024-05-10T09:54:59.577+0000 7f47cb468640 -1 mgr.server reply reply (3) No such process no change 2024-05-10T09:54:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:moved 23 / 530 (4.33962%) 2024-05-10T09:54:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:avg 66.25 2024-05-10T09:54:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:stddev 9.7179 -> 10.6859 (expected baseline 7.61372) 2024-05-10T09:54:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:min osd.2 with 47 -> 44 pgs (0.709434 -> 0.664151 * mean) 2024-05-10T09:54:59.578 INFO:teuthology.orchestra.run.smithi042.stdout:max osd.3 with 81 -> 78 pgs (1.22264 -> 1.17736 * mean) 2024-05-10T09:54:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:oload 110 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:max_change 1 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:max_change_osds 4 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:average_utilization 0.0003 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:overload_utilization 0.0004 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 weight 1.0000 -> 0.8730 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3 weight 1.0000 -> 0.8731 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 weight 1.0000 -> 0.8737 2024-05-10T09:54:59.579 INFO:teuthology.orchestra.run.smithi042.stderr:no change 2024-05-10T09:54:59.597 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-05-10T09:54:59.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-05-10T09:54:59.603 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:54:59.603 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:54:59.604 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:54:59.601+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:54:59.618 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:54:59.702 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:54:59.701+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:54:59.769 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:54:59.769 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:54:59.782 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:54:59.829 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:54:59.829+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:54:59.883 INFO:teuthology.orchestra.run.smithi042.stdout:moved 0 / 530 (0%) 2024-05-10T09:54:59.883 INFO:teuthology.orchestra.run.smithi042.stdout:avg 66.25 2024-05-10T09:54:59.883 INFO:teuthology.orchestra.run.smithi042.stdout:stddev 9.7179 -> 9.7179 (expected baseline 7.61372) 2024-05-10T09:54:59.883 INFO:teuthology.orchestra.run.smithi042.stdout:min osd.2 with 47 -> 47 pgs (0.709434 -> 0.709434 * mean) 2024-05-10T09:54:59.883 INFO:teuthology.orchestra.run.smithi042.stdout:max osd.3 with 81 -> 81 pgs (1.22264 -> 1.22264 * mean) 2024-05-10T09:54:59.883 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:54:59.883 INFO:teuthology.orchestra.run.smithi042.stdout:oload 1000 2024-05-10T09:54:59.884 INFO:teuthology.orchestra.run.smithi042.stdout:max_change 0.05 2024-05-10T09:54:59.884 INFO:teuthology.orchestra.run.smithi042.stdout:max_change_osds 4 2024-05-10T09:54:59.884 INFO:teuthology.orchestra.run.smithi042.stdout:average_utilization 0.0003 2024-05-10T09:54:59.884 INFO:teuthology.orchestra.run.smithi042.stdout:overload_utilization 0.0033 2024-05-10T09:54:59.884 INFO:teuthology.orchestra.run.smithi042.stderr:no change 2024-05-10T09:54:59.898 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:54:59.899 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:54:59.901 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-05-10T09:54:59.901 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-05-10T09:54:59.912 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:54:59.912 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:54:59.909+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:00.004 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:00.001+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:00.064 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:00.064 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:00.078 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:00.121 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:00.121+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:00.207 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:00.205+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:00.231 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:00.231 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:00.237 INFO:teuthology.orchestra.run.smithi042.stdout:moved 0 / 530 (0%) 2024-05-10T09:55:00.237 INFO:teuthology.orchestra.run.smithi042.stdout:avg 66.25 2024-05-10T09:55:00.237 INFO:teuthology.orchestra.run.smithi042.stdout:stddev 9.7179 -> 9.7179 (expected baseline 7.61372) 2024-05-10T09:55:00.237 INFO:teuthology.orchestra.run.smithi042.stdout:min osd.2 with 47 -> 47 pgs (0.709434 -> 0.709434 * mean) 2024-05-10T09:55:00.237 INFO:teuthology.orchestra.run.smithi042.stdout:max osd.3 with 81 -> 81 pgs (1.22264 -> 1.22264 * mean) 2024-05-10T09:55:00.238 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:55:00.238 INFO:teuthology.orchestra.run.smithi042.stdout:oload 1000 2024-05-10T09:55:00.238 INFO:teuthology.orchestra.run.smithi042.stdout:max_change 0.05 2024-05-10T09:55:00.238 INFO:teuthology.orchestra.run.smithi042.stdout:max_change_osds 4 2024-05-10T09:55:00.238 INFO:teuthology.orchestra.run.smithi042.stdout:average_utilization 0.0003 2024-05-10T09:55:00.238 INFO:teuthology.orchestra.run.smithi042.stdout:overload_utilization 0.0033 2024-05-10T09:55:00.238 INFO:teuthology.orchestra.run.smithi042.stderr:no change 2024-05-10T09:55:00.245 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:00.256 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-05-10T09:55:00.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-05-10T09:55:00.261 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:55:00.308 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:00.305+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:00.359 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:00.360 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:00.373 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:00.408 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:00.405+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:00.483 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:00.483 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:00.496 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:00.509 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:00.509+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout:moved 0 / 530 (0%) 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout:avg 66.25 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout:stddev 9.7179 -> 9.7179 (expected baseline 7.61372) 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout:min osd.2 with 47 -> 47 pgs (0.709434 -> 0.709434 * mean) 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout:max osd.3 with 81 -> 81 pgs (1.22264 -> 1.22264 * mean) 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout:oload 1000 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout:max_change 1 2024-05-10T09:55:00.550 INFO:teuthology.orchestra.run.smithi042.stdout:max_change_osds 4 2024-05-10T09:55:00.551 INFO:teuthology.orchestra.run.smithi042.stdout:average_utilization 0.0003 2024-05-10T09:55:00.551 INFO:teuthology.orchestra.run.smithi042.stdout:overload_utilization 0.0033 2024-05-10T09:55:00.551 INFO:teuthology.orchestra.run.smithi042.stderr:no change 2024-05-10T09:55:00.609 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:00.605+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:00.618 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:00.618 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:00.632 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:00.710 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:00.709+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:00.762 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:00.762 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:00.775 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:00.817 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:00.817+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:00.912 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:00.909+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:00.934 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:00.934 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:00.948 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:01.033 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:01.033+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:01.105 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:01.106 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:01.113 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:01.113+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:01.119 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:01.214 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:01.213+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:01.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:01.291 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:01.291 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:01.305 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:01.353 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:01.353+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:01.406 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:01.406 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:01.416 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:01.413+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:01.422 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:01.423 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:01.424 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:01.424 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:01.438 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:01.439 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:01.439 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:01.457 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:01.457 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:01.475 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:01.475 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:01.492 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:01.492 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:01.511 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:01.511 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:01.525 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:01.525+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:01.529 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:01.529 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.883988392999999, 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003342228, 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.605 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 41 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720248+0000", 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.17e-06 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720259+0000", 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1362999999999999e-05 2024-05-10T09:55:01.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720290+0000", 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1245999999999999e-05 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720326+0000", 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5769999999999998e-05 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720467+0000", 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014139299999999999 2024-05-10T09:55:01.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720848+0000", 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038087700000000001 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.721316+0000", 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000468159 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.722880+0000", 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001563839 2024-05-10T09:55:01.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723331+0000", 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000450603 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723447+0000", 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115742 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723588+0000", 2024-05-10T09:55:01.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014106599999999999 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.808568360999999, 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036007420000000001, 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:55:01.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 39 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795667+0000", 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.883e-06 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795677+0000", 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5359999999999998e-06 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795702+0000", 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4927e-05 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795716+0000", 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3828999999999999e-05 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795878+0000", 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162373 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.796006+0000", 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012822199999999999 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.799266+0000", 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032599719999999999 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.889362369000001, 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056055200000000001, 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:01.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714875+0000", 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.303e-06 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714893+0000", 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8668000000000002e-05 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714927+0000", 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3519999999999998e-05 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714948+0000", 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0911e-05 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715113+0000", 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016473599999999999 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715512+0000", 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039976900000000001 2024-05-10T09:55:01.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715816+0000", 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000303417 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719016+0000", 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032006589999999998 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720317+0000", 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013003859999999999 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720396+0000", 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9043999999999997e-05 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720477+0000", 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1106999999999994e-05 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491083450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.883386174, 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050150489999999997, 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:01.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720849+0000", 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5740000000000001e-06 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720857+0000", 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2339999999999994e-06 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720878+0000", 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0939000000000001e-05 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720890+0000", 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1863e-05 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720993+0000", 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102446 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721163+0000", 2024-05-10T09:55:01.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017038700000000001 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721496+0000", 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00033285399999999999 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.723818+0000", 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002322246 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725574+0000", 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001755288 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725705+0000", 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131345 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725863+0000", 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157873 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.627 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.88037523, 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033784850000000001, 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.628 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 205 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723863+0000", 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9369999999999997e-06 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723879+0000", 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.662e-05 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723917+0000", 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7462999999999997e-05 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723936+0000", 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9049999999999999e-05 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724071+0000", 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013534500000000001 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724296+0000", 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000224766 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724714+0000", 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041791000000000002 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.726248+0000", 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534168 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727037+0000", 2024-05-10T09:55:01.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00078889400000000005 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727121+0000", 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4109000000000004e-05 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727237+0000", 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116223 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.633 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.804396959, 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034944860000000002, 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 220 2024-05-10T09:55:01.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799840+0000", 2024-05-10T09:55:01.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.88e-06 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799852+0000", 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2597e-05 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799878+0000", 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.563e-05 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799892+0000", 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800078+0000", 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018622800000000001 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800286+0000", 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020734900000000001 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800679+0000", 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039302599999999999 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.802102+0000", 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014227090000000001 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803181+0000", 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001079602 2024-05-10T09:55:01.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803265+0000", 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4085999999999994e-05 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803331+0000", 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6175999999999998e-05 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.639 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.793672162, 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033216510000000001, 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 223 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810564+0000", 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0099999999999998e-06 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810576+0000", 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1919999999999999e-05 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810604+0000", 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8293000000000002e-05 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810618+0000", 2024-05-10T09:55:01.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.453e-05 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810739+0000", 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120559 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810974+0000", 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023486500000000001 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.811410+0000", 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043620699999999998 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.812739+0000", 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013293929999999999 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813736+0000", 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00099665600000000006 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813819+0000", 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3024999999999999e-05 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813883+0000", 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4193e-05 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.645 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.786306652, 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034076969999999999, 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 225 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:01.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817929+0000", 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9800000000000001e-06 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817940+0000", 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1263e-05 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817966+0000", 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5517e-05 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817981+0000", 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.508e-05 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818160+0000", 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017946800000000001 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818375+0000", 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021470500000000001 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818799+0000", 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042364600000000002 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.820054+0000", 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012555439999999999 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821175+0000", 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011206720000000001 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821267+0000", 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2164999999999996e-05 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821335+0000", 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7657000000000006e-05 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.782519757999999, 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031354019999999998, 2024-05-10T09:55:01.651 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 226 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:01.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821716+0000", 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0329999999999998e-06 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821726+0000", 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821758+0000", 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1109000000000003e-05 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821795+0000", 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7262999999999999e-05 2024-05-10T09:55:01.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821923+0000", 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127906 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822156+0000", 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233231 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822572+0000", 2024-05-10T09:55:01.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041563400000000001 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.823868+0000", 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00129623 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824698+0000", 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083007700000000003 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824784+0000", 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5636000000000005e-05 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824849+0000", 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5986000000000001e-05 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.657 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.752641419, 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031471559999999999, 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 234 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:01.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:01.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851595+0000", 2024-05-10T09:55:01.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:55:01.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851606+0000", 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1039999999999999e-05 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851637+0000", 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1572999999999997e-05 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851653+0000", 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:01.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851833+0000", 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017961100000000001 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852052+0000", 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000219905 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852491+0000", 2024-05-10T09:55:01.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043847999999999999 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.853823+0000", 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013323670000000001 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854589+0000", 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076523699999999999 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854679+0000", 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0660000000000003e-05 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854740+0000", 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0396000000000002e-05 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:431 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.690357048999999, 2024-05-10T09:55:01.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031636749999999999, 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 431 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913878+0000", 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4699999999999999e-06 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913885+0000", 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7830000000000001e-06 2024-05-10T09:55:01.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913899+0000", 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3550000000000001e-05 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913910+0000", 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1116e-05 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914037+0000", 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012750899999999999 2024-05-10T09:55:01.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914363+0000", 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032586799999999999 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914907+0000", 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054394199999999995 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916597+0000", 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016898 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916905+0000", 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030769499999999997 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916982+0000", 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7809e-05 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.917040+0000", 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8133000000000001e-05 2024-05-10T09:55:01.669 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:442 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.685270436, 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031368049999999999, 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.670 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 442 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918965+0000", 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.654e-06 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918973+0000", 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0730000000000005e-06 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918999+0000", 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5437000000000001e-05 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919011+0000", 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140000000000001e-05 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919129+0000", 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118539 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919440+0000", 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031087500000000001 2024-05-10T09:55:01.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919767+0000", 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032684599999999999 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921033+0000", 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001266348 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921785+0000", 2024-05-10T09:55:01.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075156400000000003 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921937+0000", 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015235800000000001 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.922100+0000", 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016297100000000001 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:493 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.649042841, 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038321729999999999, 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955193+0000", 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.514e-06 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955205+0000", 2024-05-10T09:55:01.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2395000000000001e-05 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955230+0000", 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4939e-05 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955242+0000", 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1989e-05 2024-05-10T09:55:01.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955399+0000", 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015761700000000001 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955455+0000", 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5946999999999998e-05 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958922+0000", 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034661230000000002 2024-05-10T09:55:01.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959023+0000", 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101649 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:531 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:01.680 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.625315390000001, 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033419700000000001, 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978920+0000", 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.646e-06 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978932+0000", 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1746000000000001e-05 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978957+0000", 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5425000000000001e-05 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978970+0000", 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3186e-05 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979090+0000", 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119621 2024-05-10T09:55:01.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979128+0000", 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7765999999999997e-05 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982128+0000", 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030005269999999998 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982260+0000", 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132053 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:532 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.623370693, 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040928650000000002, 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.685 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:01.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980865+0000", 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.531e-06 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980875+0000", 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0749e-05 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980899+0000", 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4031000000000001e-05 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980911+0000", 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1897e-05 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981024+0000", 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112574 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981067+0000", 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3556000000000001e-05 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984876+0000", 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003808624 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984956+0000", 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9902999999999997e-05 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.689 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.378737000999999, 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035004300000000001, 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.690 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 745 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225500+0000", 2024-05-10T09:55:01.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3100000000000001e-06 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225513+0000", 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.278e-05 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225544+0000", 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0573e-05 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225559+0000", 2024-05-10T09:55:01.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.522e-05 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225710+0000", 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015115899999999999 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226066+0000", 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035624300000000001 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226622+0000", 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055600300000000001 2024-05-10T09:55:01.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.227855+0000", 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012332510000000001 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228722+0000", 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00086697599999999999 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228885+0000", 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162969 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228997+0000", 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111946 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:747 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:01.695 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.374015494, 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032519850000000002, 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 747 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230220+0000", 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6559999999999999e-06 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230228+0000", 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.824e-06 2024-05-10T09:55:01.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230248+0000", 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230259+0000", 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1406999999999999e-05 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230372+0000", 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112829 2024-05-10T09:55:01.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230596+0000", 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022375499999999999 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.231055+0000", 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045978700000000002 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.232387+0000", 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013311589999999999 2024-05-10T09:55:01.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233206+0000", 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081972000000000002 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233359+0000", 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152683 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233470+0000", 2024-05-10T09:55:01.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111419 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.336044497, 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031982120000000002, 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.701 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 763 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268191+0000", 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0360000000000001e-06 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268202+0000", 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.043e-05 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268234+0000", 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1847000000000002e-05 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268255+0000", 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1590000000000002e-05 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268443+0000", 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018751799999999999 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268670+0000", 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022725499999999999 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268993+0000", 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032307800000000003 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.270123+0000", 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011297709999999999 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271173+0000", 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010499019999999999 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271257+0000", 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3901999999999997e-05 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271388+0000", 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013088299999999999 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.190106224000001, 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034247800000000001, 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 825 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414129+0000", 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.657e-06 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414140+0000", 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414159+0000", 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8805999999999999e-05 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414170+0000", 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1007e-05 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414280+0000", 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110115 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414524+0000", 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244405 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.415025+0000", 2024-05-10T09:55:01.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00050059300000000002 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.416518+0000", 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014937889999999999 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417272+0000", 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075359400000000001 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417420+0000", 2024-05-10T09:55:01.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148009 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417552+0000", 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013230499999999999 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:01.712 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.9629583299999993, 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003571369, 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 922 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641278+0000", 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.097e-06 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641289+0000", 2024-05-10T09:55:01.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1163e-05 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641320+0000", 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1600000000000002e-05 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641342+0000", 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2089000000000001e-05 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641594+0000", 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025150200000000002 2024-05-10T09:55:01.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642155+0000", 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056140900000000002 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642609+0000", 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045330000000000001 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.643594+0000", 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098517900000000009 2024-05-10T09:55:01.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644692+0000", 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010985039999999999 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644782+0000", 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9837000000000001e-05 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644847+0000", 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4689000000000004e-05 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:01.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:01.718 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:01.719 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:01.720 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:01.717+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:01.820 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:01.817+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:01.887 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:01.887 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:01.887 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:01.887 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:01.901 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:01.921 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:01.917+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:02.022 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:02.021+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:02.071 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:02.071 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:02.071 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:02.085 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:02.122 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:02.121+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:02.206 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:02.206 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:02.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:02.206 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:02.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.498231152999999, 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:55:02.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.488081805, 2024-05-10T09:55:02.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:55:02.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.518213188000001, 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:55:02.219 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:55:02.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.490156491, 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.226 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:55:02.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.475785381, 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.232 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:55:02.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:55:02.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:02.238 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.473099202, 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:02.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:55:02.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.378192008999999, 2024-05-10T09:55:02.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:55:02.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.458621794000001, 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.249 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:55:02.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:55:02.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.414891710999999, 2024-05-10T09:55:02.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:55:02.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:55:02.257 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.400278564000001, 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.258 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:55:02.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.262 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.325549003999999, 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.307402640999999, 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.267 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:55:02.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:55:02.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.272648121, 2024-05-10T09:55:02.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:55:02.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:55:02.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.271573909000001, 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.276 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:55:02.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.280 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.271081798000001, 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:55:02.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.269032208, 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.262787689, 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.259573264, 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.293 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:55:02.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.258399826, 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:55:02.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:02.302 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.207049448999999, 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:55:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:55:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.307 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.307 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:02.307 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:55:02.309 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:02.310 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:02.305+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:02.410 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:02.409+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:02.436 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:02.436 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:02.437 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:02.437 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:02.451 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:02.537 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:02.537+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:02.610 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:02.609+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:02.617 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:02.618 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:02.631 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:02.717 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:02.717+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:02.794 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.256152081000003, 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.795 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:02.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:55:02.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:55:02.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:55:02.801 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.443050540000002, 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.802 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:02.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:55:02.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:55:02.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.442921663999996, 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.808 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:55:02.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:55:02.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:55:02.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.442772324000003, 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.814 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:02.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:55:02.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.333701863999998, 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:55:02.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:55:02.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:55:02.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.333059405, 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:55:02.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332939295999999, 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:55:02.831 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.836 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332670335000003, 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:55:02.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:55:02.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:02.842 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332607682000003, 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:55:02.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:55:02.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:55:02.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332551375999998, 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.848 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:02.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.853 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332358534000001, 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.854 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:55:02.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332318364000002, 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.860 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:55:02.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:55:02.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:55:02.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332233137999999, 2024-05-10T09:55:02.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:55:02.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:55:02.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332040882999998, 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.871 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:55:02.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.876 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.332004570000002, 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:55:02.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:55:02.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.079567007000001, 2024-05-10T09:55:02.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.887 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.07945196, 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:55:02.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:02.893 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.079411096000001, 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:55:02.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:55:02.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:55:02.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:55:02.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.079372030999998, 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.899 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.904 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.079245808000003, 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:55:02.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:55:02.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.910 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.911 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:02.911 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:02.911 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:02.912 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:02.913 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:02.913+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:03.013 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:03.013+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:03.044 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:03.045 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:03.045 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:03.045 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:03.058 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:03.114 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:03.113+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:03.184 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:03.184 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:03.184 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:03.184 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:03.184 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:03.198 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:03.246 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:03.245+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:03.272 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:55:03.315 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:03.313+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.980876479000003, 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.335 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:55:03.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:55:03.339 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.605014263999999, 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.340 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:03.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:55:03.345 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.582391195, 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.346 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:55:03.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:55:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.53992792, 2024-05-10T09:55:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:55:03.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:55:03.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.525291490000001, 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.359 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.364 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.495790578999999, 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:55:03.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:55:03.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:55:03.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.370 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.477511332000001, 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:55:03.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:55:03.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:55:03.376 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.424647488, 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.377 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:55:03.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.380 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:03.383 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.383890466, 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:03.384 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.385 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:506 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.37042975, 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027186609999999998, 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.389 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 506 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961837+0000", 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0400000000000005e-07 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961842+0000", 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5520000000000004e-06 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961854+0000", 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1759999999999999e-05 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961859+0000", 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2909999999999998e-06 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961899+0000", 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0346000000000003e-05 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961957+0000", 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7157999999999997e-05 2024-05-10T09:55:03.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962087+0000", 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013084699999999999 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962586+0000", 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049860699999999998 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964481+0000", 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001895126 2024-05-10T09:55:03.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964523+0000", 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1965000000000002e-05 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964554+0000", 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1105000000000001e-05 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.394 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.349656830000001, 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:55:03.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:55:03.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:03.400 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.343829746000001, 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:55:03.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.406 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.312872492, 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:03.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:55:03.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:03.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:55:03.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.296662455, 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.413 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:55:03.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:55:03.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:55:03.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.418 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.219004496, 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:55:03.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.424 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.218870567, 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:55:03.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.430 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.184563348999999, 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:55:03.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:55:03.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:55:03.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.180704329999999, 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.436 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:03.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:55:03.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:55:03.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.441 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 11.949740672000001, 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:03.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 11.769538539999999, 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:03.448 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:55:03.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:55:03.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:55:03.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:03.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:03.453 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:03.455 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:03.455 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:03.453+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:03.546 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:03.590 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:03.589+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:03.630 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:03.630 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:03.630 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:03.630 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:03.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:03.689 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:03.689 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:03.690 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:03.689+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:03.709 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:03.709 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:03.728 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:03.728 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:03.745 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:03.745 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:03.756 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:03.753+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:03.766 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:03.766 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:03.788 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:03.788 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:03.809 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:03.809 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:03.810 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:03.810 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:03.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:03.832 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:03.832 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:03.898 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:03.897+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:03.949 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:03.949 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:03.958 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:03.957+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:03.965 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:04.060 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:04.057+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:04.127 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:04.127 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:04.142 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:04.190 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:04.189+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:04.261 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:04.261+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:04.270 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:04.270 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:04.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:04.370 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:04.369+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:04.453 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:04.453 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:04.463 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:04.461+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:04.468 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:04.564 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:04.561+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:04.645 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:04.645 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:04.658 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:04.706 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:04.705+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:04.766 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:04.765+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:04.778 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:04.778 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:04.793 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:04.868 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:04.865+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:04.960 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:04.960 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:04.969 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:04.965+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:04.976 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:05.070 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:05.069+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:05.106 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:05.106 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:05.120 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:05.170 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:05.169+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:05.243 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:05.243 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:05.259 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:05.271 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:05.269+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:05.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:55:05.372 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:05.369+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:05.424 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:05.424 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:05.438 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:05.485 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:05.485+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:05.562 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:05.562 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:05.574 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:05.573+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:05.576 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:05.674 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:05.673+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:05.741 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:05.741 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:05.755 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:05.775 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:05.773+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:05.851 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:05.898 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:05.897+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:05.919 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:05.919 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:05.932 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:05.978 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:05.977+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:06.013 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:06.014 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:06.031 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:06.031 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:06.051 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:06.051 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:06.051 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:06.051 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:06.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:06.068 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:06.068 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:06.088 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:06.089 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:06.109 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:06.109 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:06.113 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:06.113+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:06.130 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:06.130 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:06.152 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:06.152 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:06.214 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:06.213+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:06.238 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:06.238 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:06.238 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:06.238 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:06.238 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:06.252 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:06.283 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:06.281+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:06.295 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:55:06.382 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 22.674240298000001, 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:55:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:55:06.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:06.389 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 22.664090949999999, 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:55:06.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.395 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.694222332999999, 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:55:06.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:55:06.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:55:06.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.402 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.666165635999999, 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:55:06.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:55:06.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:55:06.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.651794526, 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:55:06.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:55:06.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:55:06.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.414 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.649108346999999, 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:06.415 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:55:06.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:55:06.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:55:06.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.554201154000001, 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.421 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.425 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.634630939000001, 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:55:06.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.590900855999999, 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:55:06.430 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:55:06.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.434 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.576287709000001, 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:55:06.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.501558148999999, 2024-05-10T09:55:06.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:55:06.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.483411786, 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:55:06.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:55:06.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.448657266, 2024-05-10T09:55:06.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:06.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:55:06.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:55:06.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.447583054000001, 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:55:06.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:55:06.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:55:06.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.447090942999999, 2024-05-10T09:55:06.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:55:06.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:55:06.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.445041353000001, 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.462 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:55:06.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.438796834, 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:55:06.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:55:06.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.435582409, 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.471 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:55:06.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.434408971, 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:55:06.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.383058594, 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.480 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:55:06.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:55:06.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.485 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.485 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:06.486 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:06.490 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:06.485+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:06.587 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:06.585+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:06.616 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:06.616 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:06.616 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:06.616 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:06.629 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:06.689 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:06.685+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:06.752 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:06.752 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:06.752 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:06.753 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:06.753 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:06.766 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:06.790 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:06.789+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:06.887 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:06.887 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.348800421, 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.888 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:55:06.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:06.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:55:06.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:55:06.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.894 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.535698879999998, 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.895 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:55:06.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:55:06.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.900 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.535570004, 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.535420664, 2024-05-10T09:55:06.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:55:06.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.426350204000002, 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:55:06.912 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:55:06.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:55:06.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.425707744999997, 2024-05-10T09:55:06.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:06.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:55:06.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:55:06.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:06.924 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.425587636000003, 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:55:06.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.425318675, 2024-05-10T09:55:06.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:55:06.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.425256021999999, 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.936 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:06.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:55:06.941 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.425199716000002, 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.942 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:06.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:55:06.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.425006873999997, 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.948 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:06.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:55:06.953 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.424966703999999, 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.954 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:55:06.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:55:06.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.959 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.424881478000003, 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.960 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:55:06.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:55:06.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.424689223000001, 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:55:06.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.971 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.424652909999999, 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:55:06.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:55:06.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:55:06.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.172215346999998, 2024-05-10T09:55:06.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:06.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:55:06.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:06.983 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.172100299999997, 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:06.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:55:06.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.989 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.172059435999998, 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:55:06.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:55:06.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:06.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:06.995 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.172020371000002, 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:06.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:06.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.001 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.171894148, 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:07.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:55:07.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:55:07.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:07.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:07.008 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:07.008 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:07.009 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:07.009+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:07.009 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:07.110 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:07.109+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:07.147 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:07.147 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:07.147 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:07.147 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:07.161 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:07.211 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:07.209+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:07.289 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:07.289 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:07.289 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:07.289 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:07.289 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:07.305 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:07.312 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:07.309+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:07.413 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:07.409+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:07.479 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:07.479 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.125791585999998, 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:55:07.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.484 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.749929371, 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:55:07.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.490 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.727306301999999, 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:55:07.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.684843026999999, 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:07.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:55:07.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.670206597, 2024-05-10T09:55:07.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:55:07.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:55:07.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.640705686, 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:55:07.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:55:07.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.622426439000002, 2024-05-10T09:55:07.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:07.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:55:07.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:07.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.521 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.569562595000001, 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.522 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:55:07.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:55:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.528805573, 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:55:07.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:55:07.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:55:07.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:506 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.515344856999999, 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027186609999999998, 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.533 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 506 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961837+0000", 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0400000000000005e-07 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961842+0000", 2024-05-10T09:55:07.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5520000000000004e-06 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961854+0000", 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1759999999999999e-05 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961859+0000", 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2909999999999998e-06 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961899+0000", 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0346000000000003e-05 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961957+0000", 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7157999999999997e-05 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962087+0000", 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013084699999999999 2024-05-10T09:55:07.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962586+0000", 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049860699999999998 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964481+0000", 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001895126 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964523+0000", 2024-05-10T09:55:07.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1965000000000002e-05 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964554+0000", 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1105000000000001e-05 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.494571937, 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.539 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:55:07.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:55:07.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.488744853, 2024-05-10T09:55:07.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:55:07.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:55:07.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:55:07.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.457787599, 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.551 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:55:07.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:55:07.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:55:07.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:55:07.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:55:07.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.441577561999999, 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:55:07.558 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:55:07.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:55:07.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.363919602999999, 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:55:07.564 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:55:07.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:55:07.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:55:07.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.570 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.363785673999999, 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:55:07.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.576 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.329478456, 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.577 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:55:07.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:55:07.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.325619437, 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.583 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:55:07.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.094655779, 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:55:07.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:55:07.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.594 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.914453647, 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.595 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:55:07.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:07.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:07.600 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:07.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:07.602 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:07.601+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:07.703 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:07.701+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:07.778 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:07.778 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:07.778 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:07.778 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:07.793 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:07.803 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:07.801+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:07.904 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:07.901+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:07.920 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:07.920 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:07.920 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:07.920 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:07.920 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:07.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:08.022 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:08.021+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:08.106 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:08.105+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:08.111 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.461671963000001, 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:08.112 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:08.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:08.117 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.277687937, 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:08.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:55:08.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:55:08.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:55:08.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:55:08.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:55:08.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.125 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.374007507000002, 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:55:08.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:55:08.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:08.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.132 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.339292293, 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:55:08.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:55:08.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:08.138 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.312910313, 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:55:08.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:55:08.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.294880241000001, 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:55:08.144 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:55:08.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:55:08.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.150 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.261217970000001, 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:55:08.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:55:08.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:55:08.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:55:08.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.230489467999998, 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.156 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.177136657999998, 2024-05-10T09:55:08.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:08.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:55:08.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.001938037999999, 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:55:08.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.173 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.912462742999999, 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:55:08.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:55:08.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:55:08.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.179 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.868069220999999, 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:55:08.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.795266254000001, 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.185 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:55:08.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.763376323999999, 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:55:08.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.193 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:08.197 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.758591043999999, 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:55:08.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:55:08.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.202 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:08.203 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.677865267000001, 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:55:08.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:55:08.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.208 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.673823482, 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.209 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:55:08.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:55:08.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.214 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.517534223999998, 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.215 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.220 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.513197100999999, 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:55:08.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:55:08.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:55:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:55:08.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:08.226 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.445338442000001, 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:08.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:08.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:08.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:08.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:55:08.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:55:08.232 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.232 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.232 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.232 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:08.232 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:08.232 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:08.232 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:08.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:08.235 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:08.233+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:08.324 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:55:08.334 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:08.333+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:08.403 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:08.404 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:08.404 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:08.404 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:08.425 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:08.435 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:08.433+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:08.437 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:08.437 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:08.457 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:08.457 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:08.477 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:08.494 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:08.494 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:08.516 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:08.516 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:08.536 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:08.532+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:08.537 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:08.537 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:08.544 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:08.544 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:08.558 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:08.558 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:08.559 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:08.578 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:08.579 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:08.646 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:08.644+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:08.694 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:08.694 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:08.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:08.750 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:08.748+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:08.840 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:08.836+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:08.877 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:08.878 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:08.892 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:08.941 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:08.937+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:09.041 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:09.036+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:09.062 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:09.062 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:09.077 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:09.143 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:09.141+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:09.244 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:09.241+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:09.248 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:09.248 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:09.262 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:09.303 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:55:09.345 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:09.341+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:09.396 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:09.397 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:09.410 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:09.445 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:09.440+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:09.546 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:09.544+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:09.574 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:09.574 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:09.588 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:09.647 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:09.645+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:09.716 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:09.730 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:09.749 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:09.744+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:09.849 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:09.849+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:09.898 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:09.898 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:09.912 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:09.949 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:09.944+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:10.050 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:10.049+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:10.078 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:10.079 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:10.092 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:10.181 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:10.181+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:10.253 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:10.252+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:10.263 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:10.263 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:10.277 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:10.354 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:10.352+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:10.447 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:10.447 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:10.455 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:10.452+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:10.461 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:10.556 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:10.553+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:10.582 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:10.582 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:10.596 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:10.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:10.685 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:10.685+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:10.758 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:10.758 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:10.758 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:10.757+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:10.762 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:10.762 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:10.775 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:10.775 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:10.776 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:10.792 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:10.792 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:10.810 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:10.810 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:10.830 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:10.831 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:10.852 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:10.853 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:10.861 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:10.861+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:10.875 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:10.875 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:10.897 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:10.897 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:10.942 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:10.942 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:10.942 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:10.942 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:10.956 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:10.960 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:10.956+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:11.061 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:11.061+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:11.120 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:11.120 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:11.120 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:11.120 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:11.120 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:11.134 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:11.177 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:11.177+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:11.263 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:11.261+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:11.307 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:11.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.768402244000001, 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:55:11.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:55:11.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:55:11.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:55:11.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:55:11.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.955300702999999, 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.315 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:55:11.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:55:11.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:55:11.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.955171827000001, 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:55:11.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:55:11.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:55:11.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.955022487000001, 2024-05-10T09:55:11.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:55:11.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:55:11.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.845952027000003, 2024-05-10T09:55:11.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:55:11.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:55:11.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.845309567999998, 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:11.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:55:11.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:55:11.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:55:11.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:55:11.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:55:11.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:55:11.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:55:11.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:55:11.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:55:11.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:55:11.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:55:11.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:55:11.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:55:11.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:55:11.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:55:11.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:55:11.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:55:11.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:55:11.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.348 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.845189458999997, 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:55:11.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.354 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.844920498, 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.355 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:55:11.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:55:11.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.844857845, 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:11.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:55:11.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:55:11.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:55:11.366 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.844801539000002, 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.367 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:55:11.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:55:11.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.844608696999998, 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:11.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:55:11.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.844568527, 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:55:11.380 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.844483300999997, 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.387 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:55:11.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:55:11.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.844291046000002, 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.393 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:11.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:55:11.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.844254733, 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.399 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.400 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.400 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:55:11.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.400 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:55:11.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:55:11.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.591817169999999, 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.406 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:55:11.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:55:11.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:55:11.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:55:11.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:11.412 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.591702122999997, 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:55:11.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:55:11.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.418 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.591661258999999, 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:55:11.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:55:11.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.591622194000003, 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.425 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:11.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:55:11.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:55:11.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:55:11.431 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.431 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.431 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.591495971000001, 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:11.432 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:11.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:11.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:11.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:11.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:55:11.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:55:11.438 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.438 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.438 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.438 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:11.438 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:11.438 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:11.438 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:55:11.440 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:11.437+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:11.441 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:11.541 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:11.541+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:11.570 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:11.570 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:11.570 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:11.570 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:11.589 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:11.642 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:11.641+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:11.710 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:11.710 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:11.710 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:11.710 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:11.710 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:11.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:11.743 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:11.741+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:11.844 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:11.841+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:11.853 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.499694368, 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.854 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:55:11.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:11.858 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.123832152999999, 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:55:11.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.101209084000001, 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.864 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:11.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:55:11.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:55:11.870 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.058745809000001, 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.871 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:55:11.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.874 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:55:11.876 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.044109378999998, 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.877 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:11.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:55:11.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.014608467999999, 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:55:11.883 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:11.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:55:11.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.996329221, 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.889 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.890 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:55:11.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:55:11.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:55:11.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.943465376999999, 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.895 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:55:11.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:55:11.900 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.902708355000001, 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.901 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:506 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.906 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.889247639000001, 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027186609999999998, 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 506 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:11.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961837+0000", 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0400000000000005e-07 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961842+0000", 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5520000000000004e-06 2024-05-10T09:55:11.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961854+0000", 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1759999999999999e-05 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961859+0000", 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2909999999999998e-06 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961899+0000", 2024-05-10T09:55:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0346000000000003e-05 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961957+0000", 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7157999999999997e-05 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962087+0000", 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013084699999999999 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962586+0000", 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049860699999999998 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964481+0000", 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001895126 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964523+0000", 2024-05-10T09:55:11.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1965000000000002e-05 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964554+0000", 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1105000000000001e-05 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.868474718999998, 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.913 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:55:11.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:55:11.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:55:11.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:55:11.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.862647634999998, 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:55:11.918 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.920 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:55:11.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.922 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.923 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.831690381000001, 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.924 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:11.925 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.926 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:55:11.929 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.815480344000001, 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.930 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:55:11.935 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.737822385000001, 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.936 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.937 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:55:11.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:55:11.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.941 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.737688456000001, 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:55:11.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:55:11.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:55:11.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:55:11.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:11.947 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.703381237999999, 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:55:11.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:55:11.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.699522218999999, 2024-05-10T09:55:11.953 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.468558560999998, 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.959 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.960 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:55:11.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:55:11.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:55:11.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.288356429, 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:11.965 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:11.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:55:11.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:55:11.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:55:11.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.970 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:11.971 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:11.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:11.973 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:11.972+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:12.074 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:12.068+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:12.146 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:12.147 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:12.147 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:12.147 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:12.161 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:12.202 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:12.200+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:12.275 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:12.273+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:12.323 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:55:12.326 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:12.326 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:12.327 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:12.327 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:12.327 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:12.343 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:12.376 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:12.373+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:12.464 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:12.464 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:12.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:12.464 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:12.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.464 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:12.464 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:12.464 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.813555726000001, 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.465 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:55:12.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:12.471 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.6295717, 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:55:12.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:55:12.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.725891269999998, 2024-05-10T09:55:12.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:55:12.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.484 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.691176056, 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.485 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:55:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:55:12.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.491 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.664794076, 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:55:12.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.497 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.646764004000001, 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.498 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:55:12.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:55:12.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:55:12.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:55:12.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:55:12.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:55:12.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:55:12.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:55:12.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:55:12.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:55:12.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:55:12.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:55:12.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:55:12.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:55:12.506 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.506 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.506 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.506 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.506 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:12.506 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.613101733000001, 2024-05-10T09:55:12.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:55:12.507 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.507 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.507 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.507 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.507 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:55:12.513 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.582373230999998, 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.514 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:12.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:55:12.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:55:12.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.529020420999998, 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:55:12.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.526 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.353821800999999, 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.527 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:55:12.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:55:12.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:55:12.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:55:12.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:55:12.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:55:12.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:55:12.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:55:12.533 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.534 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.534 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.534 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.534 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:12.534 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.264346505999999, 2024-05-10T09:55:12.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:55:12.535 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.535 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.535 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.535 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.535 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.536 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.536 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:55:12.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.536 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:12.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:55:12.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:55:12.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:55:12.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:55:12.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:55:12.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:55:12.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:55:12.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:55:12.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:55:12.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:55:12.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:55:12.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:55:12.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:55:12.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.219952983999999, 2024-05-10T09:55:12.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:55:12.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:55:12.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.147150017000001, 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:55:12.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:55:12.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:55:12.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:55:12.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:55:12.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.115260086999999, 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:55:12.558 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:55:12.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.110474806999999, 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.565 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:55:12.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:55:12.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:55:12.570 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.029749030000001, 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:55:12.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.577 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.578 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:12.578 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.025707245, 2024-05-10T09:55:12.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:55:12.578 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.578 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.578 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.578 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:12.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:55:12.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:55:12.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.869417986999999, 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.585 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:55:12.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.865080863999999, 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.591 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:55:12.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:55:12.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:55:12.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:55:12.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.797222205000001, 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:12.597 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:12.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:12.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:55:12.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:12.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:12.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:12.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:12.605 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:12.600+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:12.705 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:12.700+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:12.781 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:12.782 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:12.782 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:12.782 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:12.796 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:12.806 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:12.805+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:12.907 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:12.905+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:12.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:12.963 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:12.964 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:12.964 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:12.964 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:12.964 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:12.977 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:13.008 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:13.005+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:13.090 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:13.090 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:13.108 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:13.104+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:13.122 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:13.123 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:13.124 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:13.124 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:13.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:13.124 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:13.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.124 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.399416905999999, 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.125 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:55:13.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:13.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:13.130 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.398947833000001, 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:55:13.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:55:13.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:55:13.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:55:13.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.264689665999999, 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:55:13.136 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.251262351000001, 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.143 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:55:13.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:55:13.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.148 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.904615466999999, 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.149 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:55:13.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:55:13.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.900676691000001, 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.155 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:13.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:55:13.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:55:13.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:55:13.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:55:13.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:55:13.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.162 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.861735460999999, 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:55:13.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:55:13.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:55:13.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:55:13.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:55:13.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.726443880000001, 2024-05-10T09:55:13.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:13.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:55:13.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:13.175 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.722684780000002, 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:55:13.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.181 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.671257252, 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:55:13.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:55:13.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.667662109999998, 2024-05-10T09:55:13.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:55:13.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:55:13.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.657802144000001, 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.193 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:55:13.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.199 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.610185991000002, 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:13.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.204 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.205 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.606088206999999, 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:55:13.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:55:13.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.211 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.517159711000001, 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:55:13.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.217 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.512224078999999, 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:55:13.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:55:13.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.419062431, 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:55:13.223 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:55:13.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:55:13.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.228 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.414861912999999, 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:55:13.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.232 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.234 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.405004717000001, 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:55:13.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:55:13.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.238 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.400335186, 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.241 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:13.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:55:13.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:13.246 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:13.247 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:13.248 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:13.249 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:13.249 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:13.250 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:13.250 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:13.250 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:13.251 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:13.251 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:13.251 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:13.252 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:13.244+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:13.252 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:13.252 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:13.349 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:13.349+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:13.391 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:13.391 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:13.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:13.450 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:13.448+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:13.534 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:13.534 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:13.549 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:13.591 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:13.588+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:13.652 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:13.649+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:13.723 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:13.723 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:13.738 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:13.753 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:13.748+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:13.855 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:13.853+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:13.870 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:13.870 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:13.884 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:13.955 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:13.952+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:14.049 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:14.049 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:14.056 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:14.052+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:14.063 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:14.157 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:14.157+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:14.181 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:14.181 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:14.196 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:14.281 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:14.281+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:14.347 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:55:14.358 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:14.358 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:14.359 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:14.357+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:14.372 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:14.459 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:14.457+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:14.531 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:14.531 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:14.545 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:14.560 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:14.556+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:14.661 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:14.656+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:14.710 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:14.710 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:14.724 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:14.773 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:14.773+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:14.847 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:14.847 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:14.861 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:14.905 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:14.905+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:14.984 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:14.980+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:15.022 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:15.022 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:15.036 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:15.085 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:15.080+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:15.159 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:15.159 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:15.174 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:15.221 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:15.221+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:15.270 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:15.287 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:15.285+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:15.298 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:15.298 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:15.312 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:15.320 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:55:15.388 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:15.384+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:15.433 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:15.434 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:15.450 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:15.451 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:15.467 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:15.467 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:15.475 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:15.475 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:15.484 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:15.485 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:15.489 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:15.484+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:15.490 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:15.504 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:15.504 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:15.523 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:15.523 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:15.541 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:15.542 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:15.561 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:15.562 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:15.590 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:15.589+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:15.609 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:15.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.072989429000003, 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.610 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:55:15.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:55:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:55:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:55:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:55:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:55:15.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:55:15.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.259887888000002, 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.620 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:55:15.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:55:15.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.259759012000004, 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.626 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.259609672000003, 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.632 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:55:15.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.150539211999998, 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:55:15.638 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:15.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:55:15.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:55:15.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.149896753, 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:15.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:55:15.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:55:15.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:55:15.650 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.149776643999999, 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.651 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:55:15.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:55:15.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.149507683000003, 2024-05-10T09:55:15.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:55:15.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.149445030000003, 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:15.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:55:15.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:55:15.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.669 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.149388723999998, 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.670 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:55:15.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.149195882000001, 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.676 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:55:15.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.149155712000002, 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.682 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:55:15.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:55:15.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:55:15.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:15.688 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.149070485999999, 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:15.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:55:15.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:55:15.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:15.694 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.148878230999998, 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:15.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.148841918000002, 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:55:15.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:55:15.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:55:15.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.896404355000001, 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:55:15.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:55:15.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.896289308, 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:55:15.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.896248444000001, 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:55:15.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:55:15.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:55:15.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.896209378999998, 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:55:15.725 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:55:15.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:55:15.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:15.731 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 46.896083156000003, 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:55:15.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:15.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:15.737 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:15.739 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:15.740 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:15.737+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:15.840 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:15.841+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:15.875 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:15.890 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:15.941 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:15.936+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:16.009 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:16.009 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:16.009 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:16.026 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:16.042 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:16.041+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:16.143 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:16.140+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.840451794000003, 2024-05-10T09:55:16.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:55:16.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:55:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:55:16.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:55:16.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.464589578999998, 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.201 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:55:16.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.44196651, 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.207 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:55:16.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.213 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.399503235000001, 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:55:16.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:55:16.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:55:16.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.219 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.384866805000001, 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:55:16.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.225 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.355365893999998, 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.226 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:55:16.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:55:16.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.337086647, 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.232 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:55:16.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:55:16.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:55:16.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.284222802999999, 2024-05-10T09:55:16.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:55:16.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:55:16.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:55:16.242 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.243465781000001, 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.243 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:55:16.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:55:16.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:55:16.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:506 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.230005065, 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027186609999999998, 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 506 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.249 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961837+0000", 2024-05-10T09:55:16.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0400000000000005e-07 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961842+0000", 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5520000000000004e-06 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961854+0000", 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1759999999999999e-05 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961859+0000", 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2909999999999998e-06 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961899+0000", 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0346000000000003e-05 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961957+0000", 2024-05-10T09:55:16.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7157999999999997e-05 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962087+0000", 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013084699999999999 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962586+0000", 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049860699999999998 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964481+0000", 2024-05-10T09:55:16.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001895126 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964523+0000", 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1965000000000002e-05 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964554+0000", 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1105000000000001e-05 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.209232145000001, 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.255 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:55:16.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:55:16.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.203405061000002, 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:55:16.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:55:16.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.266 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.172447807000001, 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:55:16.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:55:16.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:16.272 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.156237770000001, 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:16.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:55:16.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:55:16.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:16.278 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.078579811000001, 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:16.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:55:16.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:55:16.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:16.284 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.078445882, 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:16.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.044138663999998, 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:55:16.290 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:55:16.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:55:16.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.040279644999998, 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:55:16.296 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:55:16.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.809315987000002, 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.302 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:55:16.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.629113855, 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.310 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:55:16.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:55:16.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:55:16.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:55:16.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.316 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.316 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.316 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:16.317 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:16.318 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:16.316+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:16.418 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:16.416+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:16.451 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:16.451 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:16.451 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:16.451 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:16.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:16.519 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:16.516+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:16.591 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:16.592 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:16.592 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:16.592 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:16.592 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:16.606 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:16.620 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:16.616+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:16.721 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:16.716+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:16.737 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:16.737 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:16.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:16.737 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:16.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.737 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:16.737 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:16.737 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.087500063, 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:55:16.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.903516036999999, 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:55:16.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.999835607000001, 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.749 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:55:16.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:55:16.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:55:16.755 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.965120392999999, 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.756 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:55:16.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:55:16.761 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.938738412999999, 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.762 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:55:16.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:55:16.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:55:16.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.920708341000001, 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.768 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.769 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:55:16.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:55:16.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.773 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.88704607, 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.774 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.775 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:55:16.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.778 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.856317568000001, 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.780 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:55:16.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:55:16.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:55:16.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:55:16.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.802964758000002, 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.786 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:55:16.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.791 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.627766137999998, 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:55:16.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:55:16.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:55:16.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.797 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.538290842999999, 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.798 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:55:16.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.803 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.493897320999999, 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:55:16.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:55:16.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:55:16.809 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.421094354000001, 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.810 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:16.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.815 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.389204423999999, 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:55:16.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:55:16.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:16.821 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.384419143999999, 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:55:16.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:16.827 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.303693367000001, 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:16.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:55:16.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.299651581999999, 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:55:16.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.839 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.143362324000002, 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:16.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:55:16.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:55:16.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:55:16.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.139025200999999, 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:55:16.845 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:55:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:55:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.071166542, 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:55:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:55:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:55:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:55:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:16.857 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:16.858 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:16.859 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:16.856+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:16.959 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:16.956+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:17.032 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:17.032 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:17.032 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:17.033 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:17.047 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:17.060 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:17.060+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:17.161 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:17.156+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:17.167 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:17.167 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:17.167 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:17.167 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:17.167 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:17.183 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:17.261 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:17.256+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:17.311 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:17.311 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:17.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:17.311 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:17.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.584755811999997, 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:55:17.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:55:17.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:55:17.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:55:17.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.584286738999999, 2024-05-10T09:55:17.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:17.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:55:17.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:55:17.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:55:17.325 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.325 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 26.450028572000001, 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.326 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:55:17.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:55:17.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 26.436601257, 2024-05-10T09:55:17.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:55:17.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 26.089954373000001, 2024-05-10T09:55:17.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 26.086015596999999, 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.344 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:55:17.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:55:17.350 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 26.047074367, 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.351 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:55:17.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:55:17.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.911782786, 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.357 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:55:17.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:55:17.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:55:17.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.908023686, 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.363 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:55:17.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:55:17.368 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.856596157999999, 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.369 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:55:17.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:55:17.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:55:17.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.853001016, 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:55:17.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:55:17.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.84314105, 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.381 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:55:17.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:55:17.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:17.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.386 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.795524897, 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:55:17.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.791427113000001, 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:55:17.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.702498617, 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:55:17.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:55:17.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.404 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.697562985000001, 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:55:17.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:55:17.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:55:17.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:55:17.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.604401336999999, 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:55:17.410 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:55:17.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.416 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.600200819000001, 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:55:17.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.422 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.590343622999999, 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:55:17.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.428 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.585674092000001, 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:55:17.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:17.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:17.434 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:17.435 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:17.435 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:55:17.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:17.437 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:17.436+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:17.537 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:17.532+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:17.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:17.611 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:17.612 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:17.612 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:17.612 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:17.628 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:17.638 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:17.636+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:17.734 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:17.734 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:17.739 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:17.736+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:17.751 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:17.751 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:17.768 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:17.768 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:17.785 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:17.785 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:17.790 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:17.790 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:17.805 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:17.805 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:17.806 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:17.827 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:17.827 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:17.840 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:17.836+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:17.848 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:17.848 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:17.869 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:17.869 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:17.924 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:17.924 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:17.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:17.940 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:17.936+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:18.041 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:18.036+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:18.072 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:18.072 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:18.086 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:18.143 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:18.140+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:18.209 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:18.210 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:18.225 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:18.244 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:18.240+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:18.348 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:18.344+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:18.349 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:55:18.398 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:18.398 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:18.412 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:18.454 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:18.452+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:18.546 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:18.544+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:18.576 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:18.576 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:18.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:18.681 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:18.680+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:18.748 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:18.744+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:18.758 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:18.758 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:18.772 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:18.849 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:18.844+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:18.937 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:18.937 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:18.951 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:18.951 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:18.948+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:19.051 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:19.048+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:19.073 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:19.073 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:19.089 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:19.152 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:19.148+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:19.214 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:19.214 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:19.228 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:19.270 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:19.268+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:19.353 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:19.348+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:19.393 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:19.394 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:19.408 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:19.457 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:19.456+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:19.535 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:19.535 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:19.550 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:19.594 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:19.592+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:19.656 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:19.652+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:19.715 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:19.715 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:19.730 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:19.757 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:19.752+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:19.858 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:19.856+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:19.887 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:19.895 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:19.895 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:19.909 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:19.960 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:19.956+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:20.061 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:20.060+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:20.065 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:20.065 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:20.078 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:20.078 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:20.078 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:20.078 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:20.084 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:20.085 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:20.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:20.102 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:20.102 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:20.119 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:20.119 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:20.139 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:20.139 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:20.159 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:20.160 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:20.162 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:20.160+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:20.180 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:20.181 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:20.204 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:20.204 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:20.213 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:20.213 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:20.213 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:20.213 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:20.213 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:20.229 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:20.270 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:20.268+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:20.364 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:20.360+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:20.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:55:20.401 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:20.401 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:20.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:20.401 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:20.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.401 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.048515459000001, 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:20.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.672653243999999, 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.407 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:55:20.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:20.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.412 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.650030175000001, 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.413 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:55:20.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:55:20.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:55:20.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:20.419 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.607566899999998, 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:55:20.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.592930469999999, 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.425 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:20.430 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.563429558999999, 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.545150312000001, 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:55:20.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:55:20.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.492286468, 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:55:20.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:55:20.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:55:20.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.451529445999999, 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:55:20.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:506 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.438068730000001, 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027186609999999998, 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.453 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 506 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961836+0000", 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961837+0000", 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0400000000000005e-07 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961842+0000", 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5520000000000004e-06 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961854+0000", 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1759999999999999e-05 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961859+0000", 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2909999999999998e-06 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961899+0000", 2024-05-10T09:55:20.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0346000000000003e-05 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.961957+0000", 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7157999999999997e-05 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962087+0000", 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013084699999999999 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.962586+0000", 2024-05-10T09:55:20.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049860699999999998 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964481+0000", 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001895126 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964523+0000", 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1965000000000002e-05 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.964554+0000", 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1105000000000001e-05 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.417295809999999, 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:55:20.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.464 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.411468725999999, 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:55:20.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:55:20.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.380511471999998, 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:55:20.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.364301435000002, 2024-05-10T09:55:20.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:55:20.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.286643475999998, 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:20.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:55:20.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.286509547000001, 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:55:20.488 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:55:20.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:55:20.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.493 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.252202328999999, 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:55:20.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:55:20.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:55:20.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:55:20.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.248343309999999, 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.499 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:55:20.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:55:20.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:55:20.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.505 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.017379651999999, 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.511 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.837177520000001, 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:20.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:55:20.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:20.517 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:20.518 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:20.519 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:20.519 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:20.516+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:20.620 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:20.620+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:20.681 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:20.681 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:20.681 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:20.681 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:20.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:20.742 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:20.740+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:20.812 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:20.812 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:20.812 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:20.812 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:20.812 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:20.822 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:20.816+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:20.827 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:20.922 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:20.920+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:21.003 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:21.003 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:21.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:21.003 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:21.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.352637182999999, 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:55:21.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:21.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.009 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.168653157000001, 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.010 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:55:21.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:55:21.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:55:21.015 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.264972727, 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.016 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:55:21.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:55:21.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:55:21.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.230257513000002, 2024-05-10T09:55:21.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:21.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:55:21.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:55:21.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:55:21.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.203875533000001, 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:55:21.029 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:55:21.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.185845461, 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:55:21.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.041 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.152183189999999, 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:55:21.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:55:21.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.047 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.121454688, 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:21.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.053 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.068101878, 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:55:21.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:55:21.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:55:21.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.892903258, 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.059 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:21.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:55:21.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:55:21.064 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.803427963000001, 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.065 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:55:21.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.759034441000001, 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:55:21.071 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:55:21.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:55:21.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.686231474, 2024-05-10T09:55:21.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:21.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:55:21.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.654341544000001, 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.083 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:55:21.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.089 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.649556264000001, 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:55:21.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:55:21.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.568830487, 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.096 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:21.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:55:21.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.564788702000001, 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:55:21.102 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.408499444, 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.108 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:55:21.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:55:21.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.404162321000001, 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.114 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:55:21.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:55:21.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.336303661999999, 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:55:21.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:55:21.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:55:21.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.126 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.126 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:21.127 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:21.127 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:21.124+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:21.227 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:21.228+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:21.304 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:21.305 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:21.305 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:21.305 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:21.321 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:21.328 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:21.324+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:21.374 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:55:21.429 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:21.428+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:21.452 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:21.452 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:21.452 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:21.452 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:21.452 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:21.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:21.530 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:21.528+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.874029239999999, 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:55:21.601 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:21.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:55:21.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:21.607 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.873560167000001, 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:55:21.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:55:21.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:21.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.613 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.739301999999999, 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.614 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:55:21.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:55:21.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.621 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.725874685000001, 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.622 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:55:21.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.627 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.379227800999999, 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.628 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:55:21.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.375289025000001, 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.634 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:55:21.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:55:21.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:21.640 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.336347795000002, 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.641 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:55:21.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:55:21.646 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.201056214000001, 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.647 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:55:21.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:55:21.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.197297114000001, 2024-05-10T09:55:21.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:55:21.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.145869586, 2024-05-10T09:55:21.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:55:21.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:55:21.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.142274444000002, 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.665 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:55:21.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:55:21.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.132414478000001, 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.671 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:55:21.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:55:21.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.084798325000001, 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.677 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:55:21.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:55:21.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.080700540999999, 2024-05-10T09:55:21.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:55:21.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:55:21.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:21.689 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.991772045000001, 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:55:21.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:21.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.986836412999999, 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.893674765, 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.701 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:55:21.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:55:21.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.707 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.889474246999999, 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:55:21.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.713 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.879617051, 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:55:21.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:55:21.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:21.719 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 29.874947519999999, 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:21.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:55:21.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:55:21.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:21.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:21.725 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:21.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:21.727 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:21.724+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:21.827 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:21.828+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:21.903 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:21.904 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:21.904 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:21.904 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:21.918 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:21.962 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:21.960+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:22.029 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:22.024+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:22.039 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:22.039 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:22.040 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:22.040 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:22.040 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:22.054 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:22.143 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:22.140+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:22.224 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 36.545284324999997, 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086496530000000002, 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.229 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 44 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679869+0000", 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3719999999999999e-06 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679880+0000", 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0854e-05 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679902+0000", 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2464e-05 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679932+0000", 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9726999999999998e-05 2024-05-10T09:55:22.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680032+0000", 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010032299999999999 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680042+0000", 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3510000000000008e-06 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688283+0000", 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082418319999999993 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688516+0000", 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023273 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.494132023999999, 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035922279999999998, 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 207 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.235 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731022+0000", 2024-05-10T09:55:22.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7140000000000002e-06 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731035+0000", 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3339999999999999e-05 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731069+0000", 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4102e-05 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731086+0000", 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6889999999999999e-05 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731309+0000", 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022293599999999999 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731595+0000", 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028612400000000001 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.238 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.732083+0000", 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048802300000000003 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.733712+0000", 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001629339 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734464+0000", 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075213400000000001 2024-05-10T09:55:22.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734544+0000", 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9653000000000005e-05 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734611+0000", 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6972999999999997e-05 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.440348884999999, 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003743836, 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 216 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.241 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784805+0000", 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5730000000000002e-06 2024-05-10T09:55:22.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784817+0000", 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.277e-05 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784854+0000", 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6205999999999999e-05 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.243 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784873+0000", 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9749999999999999e-05 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785009+0000", 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013592300000000001 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785241+0000", 2024-05-10T09:55:22.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000232031 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785673+0000", 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043218999999999999 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.787225+0000", 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015515259999999999 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788269+0000", 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001043906 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788425+0000", 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155742 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788546+0000", 2024-05-10T09:55:22.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012121900000000001 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.400265445999999, 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034684479999999998, 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.247 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 227 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:22.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824888+0000", 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6960000000000001e-06 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824901+0000", 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3144e-05 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.249 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824932+0000", 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0273e-05 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824948+0000", 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6402999999999999e-05 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825065+0000", 2024-05-10T09:55:22.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011705300000000001 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825277+0000", 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021180099999999999 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825698+0000", 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042071399999999998 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.827222+0000", 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015247489999999999 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828074+0000", 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085207100000000003 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828231+0000", 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015675199999999999 2024-05-10T09:55:22.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828354+0000", 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012279200000000001 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.392171276999999, 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032440870000000001, 2024-05-10T09:55:22.253 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 229 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832982+0000", 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6429999999999999e-06 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832995+0000", 2024-05-10T09:55:22.255 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2979999999999999e-05 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833026+0000", 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0383e-05 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833041+0000", 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4922999999999999e-05 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833158+0000", 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011791299999999999 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833366+0000", 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020795500000000001 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833777+0000", 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000410331 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.835291+0000", 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015140329999999999 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836021+0000", 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00073029400000000004 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836105+0000", 2024-05-10T09:55:22.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3666999999999997e-05 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836224+0000", 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118965 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:22.259 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.384961781000001, 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034732550000000002, 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 231 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840191+0000", 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.996e-06 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840203+0000", 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1523e-05 2024-05-10T09:55:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840229+0000", 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6713e-05 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840244+0000", 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4243999999999999e-05 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840361+0000", 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011759199999999999 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840612+0000", 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025127500000000002 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.841027+0000", 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00041445099999999998 2024-05-10T09:55:22.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.842473+0000", 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001446536 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843387+0000", 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091381700000000004 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843543+0000", 2024-05-10T09:55:22.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155379 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843662+0000", 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011972900000000001 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:680 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.120615045000001, 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029268050000000002, 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 680 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:22.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104538+0000", 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4399999999999999e-06 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104552+0000", 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104589+0000", 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6671000000000002e-05 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104607+0000", 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7943000000000001e-05 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104729+0000", 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012238700000000001 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104918+0000", 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018902200000000001 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.105255+0000", 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033649500000000002 2024-05-10T09:55:22.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106322+0000", 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001067389 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107175+0000", 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085289000000000003 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107340+0000", 2024-05-10T09:55:22.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016486199999999999 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107463+0000", 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012261999999999999 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.035198389000001, 2024-05-10T09:55:22.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029077830000000002, 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 730 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:22.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189955+0000", 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1600000000000001e-06 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189966+0000", 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1739999999999999e-05 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189998+0000", 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1229999999999997e-05 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190012+0000", 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4769e-05 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190156+0000", 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014340300000000001 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190368+0000", 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000211895 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190680+0000", 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031250499999999998 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.191743+0000", 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010630749999999999 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192700+0000", 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095679700000000001 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192785+0000", 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5205999999999997e-05 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192860+0000", 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5003e-05 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.277 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.021591745999999, 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033316309999999998, 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.278 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 736 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:22.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203561+0000", 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3439999999999999e-06 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203573+0000", 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1996e-05 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203611+0000", 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7577000000000003e-05 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203626+0000", 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5217e-05 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203813+0000", 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018622499999999999 2024-05-10T09:55:22.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204026+0000", 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000213542 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204352+0000", 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032619799999999998 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.205489+0000", 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011368649999999999 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206609+0000", 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011194919999999999 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206768+0000", 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015959200000000001 2024-05-10T09:55:22.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206891+0000", 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122583 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:22.284 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 31.017309098999998, 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031971209999999998, 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 738 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207844+0000", 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7269999999999999e-06 2024-05-10T09:55:22.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207853+0000", 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8630000000000003e-06 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207879+0000", 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5219999999999999e-05 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207891+0000", 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208029+0000", 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013824599999999999 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208278+0000", 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024847399999999999 2024-05-10T09:55:22.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208777+0000", 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049937099999999997 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210173+0000", 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013959560000000001 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210892+0000", 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071904200000000003 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210976+0000", 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4105999999999997e-05 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.211039+0000", 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2535999999999999e-05 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.290 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.864718238000002, 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003393713, 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 802 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:22.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360435+0000", 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.08e-06 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360446+0000", 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1457000000000001e-05 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360476+0000", 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0153000000000001e-05 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360491+0000", 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5024e-05 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360652+0000", 2024-05-10T09:55:22.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361013+0000", 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036118400000000002 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361578+0000", 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056503900000000004 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.362848+0000", 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001270094 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363541+0000", 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069264200000000004 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363699+0000", 2024-05-10T09:55:22.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158672 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363826+0000", 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012694599999999999 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:22.297 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.860118966999998, 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003036015, 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 804 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365034+0000", 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.03e-06 2024-05-10T09:55:22.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365045+0000", 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.114e-05 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365079+0000", 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3726000000000002e-05 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365094+0000", 2024-05-10T09:55:22.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5384e-05 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365225+0000", 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013112900000000001 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365460+0000", 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000234754 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365938+0000", 2024-05-10T09:55:22.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047798399999999998 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367189+0000", 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012510209999999999 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367802+0000", 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000612935 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367964+0000", 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016159900000000001 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.368068+0000", 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104313 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.807640666000001, 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030128820000000001, 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.304 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 826 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417513+0000", 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3130000000000001e-06 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417525+0000", 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2574e-05 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417556+0000", 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0790000000000002e-05 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417571+0000", 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4976e-05 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417704+0000", 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013354299999999999 2024-05-10T09:55:22.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417944+0000", 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023976800000000001 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.418281+0000", 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033648800000000002 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.419414+0000", 2024-05-10T09:55:22.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011336580000000001 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420370+0000", 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095544 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420455+0000", 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5675999999999998e-05 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420523+0000", 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7656000000000004e-05 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.705075807, 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032627770000000001, 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 871 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520077+0000", 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9470000000000002e-06 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520091+0000", 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3586e-05 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520120+0000", 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9167e-05 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520135+0000", 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4946000000000001e-05 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520288+0000", 2024-05-10T09:55:22.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015277300000000001 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520668+0000", 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038034700000000001 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.521266+0000", 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059778200000000004 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.522481+0000", 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001215591 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523188+0000", 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070687500000000004 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523273+0000", 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5169999999999999e-05 2024-05-10T09:55:22.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523338+0000", 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4592999999999996e-05 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.669773670000001, 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003478835, 2024-05-10T09:55:22.316 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 886 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555379+0000", 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.243e-06 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555392+0000", 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2225999999999999e-05 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555423+0000", 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0994000000000002e-05 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555438+0000", 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5143000000000001e-05 2024-05-10T09:55:22.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555594+0000", 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156009 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555974+0000", 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037971400000000002 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.556522+0000", 2024-05-10T09:55:22.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054812199999999995 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.557713+0000", 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011910060000000001 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558707+0000", 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099478600000000011 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558794+0000", 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6142000000000003e-05 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558856+0000", 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.245e-05 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.322 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.648578533999999, 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003113457, 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 895 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576574+0000", 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576585+0000", 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0924000000000001e-05 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576615+0000", 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0066e-05 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576630+0000", 2024-05-10T09:55:22.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4693e-05 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576745+0000", 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011446300000000001 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576974+0000", 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022977100000000001 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.577315+0000", 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034073099999999999 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.578411+0000", 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001095752 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579411+0000", 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099999000000000008 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579570+0000", 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015879499999999999 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579686+0000", 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116259 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.644573176000002, 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029848890000000001, 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 897 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.329 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580579+0000", 2024-05-10T09:55:22.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.313e-06 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580587+0000", 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6969999999999993e-06 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580609+0000", 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2263e-05 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580620+0000", 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1293e-05 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580743+0000", 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122299 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580998+0000", 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025569500000000001 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:22.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.581477+0000", 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047893000000000002 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.582608+0000", 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131232 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583301+0000", 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000692839 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583453+0000", 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000151562 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583563+0000", 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010976600000000001 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.334 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.641452128000001, 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032632500000000001, 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 898 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583701+0000", 2024-05-10T09:55:22.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.854e-06 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583729+0000", 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8498999999999999e-05 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583761+0000", 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622999999999999e-05 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583776+0000", 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.517e-05 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583913+0000", 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137453 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584254+0000", 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034036400000000001 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584799+0000", 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054493300000000005 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586086+0000", 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012870410000000001 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586691+0000", 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060565800000000002 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586848+0000", 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156973 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586962+0000", 2024-05-10T09:55:22.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113682 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.637153628, 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003187517, 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.341 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 900 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587999+0000", 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.663e-06 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588024+0000", 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5432999999999999e-05 2024-05-10T09:55:22.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588048+0000", 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3666e-05 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588059+0000", 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1174e-05 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588178+0000", 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118416 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588398+0000", 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220485 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588860+0000", 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046165300000000002 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590173+0000", 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013134469999999999 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590917+0000", 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074345200000000002 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591067+0000", 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015018900000000001 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591185+0000", 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117939 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 30.554810378999999, 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031097049999999999, 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:22.347 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 934 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:22.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670343+0000", 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670355+0000", 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1647e-05 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670384+0000", 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670405+0000", 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0296e-05 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:22.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670553+0000", 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014783900000000001 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670880+0000", 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032728100000000001 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.671207+0000", 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032735799999999998 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.672408+0000", 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001201045 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673285+0000", 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087693700000000005 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673383+0000", 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8321999999999998e-05 2024-05-10T09:55:22.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673450+0000", 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6723999999999993e-05 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:22.353 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:22.355 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:22.355 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:22.352+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:22.377 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:22.378 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:22.395 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:22.395 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:22.413 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:22.414 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:22.432 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:22.432 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:22.453 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:22.455 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:22.452+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:22.472 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:22.473 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:22.493 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:22.493 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:22.496 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:22.496 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:22.510 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:22.514 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:22.514 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:22.557 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:22.556+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:22.628 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:22.628 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:22.642 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:22.685 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:22.684+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:22.758 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:22.756+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:22.801 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:22.801 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:22.815 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:22.862 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:22.860+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:22.938 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:22.938 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:22.954 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:22.960 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:22.956+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:23.061 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:23.056+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:23.121 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:23.121 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:23.135 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:23.162 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:23.160+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:23.258 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:23.258 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:23.263 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:23.260+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:23.272 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:23.365 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:23.360+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:23.393 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:23.393 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:23.395 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:55:23.407 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:23.465 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:23.464+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:23.529 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:23.529 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:23.544 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:23.586 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:23.584+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:23.668 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:23.664+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:23.712 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:23.712 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:23.726 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:23.774 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:23.772+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:23.844 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:23.844 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:23.859 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:23.869 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:23.864+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:23.970 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:23.968+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:24.026 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:24.026 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:24.040 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:24.086 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:24.084+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:24.163 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:24.163 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:24.173 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:24.168+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:24.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:24.274 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:24.272+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:24.311 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:24.312 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:24.326 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:24.375 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:24.372+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:55:24.450 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:24.451 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:24.465 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:24.475 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:24.472+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:24.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:24.576 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:24.572+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:24.591 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:24.591 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:24.606 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:24.671 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:24.672 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:24.677 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:24.672+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:24.687 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:24.688 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:24.704 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:24.704 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:24.720 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:24.720 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:24.732 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:24.732 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:24.732 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:24.732 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:24.741 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:24.741 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:24.745 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:24.761 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:24.762 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:24.782 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:24.782 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:24.783 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:24.780+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:24.802 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:24.802 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:24.874 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:24.874 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:24.874 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:24.874 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:24.874 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:24.879 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:24.876+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:24.888 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:24.980 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:24.976+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:25.012 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 41.362006469999997, 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:25.013 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:55:25.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.178022444, 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:55:25.018 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:55:25.023 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.274342013999998, 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.024 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:55:25.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:55:25.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.239626800000003, 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:55:25.030 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:55:25.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:55:25.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:55:25.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.21324482, 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.195214747999998, 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.041 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:55:25.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:55:25.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.046 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.161552477000001, 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:25.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:55:25.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.130823974999998, 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.052 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:25.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:25.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:55:25.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:55:25.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.057 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.077471164999999, 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.902272545000002, 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.063 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:55:25.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.068 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.812797250000003, 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.768403728000003, 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.074 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:25.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:55:25.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:55:25.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.079 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.695600761000001, 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.080 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:55:25.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:55:25.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.663710831000003, 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.085 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:55:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.658925551000003, 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.091 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:25.096 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.578199773999998, 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:55:25.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:55:25.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:25.102 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.574157989, 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:55:25.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:55:25.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.417868730999999, 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.108 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:55:25.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:55:25.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:55:25.113 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.413531608, 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.114 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:55:25.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:55:25.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:55:25.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.345672948999997, 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.119 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:55:25.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:55:25.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:55:25.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:55:25.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.125 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.125 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.125 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:25.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:25.127 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:25.124+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:25.227 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:25.224+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:25.303 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:25.303 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:25.303 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:25.303 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:25.318 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:25.328 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:25.324+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:25.429 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:25.424+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:25.439 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:25.439 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:25.439 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:25.439 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:25.439 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:25.454 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:25.530 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:25.528+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 41.850490659999998, 2024-05-10T09:55:25.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:25.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.850021587000001, 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:25.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:55:25.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.588 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.715763420000002, 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.589 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:55:25.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:55:25.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:55:25.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.594 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.702336105000001, 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:25.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:55:25.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:55:25.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.600 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.355689220999999, 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:55:25.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:55:25.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.351750445, 2024-05-10T09:55:25.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.609 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.312809215000001, 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.612 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:25.617 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.177517633999997, 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:55:25.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:55:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.621 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.173758534000001, 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.623 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.624 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.624 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.624 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.624 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:55:25.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.624 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:25.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:25.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:55:25.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:55:25.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.627 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:55:25.627 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:55:25.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:55:25.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.631 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.122331006000003, 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:55:25.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:25.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:55:25.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.118735864000001, 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:55:25.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:55:25.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.640 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:25.641 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:55:25.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:55:25.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:55:25.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:55:25.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:55:25.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:55:25.644 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.108875898000001, 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:55:25.645 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.646 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.646 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.646 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.646 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.646 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.646 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:55:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:55:25.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.652 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.061259745000001, 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.653 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.057161960999998, 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:25.664 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.968233464999997, 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:55:25.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:55:25.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:55:25.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:55:25.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:55:25.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:55:25.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.963297832999999, 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.672 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:25.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:55:25.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:55:25.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.677 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.870136185, 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.678 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:25.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:55:25.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:55:25.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:55:25.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.865935667000002, 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:55:25.683 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.856078471000004, 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.689 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:55:25.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 33.851408939999999, 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:25.695 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:25.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:55:25.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:55:25.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:25.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:55:25.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:55:25.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:25.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:55:25.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:55:25.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:25.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:25.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:25.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:55:25.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:55:25.702 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.702 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.702 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.702 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:25.706 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:25.706 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:25.708 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:25.708 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:25.704+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:25.808 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:25.804+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:25.881 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:25.881 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:25.882 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:25.882 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:25.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:25.911 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:25.908+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:26.011 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:26.008+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:26.063 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:26.063 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:26.063 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:26.063 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:26.063 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:26.077 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:26.115 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:26.112+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 40.526641243, 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086496530000000002, 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.208 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 44 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679869+0000", 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3719999999999999e-06 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679880+0000", 2024-05-10T09:55:26.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0854e-05 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679902+0000", 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2464e-05 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679932+0000", 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9726999999999998e-05 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680032+0000", 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010032299999999999 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680042+0000", 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3510000000000008e-06 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688283+0000", 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082418319999999993 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688516+0000", 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023273 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 35.475488941999998, 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035922279999999998, 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.213 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 207 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731022+0000", 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7140000000000002e-06 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731035+0000", 2024-05-10T09:55:26.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3339999999999999e-05 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731069+0000", 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4102e-05 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731086+0000", 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6889999999999999e-05 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731309+0000", 2024-05-10T09:55:26.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022293599999999999 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731595+0000", 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028612400000000001 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.732083+0000", 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048802300000000003 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.733712+0000", 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001629339 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734464+0000", 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075213400000000001 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734544+0000", 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9653000000000005e-05 2024-05-10T09:55:26.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734611+0000", 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6972999999999997e-05 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 35.421705803000002, 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003743836, 2024-05-10T09:55:26.219 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 216 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.221 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:26.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784805+0000", 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5730000000000002e-06 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784817+0000", 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.277e-05 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784854+0000", 2024-05-10T09:55:26.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6205999999999999e-05 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784873+0000", 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9749999999999999e-05 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785009+0000", 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013592300000000001 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785241+0000", 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000232031 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785673+0000", 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043218999999999999 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.787225+0000", 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015515259999999999 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788269+0000", 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001043906 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788425+0000", 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155742 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788546+0000", 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012121900000000001 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.225 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 35.381622364000002, 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034684479999999998, 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.226 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 227 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824888+0000", 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6960000000000001e-06 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824901+0000", 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3144e-05 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824932+0000", 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0273e-05 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824948+0000", 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6402999999999999e-05 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825065+0000", 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011705300000000001 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825277+0000", 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021180099999999999 2024-05-10T09:55:26.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825698+0000", 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042071399999999998 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.827222+0000", 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015247489999999999 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828074+0000", 2024-05-10T09:55:26.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085207100000000003 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828231+0000", 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015675199999999999 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828354+0000", 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012279200000000001 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 35.373528194999999, 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032440870000000001, 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 229 2024-05-10T09:55:26.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832982+0000", 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6429999999999999e-06 2024-05-10T09:55:26.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832995+0000", 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2979999999999999e-05 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833026+0000", 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0383e-05 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833041+0000", 2024-05-10T09:55:26.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4922999999999999e-05 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833158+0000", 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011791299999999999 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833366+0000", 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020795500000000001 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833777+0000", 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000410331 2024-05-10T09:55:26.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.835291+0000", 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015140329999999999 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836021+0000", 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00073029400000000004 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836105+0000", 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3666999999999997e-05 2024-05-10T09:55:26.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836224+0000", 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118965 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 35.366318698999997, 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034732550000000002, 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.237 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 231 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.238 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840191+0000", 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.996e-06 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840203+0000", 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1523e-05 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840229+0000", 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6713e-05 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840244+0000", 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4243999999999999e-05 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840361+0000", 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011759199999999999 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840612+0000", 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025127500000000002 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.841027+0000", 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00041445099999999998 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.842473+0000", 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001446536 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843387+0000", 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091381700000000004 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843543+0000", 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155379 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843662+0000", 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011972900000000001 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.242 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:680 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 35.101971962999997, 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029268050000000002, 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.243 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 680 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104538+0000", 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4399999999999999e-06 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104552+0000", 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104589+0000", 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6671000000000002e-05 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104607+0000", 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7943000000000001e-05 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104729+0000", 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012238700000000001 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104918+0000", 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018902200000000001 2024-05-10T09:55:26.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.105255+0000", 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033649500000000002 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106322+0000", 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001067389 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107175+0000", 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085289000000000003 2024-05-10T09:55:26.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107340+0000", 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016486199999999999 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107463+0000", 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012261999999999999 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 35.016555306999997, 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029077830000000002, 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 730 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.249 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189955+0000", 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1600000000000001e-06 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189966+0000", 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1739999999999999e-05 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189998+0000", 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1229999999999997e-05 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190012+0000", 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4769e-05 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190156+0000", 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014340300000000001 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190368+0000", 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000211895 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190680+0000", 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031250499999999998 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.191743+0000", 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010630749999999999 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192700+0000", 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095679700000000001 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192785+0000", 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5205999999999997e-05 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192860+0000", 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5003e-05 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 35.002948664000002, 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033316309999999998, 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.254 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 736 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.255 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203561+0000", 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3439999999999999e-06 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203573+0000", 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1996e-05 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203611+0000", 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7577000000000003e-05 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203626+0000", 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5217e-05 2024-05-10T09:55:26.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203813+0000", 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018622499999999999 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204026+0000", 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000213542 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:26.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204352+0000", 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032619799999999998 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.205489+0000", 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011368649999999999 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206609+0000", 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011194919999999999 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206768+0000", 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015959200000000001 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206891+0000", 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122583 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.260 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.998666016999998, 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031971209999999998, 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 738 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:26.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207844+0000", 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7269999999999999e-06 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207853+0000", 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8630000000000003e-06 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207879+0000", 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5219999999999999e-05 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207891+0000", 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:26.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208029+0000", 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013824599999999999 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208278+0000", 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024847399999999999 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208777+0000", 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049937099999999997 2024-05-10T09:55:26.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210173+0000", 2024-05-10T09:55:26.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013959560000000001 2024-05-10T09:55:26.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210892+0000", 2024-05-10T09:55:26.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071904200000000003 2024-05-10T09:55:26.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210976+0000", 2024-05-10T09:55:26.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4105999999999997e-05 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.211039+0000", 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2535999999999999e-05 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.267 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.846075155999998, 2024-05-10T09:55:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003393713, 2024-05-10T09:55:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.268 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 802 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360435+0000", 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.08e-06 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360446+0000", 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1457000000000001e-05 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360476+0000", 2024-05-10T09:55:26.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0153000000000001e-05 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360491+0000", 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5024e-05 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360652+0000", 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361013+0000", 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036118400000000002 2024-05-10T09:55:26.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361578+0000", 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056503900000000004 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.362848+0000", 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001270094 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363541+0000", 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069264200000000004 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363699+0000", 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158672 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363826+0000", 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012694599999999999 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.273 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.841475885000001, 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003036015, 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.274 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 804 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365034+0000", 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.03e-06 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365045+0000", 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.114e-05 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365079+0000", 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3726000000000002e-05 2024-05-10T09:55:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365094+0000", 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5384e-05 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365225+0000", 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013112900000000001 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365460+0000", 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000234754 2024-05-10T09:55:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365938+0000", 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047798399999999998 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367189+0000", 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012510209999999999 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367802+0000", 2024-05-10T09:55:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000612935 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367964+0000", 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016159900000000001 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.368068+0000", 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104313 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.788997584000001, 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030128820000000001, 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 826 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417513+0000", 2024-05-10T09:55:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3130000000000001e-06 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417525+0000", 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2574e-05 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417556+0000", 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0790000000000002e-05 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417571+0000", 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4976e-05 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417704+0000", 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013354299999999999 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417944+0000", 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023976800000000001 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.418281+0000", 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033648800000000002 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.419414+0000", 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011336580000000001 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420370+0000", 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095544 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420455+0000", 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5675999999999998e-05 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420523+0000", 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7656000000000004e-05 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.686432725000003, 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032627770000000001, 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 871 2024-05-10T09:55:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520077+0000", 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9470000000000002e-06 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520091+0000", 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3586e-05 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520120+0000", 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9167e-05 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520135+0000", 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4946000000000001e-05 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520288+0000", 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015277300000000001 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520668+0000", 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038034700000000001 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.521266+0000", 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059778200000000004 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.522481+0000", 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001215591 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523188+0000", 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070687500000000004 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523273+0000", 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5169999999999999e-05 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523338+0000", 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4592999999999996e-05 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.651130588000001, 2024-05-10T09:55:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003478835, 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 886 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555379+0000", 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.243e-06 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555392+0000", 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2225999999999999e-05 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555423+0000", 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0994000000000002e-05 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555438+0000", 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5143000000000001e-05 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555594+0000", 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156009 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555974+0000", 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037971400000000002 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.556522+0000", 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054812199999999995 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.557713+0000", 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011910060000000001 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558707+0000", 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099478600000000011 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558794+0000", 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6142000000000003e-05 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558856+0000", 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.245e-05 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.629935451999998, 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003113457, 2024-05-10T09:55:26.298 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 895 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576574+0000", 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576585+0000", 2024-05-10T09:55:26.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0924000000000001e-05 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576615+0000", 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0066e-05 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576630+0000", 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4693e-05 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576745+0000", 2024-05-10T09:55:26.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011446300000000001 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576974+0000", 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022977100000000001 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.577315+0000", 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034073099999999999 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.578411+0000", 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001095752 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579411+0000", 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099999000000000008 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579570+0000", 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015879499999999999 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579686+0000", 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116259 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.625930093999997, 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029848890000000001, 2024-05-10T09:55:26.304 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 897 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580579+0000", 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.313e-06 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580587+0000", 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6969999999999993e-06 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580609+0000", 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2263e-05 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580620+0000", 2024-05-10T09:55:26.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1293e-05 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580743+0000", 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122299 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580998+0000", 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025569500000000001 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.581477+0000", 2024-05-10T09:55:26.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047893000000000002 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.582608+0000", 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131232 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583301+0000", 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000692839 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583453+0000", 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000151562 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583563+0000", 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010976600000000001 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.310 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.622809046, 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032632500000000001, 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 898 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:26.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583701+0000", 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.854e-06 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583729+0000", 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8498999999999999e-05 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583761+0000", 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622999999999999e-05 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583776+0000", 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.517e-05 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583913+0000", 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137453 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584254+0000", 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034036400000000001 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:26.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584799+0000", 2024-05-10T09:55:26.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054493300000000005 2024-05-10T09:55:26.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586086+0000", 2024-05-10T09:55:26.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012870410000000001 2024-05-10T09:55:26.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586691+0000", 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060565800000000002 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586848+0000", 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156973 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586962+0000", 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113682 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.319 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.618510546000003, 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003187517, 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 900 2024-05-10T09:55:26.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587999+0000", 2024-05-10T09:55:26.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.663e-06 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588024+0000", 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5432999999999999e-05 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588048+0000", 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3666e-05 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588059+0000", 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1174e-05 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588178+0000", 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118416 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588398+0000", 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220485 2024-05-10T09:55:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588860+0000", 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046165300000000002 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590173+0000", 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013134469999999999 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590917+0000", 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074345200000000002 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591067+0000", 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015018900000000001 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591185+0000", 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117939 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 34.536167296999999, 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031097049999999999, 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.326 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 934 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670343+0000", 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670355+0000", 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1647e-05 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670384+0000", 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670405+0000", 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0296e-05 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670553+0000", 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014783900000000001 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670880+0000", 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032728100000000001 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.671207+0000", 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032735799999999998 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.672408+0000", 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001201045 2024-05-10T09:55:26.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673285+0000", 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087693700000000005 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673383+0000", 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8321999999999998e-05 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673450+0000", 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6723999999999993e-05 2024-05-10T09:55:26.331 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.332 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.332 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.332 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:26.332 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:26.332 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:26.333 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:26.334 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:26.332+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:26.404 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:55:26.450 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:26.448+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:26.467 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:26.467 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:26.467 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:26.467 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:26.481 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:26.535 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:26.532+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:26.603 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:26.604 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:26.604 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:26.618 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:26.636 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:26.632+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:26.736 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:26.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.064698839000002, 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086530440000000004, 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "reached pg", 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:26.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670663+0000", 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1870000000000001e-06 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670697+0000", 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4013000000000001e-05 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670734+0000", 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6449999999999998e-05 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670760+0000", 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6196000000000001e-05 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670897+0000", 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013763499999999999 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670912+0000", 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.417e-05 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.678965+0000", 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080535780000000005 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.679313+0000", 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034781500000000002 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:26.741 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.028384930999998, 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049225980000000003, 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706975+0000", 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.083e-06 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706996+0000", 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1463000000000001e-05 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707016+0000", 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9639999999999998e-05 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707036+0000", 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9949000000000002e-05 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707643+0000", 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060738299999999997 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707688+0000", 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5201999999999999e-05 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711782+0000", 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040939649999999998 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711896+0000", 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011391300000000001 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.745 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:47 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'2, mlcod=0'0)", 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.019396061000002, 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039603599999999996, 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715965+0000", 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.04e-06 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715981+0000", 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716014+0000", 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3543000000000001e-05 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716035+0000", 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0849999999999999e-05 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716179+0000", 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014356199999999999 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716226+0000", 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7512000000000002e-05 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719825+0000", 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035986569999999999 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719923+0000", 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8060000000000006e-05 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.749 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.976140264999998, 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010358320000000001, 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.750 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 211 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759222+0000", 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759238+0000", 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5889999999999999e-05 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759276+0000", 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8226000000000003e-05 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759293+0000", 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7453999999999999e-05 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759495+0000", 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000201974 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759509+0000", 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.362e-05 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.765967+0000", 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006457717 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766268+0000", 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000301124 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766936+0000", 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00066803499999999998 2024-05-10T09:55:26.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.768435+0000", 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014995150000000001 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769328+0000", 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089229700000000001 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769474+0000", 2024-05-10T09:55:26.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014578200000000001 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769577+0000", 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103199 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.891171847000003, 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034011599999999999, 2024-05-10T09:55:26.756 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 232 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844190+0000", 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844202+0000", 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844234+0000", 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1822999999999997e-05 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844250+0000", 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6713000000000001e-05 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844385+0000", 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013458900000000001 2024-05-10T09:55:26.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844620+0000", 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023536799999999999 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.845031+0000", 2024-05-10T09:55:26.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041049700000000001 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.846532+0000", 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015012820000000001 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847430+0000", 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089785600000000004 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847520+0000", 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0303000000000006e-05 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847588+0000", 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7745999999999998e-05 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:272 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.865735317000002, 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036051189999999999, 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 272 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869626+0000", 2024-05-10T09:55:26.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869636+0000", 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0013000000000001e-05 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869663+0000", 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7630000000000001e-05 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869682+0000", 2024-05-10T09:55:26.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8403999999999999e-05 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869807+0000", 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012508199999999999 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870001+0000", 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019480499999999999 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870357+0000", 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035530099999999998 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871669+0000", 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001311776 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.872980+0000", 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013111760000000001 2024-05-10T09:55:26.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873124+0000", 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000144086 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873229+0000", 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104666 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:279 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.864585089000002, 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030980360000000002, 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 279 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870776+0000", 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1569999999999998e-06 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870789+0000", 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2756e-05 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870814+0000", 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5726999999999999e-05 2024-05-10T09:55:26.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870833+0000", 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870974+0000", 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014081200000000001 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871320+0000", 2024-05-10T09:55:26.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034598000000000002 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871968+0000", 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064825199999999999 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873503+0000", 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534671 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873681+0000", 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178066 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873790+0000", 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109106 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873872+0000", 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1848999999999995e-05 2024-05-10T09:55:26.774 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:314 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.858658245000001, 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051436470000000003, 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 314 2024-05-10T09:55:26.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876703+0000", 2024-05-10T09:55:26.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876716+0000", 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.29e-05 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876746+0000", 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0289000000000001e-05 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876766+0000", 2024-05-10T09:55:26.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9936999999999999e-05 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876915+0000", 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148632 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877123+0000", 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000208622 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877524+0000", 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040038299999999998 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881305+0000", 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037810109999999999 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881676+0000", 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000370854 2024-05-10T09:55:26.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881761+0000", 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4997e-05 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881844+0000", 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3474999999999996e-05 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.780 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.832865697999999, 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029358380000000001, 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 406 2024-05-10T09:55:26.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.782 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.782 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:26.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:26.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902496+0000", 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6690000000000002e-06 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902511+0000", 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5123000000000001e-05 2024-05-10T09:55:26.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902543+0000", 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.26e-05 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902564+0000", 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0835999999999998e-05 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902712+0000", 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148131 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902984+0000", 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027137500000000002 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.903362+0000", 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037871299999999998 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.904567+0000", 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012045890000000001 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905281+0000", 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071434299999999999 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905367+0000", 2024-05-10T09:55:26.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5833000000000003e-05 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905429+0000", 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1625999999999996e-05 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:493 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.780961693999998, 2024-05-10T09:55:26.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050291299999999997, 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 493 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954398+0000", 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3400000000000001e-06 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954405+0000", 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8329999999999996e-06 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954424+0000", 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954435+0000", 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954516+0000", 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1138999999999997e-05 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954721+0000", 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020454800000000001 2024-05-10T09:55:26.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955012+0000", 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000290888 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956172+0000", 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011604510000000001 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959287+0000", 2024-05-10T09:55:26.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031147750000000002 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959352+0000", 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4622000000000006e-05 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959426+0000", 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4413999999999996e-05 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:494 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.780847262000002, 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044303820000000001, 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.795 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 494 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954513+0000", 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2500000000000001e-06 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954521+0000", 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1729999999999995e-06 2024-05-10T09:55:26.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954535+0000", 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4394e-05 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954545+0000", 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-06 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954661+0000", 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011643500000000001 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954872+0000", 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000210805 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955341+0000", 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046933700000000001 2024-05-10T09:55:26.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956602+0000", 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001260323 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958742+0000", 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021402560000000001 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958878+0000", 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013547099999999999 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958942+0000", 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4307999999999995e-05 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:503 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.801 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.774845568000003, 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003841995, 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 503 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960515+0000", 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2000000000000001e-06 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960528+0000", 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2476e-05 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960561+0000", 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3460000000000002e-05 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960581+0000", 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9763e-05 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960707+0000", 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012605799999999999 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960841+0000", 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134122 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.961113+0000", 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027215799999999999 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964004+0000", 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002890849 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964166+0000", 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016143 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964261+0000", 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5128000000000001e-05 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964355+0000", 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4351000000000005e-05 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.807 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.670527450000002, 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029080270000000001, 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.808 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 633 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:26.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064834+0000", 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9330000000000001e-06 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064849+0000", 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5003e-05 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064881+0000", 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2162999999999997e-05 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064897+0000", 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5444e-05 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065013+0000", 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116662 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065239+0000", 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022532800000000001 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065553+0000", 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031410800000000001 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.066681+0000", 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001128038 2024-05-10T09:55:26.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067537+0000", 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00085565999999999995 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067632+0000", 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5149000000000007e-05 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067739+0000", 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107539 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.439250315000002, 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031802750000000002, 2024-05-10T09:55:26.814 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 775 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296111+0000", 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5440000000000001e-06 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296126+0000", 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5243e-05 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296158+0000", 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1359000000000002e-05 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296173+0000", 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296308+0000", 2024-05-10T09:55:26.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135592 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296654+0000", 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034609799999999998 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.297217+0000", 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056229200000000004 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.298808+0000", 2024-05-10T09:55:26.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015914010000000001 2024-05-10T09:55:26.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299121+0000", 2024-05-10T09:55:26.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031244399999999999 2024-05-10T09:55:26.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299209+0000", 2024-05-10T09:55:26.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8159999999999996e-05 2024-05-10T09:55:26.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299289+0000", 2024-05-10T09:55:26.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9981999999999994e-05 2024-05-10T09:55:26.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.822 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.822 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:26.822 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.359985510999998, 2024-05-10T09:55:26.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003080607, 2024-05-10T09:55:26.822 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 808 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375392+0000", 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8366999999999999e-05 2024-05-10T09:55:26.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375406+0000", 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4506e-05 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375438+0000", 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1869999999999998e-05 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375453+0000", 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5204e-05 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375580+0000", 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012671500000000001 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375856+0000", 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027567200000000003 2024-05-10T09:55:26.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.376172+0000", 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031694999999999998 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.377362+0000", 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011898880000000001 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378247+0000", 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088473399999999998 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378337+0000", 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0094999999999997e-05 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378454+0000", 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116606 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.345907179000001, 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032206259999999999, 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 814 2024-05-10T09:55:26.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389454+0000", 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1629999999999999e-06 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389467+0000", 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3414000000000001e-05 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389498+0000", 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0783e-05 2024-05-10T09:55:26.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389513+0000", 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.485e-05 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389669+0000", 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015608899999999999 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390051+0000", 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038213400000000001 2024-05-10T09:55:26.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390607+0000", 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055646199999999997 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392039+0000", 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014314519999999999 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392507+0000", 2024-05-10T09:55:26.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046770999999999998 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392593+0000", 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6159e-05 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392672+0000", 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.941e-05 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.193923662000003, 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029667840000000001, 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.835 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 880 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541439+0000", 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541451+0000", 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2583e-05 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541484+0000", 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3176999999999998e-05 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541501+0000", 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6249999999999999e-05 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541623+0000", 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012215199999999999 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541853+0000", 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023054799999999999 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.542204+0000", 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035071100000000002 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.543359+0000", 2024-05-10T09:55:26.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011545609999999999 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544248+0000", 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088955700000000002 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544335+0000", 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544402+0000", 2024-05-10T09:55:26.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6408999999999994e-05 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.189732053999997, 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029184770000000001, 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.841 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 882 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545629+0000", 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1299999999999999e-06 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545640+0000", 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1663e-05 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545672+0000", 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1922999999999999e-05 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545691+0000", 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8583000000000001e-05 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545821+0000", 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012955599999999999 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545967+0000", 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014623199999999999 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.546238+0000", 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027076800000000001 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.547400+0000", 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011622080000000001 2024-05-10T09:55:26.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548341+0000", 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00094160900000000004 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548428+0000", 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6502999999999995e-05 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548545+0000", 2024-05-10T09:55:26.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117302 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.186536046000001, 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002968301, 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.847 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 883 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548824+0000", 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7540000000000001e-06 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548835+0000", 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0243e-05 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548859+0000", 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4253e-05 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548873+0000", 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4056999999999999e-05 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548984+0000", 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011150900000000001 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549223+0000", 2024-05-10T09:55:26.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023871100000000001 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549550+0000", 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000327301 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.550681+0000", 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011309849999999999 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551571+0000", 2024-05-10T09:55:26.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088975600000000001 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551662+0000", 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0956000000000001e-05 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551791+0000", 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012877599999999999 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.852 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.086350869, 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003259788, 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 925 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649010+0000", 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1239999999999999e-06 2024-05-10T09:55:26.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:26.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649021+0000", 2024-05-10T09:55:26.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0766e-05 2024-05-10T09:55:26.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649051+0000", 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0533000000000001e-05 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649067+0000", 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5446000000000001e-05 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649189+0000", 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122576 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649413+0000", 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022339199999999999 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649726+0000", 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031377100000000002 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.650954+0000", 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012274300000000001 2024-05-10T09:55:26.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.651996+0000", 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001041922 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652156+0000", 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015990500000000001 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652268+0000", 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011192300000000001 2024-05-10T09:55:26.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.859 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:26.859 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:26.859 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:26.859 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:26.860 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:26.732+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:26.862 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:26.862 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:26.856+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:26.961 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:26.956+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:27.014 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:27.014 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:27.031 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:27.031 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:27.035 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:27.035 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:27.036 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:27.036 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:27.048 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:27.048 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:27.050 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:27.064 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:27.065 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:27.082 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:27.082 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:27.094 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:27.092+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:27.102 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:27.103 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:27.121 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:27.121 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:27.138 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:27.138 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:27.163 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:27.160+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:27.217 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:27.217 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:27.232 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:27.265 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:27.260+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:27.366 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:27.364+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:27.395 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:27.395 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:27.397 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:55:27.409 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:27.467 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:27.464+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:27.568 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:27.564+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:27.576 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:27.576 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:27.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:27.682 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:27.680+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:27.762 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:27.763 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:27.769 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:27.764+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:27.777 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:27.871 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:27.868+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:27.938 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:27.938 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:27.952 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:27.971 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:27.972+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:28.068 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:28.069 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:28.072 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:28.068+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:28.083 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:28.173 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:28.172+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:28.252 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:28.252 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:28.266 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:28.274 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:28.272+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:28.375 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:28.372+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:28.434 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:28.434 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:28.448 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:28.490 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:28.488+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:28.576 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:28.572+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:28.585 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:28.585 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:28.600 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:28.691 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:28.688+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:28.772 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:28.772 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:28.778 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:28.776+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:28.786 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:28.879 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:28.876+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:28.957 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:28.957 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:28.972 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:29.015 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:29.012+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:29.081 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:29.080+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:29.134 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:29.134 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:29.149 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:29.156 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:29.183 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:29.180+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:29.276 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:29.276 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:29.283 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:29.280+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:29.291 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:29.340 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:29.340 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:29.357 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:29.357 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:29.373 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:29.374 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:29.384 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:29.380+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:29.391 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:29.413 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:29.413 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 45.766794372, 2024-05-10T09:55:29.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:29.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:29.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 41.582810346000002, 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.422 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.427 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.679129916000001, 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:55:29.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:55:29.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:55:29.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:55:29.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.644414701999999, 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.435 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:55:29.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:55:29.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.618032722000002, 2024-05-10T09:55:29.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:55:29.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:55:29.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.447 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.60000265, 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:55:29.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:55:29.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.566340379000003, 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.454 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:55:29.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:55:29.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:55:29.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.535611877000001, 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:55:29.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:55:29.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.482259067000001, 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.466 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:55:29.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.307060446999998, 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.472 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:55:29.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.477 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.217585151999998, 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.478 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:55:29.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:55:29.483 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.173191629999998, 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.484 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:55:29.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:55:29.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.100388662999997, 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.490 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:55:29.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.068498732999998, 2024-05-10T09:55:29.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:29.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.063713452999998, 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:55:29.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:55:29.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.982987676, 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:55:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:55:29.515 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.978945891000002, 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.516 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:55:29.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:55:29.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.822656633000001, 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:55:29.522 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:29.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:55:29.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.818319510000002, 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:55:29.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:55:29.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 37.750460851, 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:29.535 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:29.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:29.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:29.541 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:29.541 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:55:29.543 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:29.543 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:29.544 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:29.544 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:29.544 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:29.545 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:29.546 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:29.546 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:29.540+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:29.644 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:29.640+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:29.714 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:29.714 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:29.714 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:29.714 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:29.732 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:29.744 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:29.740+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:29.845 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:29.840+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:29.849 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:29.849 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:29.849 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:29.849 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:29.849 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:29.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:29.951 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:29.948+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:30.028 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 46.301679628000002, 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:55:30.029 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:30.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:55:30.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:30.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:55:30.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.301210554999997, 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:55:30.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.166952387999999, 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:55:30.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:55:30.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.153525072999997, 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.048 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:55:30.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:55:30.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:55:30.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.053 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.806878189000003, 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.054 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:55:30.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:55:30.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.802939412999997, 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.060 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:30.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:55:30.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:55:30.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:55:30.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.763998182999998, 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.067 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:30.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:55:30.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:55:30.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:55:30.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:55:30.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.074 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.628706602000001, 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:55:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:55:30.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:55:30.080 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.624947501999998, 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.081 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:30.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:55:30.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:55:30.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.573519974, 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.087 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:30.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:55:30.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:55:30.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.569924831999998, 2024-05-10T09:55:30.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:55:30.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:55:30.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.560064865999998, 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.100 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:55:30.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.106 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.512448712999998, 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:55:30.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.508350929000002, 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.113 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.419422433000001, 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.119 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:55:30.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:55:30.124 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.414486801000002, 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:55:30.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:55:30.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.130 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.321325152999997, 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:55:30.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:55:30.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.317124634999999, 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.137 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:55:30.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:55:30.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.307267439, 2024-05-10T09:55:30.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:30.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:55:30.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.149 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.302597908000003, 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:55:30.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:30.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.155 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:30.157 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:30.158 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:30.152+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:30.258 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:30.256+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:30.330 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:30.330 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:30.330 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:30.330 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:30.345 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:30.390 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:30.388+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:30.402 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:55:30.460 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:30.456+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:30.483 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:30.483 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:30.483 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:30.483 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:30.483 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:30.497 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:30.561 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:30.556+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:30.575 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T09:55:30.576 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T09:55:30.576 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-10T09:55:30.576 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-10T09:55:30.628 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:30.628 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:30.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:30.628 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 44.945823781000001, 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086496530000000002, 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 44 2024-05-10T09:55:30.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679869+0000", 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3719999999999999e-06 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679880+0000", 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0854e-05 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679902+0000", 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2464e-05 2024-05-10T09:55:30.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679932+0000", 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9726999999999998e-05 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680032+0000", 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010032299999999999 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:30.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680042+0000", 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3510000000000008e-06 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688283+0000", 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082418319999999993 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688516+0000", 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023273 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.89467148, 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035922279999999998, 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 207 2024-05-10T09:55:30.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731022+0000", 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7140000000000002e-06 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731035+0000", 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3339999999999999e-05 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731069+0000", 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4102e-05 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731086+0000", 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6889999999999999e-05 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731309+0000", 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022293599999999999 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731595+0000", 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028612400000000001 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.732083+0000", 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048802300000000003 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.733712+0000", 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001629339 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734464+0000", 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075213400000000001 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734544+0000", 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9653000000000005e-05 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734611+0000", 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6972999999999997e-05 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.639 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.840888341000003, 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003743836, 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 216 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784805+0000", 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5730000000000002e-06 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784817+0000", 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.277e-05 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784854+0000", 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6205999999999999e-05 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784873+0000", 2024-05-10T09:55:30.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9749999999999999e-05 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785009+0000", 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013592300000000001 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785241+0000", 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000232031 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785673+0000", 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043218999999999999 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.787225+0000", 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015515259999999999 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788269+0000", 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001043906 2024-05-10T09:55:30.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788425+0000", 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155742 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788546+0000", 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012121900000000001 2024-05-10T09:55:30.645 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.800804902000003, 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034684479999999998, 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.646 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 227 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824888+0000", 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6960000000000001e-06 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824901+0000", 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3144e-05 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824932+0000", 2024-05-10T09:55:30.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0273e-05 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824948+0000", 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6402999999999999e-05 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825065+0000", 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011705300000000001 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825277+0000", 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021180099999999999 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825698+0000", 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042071399999999998 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.827222+0000", 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015247489999999999 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828074+0000", 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085207100000000003 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828231+0000", 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015675199999999999 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828354+0000", 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012279200000000001 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.651 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.792710733, 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032440870000000001, 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.652 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 229 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832982+0000", 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6429999999999999e-06 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832995+0000", 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2979999999999999e-05 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833026+0000", 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0383e-05 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833041+0000", 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4922999999999999e-05 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833158+0000", 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011791299999999999 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833366+0000", 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020795500000000001 2024-05-10T09:55:30.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833777+0000", 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000410331 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.835291+0000", 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015140329999999999 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836021+0000", 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00073029400000000004 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836105+0000", 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3666999999999997e-05 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836224+0000", 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118965 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.657 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.785501236999998, 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034732550000000002, 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 231 2024-05-10T09:55:30.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840191+0000", 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.996e-06 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840203+0000", 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1523e-05 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840229+0000", 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6713e-05 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840244+0000", 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4243999999999999e-05 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840361+0000", 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011759199999999999 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840612+0000", 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025127500000000002 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.841027+0000", 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00041445099999999998 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.842473+0000", 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001446536 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843387+0000", 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091381700000000004 2024-05-10T09:55:30.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843543+0000", 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155379 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843662+0000", 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011972900000000001 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:680 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.521154500999998, 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029268050000000002, 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 680 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.664 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104538+0000", 2024-05-10T09:55:30.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4399999999999999e-06 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104552+0000", 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104589+0000", 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6671000000000002e-05 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104607+0000", 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7943000000000001e-05 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104729+0000", 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012238700000000001 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104918+0000", 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018902200000000001 2024-05-10T09:55:30.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.105255+0000", 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033649500000000002 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106322+0000", 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001067389 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107175+0000", 2024-05-10T09:55:30.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085289000000000003 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107340+0000", 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016486199999999999 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107463+0000", 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012261999999999999 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.435737844999998, 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029077830000000002, 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 730 2024-05-10T09:55:30.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189955+0000", 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1600000000000001e-06 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189966+0000", 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1739999999999999e-05 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189998+0000", 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1229999999999997e-05 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190012+0000", 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4769e-05 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190156+0000", 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014340300000000001 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190368+0000", 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000211895 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190680+0000", 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031250499999999998 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.191743+0000", 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010630749999999999 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192700+0000", 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095679700000000001 2024-05-10T09:55:30.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192785+0000", 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5205999999999997e-05 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192860+0000", 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5003e-05 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.422131202000003, 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033316309999999998, 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 736 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.676 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203561+0000", 2024-05-10T09:55:30.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3439999999999999e-06 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203573+0000", 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1996e-05 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203611+0000", 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7577000000000003e-05 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203626+0000", 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5217e-05 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203813+0000", 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018622499999999999 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204026+0000", 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000213542 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204352+0000", 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032619799999999998 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.205489+0000", 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011368649999999999 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206609+0000", 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011194919999999999 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206768+0000", 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015959200000000001 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206891+0000", 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122583 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.681 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.417848554999999, 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031971209999999998, 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 738 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207844+0000", 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7269999999999999e-06 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207853+0000", 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8630000000000003e-06 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207879+0000", 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5219999999999999e-05 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207891+0000", 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208029+0000", 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013824599999999999 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208278+0000", 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024847399999999999 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208777+0000", 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049937099999999997 2024-05-10T09:55:30.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210173+0000", 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013959560000000001 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210892+0000", 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071904200000000003 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210976+0000", 2024-05-10T09:55:30.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4105999999999997e-05 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.211039+0000", 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2535999999999999e-05 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:30.687 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.265257693999999, 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003393713, 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 802 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360435+0000", 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.08e-06 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360446+0000", 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1457000000000001e-05 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360476+0000", 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0153000000000001e-05 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360491+0000", 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5024e-05 2024-05-10T09:55:30.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360652+0000", 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361013+0000", 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036118400000000002 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:30.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361578+0000", 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056503900000000004 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.362848+0000", 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001270094 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363541+0000", 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069264200000000004 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363699+0000", 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158672 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363826+0000", 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012694599999999999 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.693 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.260658423000002, 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003036015, 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 804 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365034+0000", 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.03e-06 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365045+0000", 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.114e-05 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365079+0000", 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3726000000000002e-05 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365094+0000", 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5384e-05 2024-05-10T09:55:30.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365225+0000", 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013112900000000001 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365460+0000", 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000234754 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365938+0000", 2024-05-10T09:55:30.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047798399999999998 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367189+0000", 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012510209999999999 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367802+0000", 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000612935 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367964+0000", 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016159900000000001 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.368068+0000", 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104313 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.699 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.208180122000002, 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030128820000000001, 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 826 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:30.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417513+0000", 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3130000000000001e-06 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417525+0000", 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2574e-05 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417556+0000", 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0790000000000002e-05 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417571+0000", 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4976e-05 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417704+0000", 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013354299999999999 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417944+0000", 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023976800000000001 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.418281+0000", 2024-05-10T09:55:30.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033648800000000002 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.419414+0000", 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011336580000000001 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420370+0000", 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095544 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420455+0000", 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5675999999999998e-05 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420523+0000", 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7656000000000004e-05 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.705 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.105615262999997, 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032627770000000001, 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 871 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520077+0000", 2024-05-10T09:55:30.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9470000000000002e-06 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520091+0000", 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3586e-05 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520120+0000", 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9167e-05 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520135+0000", 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4946000000000001e-05 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520288+0000", 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015277300000000001 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520668+0000", 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038034700000000001 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.521266+0000", 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059778200000000004 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.522481+0000", 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001215591 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523188+0000", 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070687500000000004 2024-05-10T09:55:30.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523273+0000", 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5169999999999999e-05 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523338+0000", 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4592999999999996e-05 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.070313126000002, 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003478835, 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 886 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.712 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555379+0000", 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.243e-06 2024-05-10T09:55:30.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555392+0000", 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2225999999999999e-05 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555423+0000", 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0994000000000002e-05 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555438+0000", 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5143000000000001e-05 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555594+0000", 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156009 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555974+0000", 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037971400000000002 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.556522+0000", 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054812199999999995 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.557713+0000", 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011910060000000001 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558707+0000", 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099478600000000011 2024-05-10T09:55:30.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558794+0000", 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6142000000000003e-05 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558856+0000", 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.245e-05 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.717 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.049117989999999, 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003113457, 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 895 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576574+0000", 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:30.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576585+0000", 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0924000000000001e-05 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576615+0000", 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0066e-05 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576630+0000", 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4693e-05 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576745+0000", 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011446300000000001 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576974+0000", 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022977100000000001 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.577315+0000", 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034073099999999999 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.578411+0000", 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001095752 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579411+0000", 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099999000000000008 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579570+0000", 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015879499999999999 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579686+0000", 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116259 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.723 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.045112631999999, 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029848890000000001, 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 897 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580579+0000", 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.313e-06 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580587+0000", 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6969999999999993e-06 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580609+0000", 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2263e-05 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580620+0000", 2024-05-10T09:55:30.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1293e-05 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580743+0000", 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122299 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580998+0000", 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025569500000000001 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:30.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.581477+0000", 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047893000000000002 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.582608+0000", 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131232 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583301+0000", 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000692839 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583453+0000", 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000151562 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583563+0000", 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010976600000000001 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.729 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.041991584000002, 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032632500000000001, 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 898 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583701+0000", 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.854e-06 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583729+0000", 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8498999999999999e-05 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583761+0000", 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622999999999999e-05 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583776+0000", 2024-05-10T09:55:30.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.517e-05 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583913+0000", 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137453 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584254+0000", 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034036400000000001 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:30.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584799+0000", 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054493300000000005 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586086+0000", 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012870410000000001 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586691+0000", 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060565800000000002 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586848+0000", 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156973 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586962+0000", 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113682 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.735 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 39.037693083999997, 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003187517, 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 900 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587999+0000", 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.663e-06 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588024+0000", 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5432999999999999e-05 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588048+0000", 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3666e-05 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588059+0000", 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1174e-05 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588178+0000", 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118416 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588398+0000", 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220485 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588860+0000", 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046165300000000002 2024-05-10T09:55:30.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590173+0000", 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013134469999999999 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590917+0000", 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074345200000000002 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591067+0000", 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015018900000000001 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591185+0000", 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117939 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:30.741 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.955349835, 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031097049999999999, 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 934 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:30.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670343+0000", 2024-05-10T09:55:30.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670355+0000", 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1647e-05 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670384+0000", 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670405+0000", 2024-05-10T09:55:30.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0296e-05 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670553+0000", 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014783900000000001 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670880+0000", 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032728100000000001 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:30.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.671207+0000", 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032735799999999998 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.672408+0000", 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001201045 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673285+0000", 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087693700000000005 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673383+0000", 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8321999999999998e-05 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673450+0000", 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6723999999999993e-05 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.747 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.748 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:30.749 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:30.749 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:30.744+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:30.850 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:30.848+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:30.880 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:30.880 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:30.880 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:30.880 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:30.886 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:55:30.886 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:30.886 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 47, 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "fsid": "7e1d9b5a-9708-485a-8c63-703e41c4a829", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "created": "2024-05-10T09:54:13.508887+0000", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "modified": "2024-05-10T09:55:30.395526+0000", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "last_up_change": "2024-05-10T09:54:24.495518+0000", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "last_in_change": "2024-05-10T09:54:15.752492+0000", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_num": 5804032, 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_set": [ 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "nodeep-scrub", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "pglog_hardlimit", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "purged_snapdirs", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_deletes", 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: "sortbitwise" 2024-05-10T09:55:30.887 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_version": 5, 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "full_ratio": 0.94999998807907104, 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_snapshot": "", 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_max": 8, 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd": 8, 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "require_min_compat_client": "luminous", 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "min_compat_client": "luminous", 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "require_osd_release": "squid", 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_crimson": false, 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: "pools": [ 2024-05-10T09:55:30.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 1, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": ".mgr", 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:26.214148+0000", 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:55:30.889 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 1, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 1, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 1, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 1, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 1, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:55:30.890 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "19", 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:55:30.891 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:55:30.892 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:55:30.893 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "options": { 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_max": 32, 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_min": 1 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": {} 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:55:30.894 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 8, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 8, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 0.25, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 2, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 2, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 2, 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "rbd", 2024-05-10T09:55:30.895 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:31.575111+0000", 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 8, 2024-05-10T09:55:30.896 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 8, 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 8, 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 8, 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 8, 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "22", 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:55:30.897 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:55:30.898 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:55:30.899 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd": {} 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:55:30.900 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.9900000095367432, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.9900000095367432, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 0.87999999523162842, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.75, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.75, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 3, 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.buckets.data", 2024-05-10T09:55:30.901 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:38.369592+0000", 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 64, 2024-05-10T09:55:30.902 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 64, 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 64, 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 64, 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 64, 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "25", 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:55:30.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:55:30.904 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:55:30.905 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:55:30.906 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.5, 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.5, 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.5, 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.5, 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.907 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 4, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.buckets.index", 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:39.953615+0000", 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:55:30.908 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 64, 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 64, 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 64, 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 64, 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 64, 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:55:30.909 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "27", 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:55:30.910 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:55:30.911 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:55:30.912 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 2, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 2, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 2, 2024-05-10T09:55:30.913 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 2, 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 5, 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": ".rgw.root", 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:41.893433+0000", 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:55:30.914 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 32, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 32, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 32, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 32, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 32, 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:55:30.915 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "29", 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:55:30.916 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:55:30.917 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:55:30.918 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.25, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.25, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.25, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.25, 2024-05-10T09:55:30.919 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 6, 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.log", 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:43.804869+0000", 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:55:30.920 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 32, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 32, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 32, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 32, 2024-05-10T09:55:30.921 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 32, 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "31", 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:55:30.922 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:55:30.923 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:55:30.924 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:55:30.925 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.75, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.75, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.75, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.75, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 7, 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.control", 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:45.696998+0000", 2024-05-10T09:55:30.926 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 32, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 32, 2024-05-10T09:55:30.927 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 32, 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 32, 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 32, 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "33", 2024-05-10T09:55:30.928 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:55:30.929 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:55:30.930 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:55:30.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.75, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.75, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.75, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.75, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 8, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.meta", 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:47.845498+0000", 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:55:30.933 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 32, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 32, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 32, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 32, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 32, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:55:30.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "35", 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:55:30.935 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.936 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "options": { 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_bias": 4 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:55:30.937 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.5, 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.5, 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.5, 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.5, 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:55:30.938 INFO:teuthology.orchestra.run.smithi042.stdout: "osds": [ 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 0, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "897c58ab-70e9-4a8d-b51f-cf9dc6cedd29", 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 33, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:55:30.939 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6800", 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6801", 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6802", 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6803", 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.941 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6806", 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6807", 2024-05-10T09:55:30.942 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6804", 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.943 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6805", 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.42:6801/3913515164", 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.42:6803/3913515164", 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.42:6807/3913515164", 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.42:6805/3913515164", 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 1, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "fc75a63e-e69c-4efb-89cb-b599f6ded234", 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 14, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 42, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6809", 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6811", 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6813", 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6815", 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6821", 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6823", 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.948 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6817", 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6819", 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.42:6811/2743871003", 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.42:6815/2743871003", 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.42:6823/2743871003", 2024-05-10T09:55:30.949 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.42:6819/2743871003", 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 2, 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "18889f8e-3a4e-4ea7-b9b6-af9547e84e85", 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:55:30.950 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 42, 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6808", 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6810", 2024-05-10T09:55:30.951 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6812", 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.952 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6814", 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6820", 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.953 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6822", 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6816", 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:55:30.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6818", 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.42:6810/3683869396", 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.42:6814/3683869396", 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.42:6822/3683869396", 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.42:6818/3683869396", 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:55:30.955 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 3, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "a2720077-7595-48e4-9f86-60cd449b0d90", 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 33, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:55:30.956 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6824", 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6825", 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6826", 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6827", 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.958 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6830", 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6831", 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.959 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6828", 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6829", 2024-05-10T09:55:30.960 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.42:6825/125865404", 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.42:6827/125865404", 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.42:6831/125865404", 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.42:6829/125865404", 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 4, 2024-05-10T09:55:30.961 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "c271ae7d-8d4d-46a6-9273-8a52de33dd30", 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 42, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.962 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6823", 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 74015139 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6825", 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 74015139 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.963 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6826", 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 74015139 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6827", 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 74015139 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.964 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6830", 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 74015139 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6831", 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 74015139 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6828", 2024-05-10T09:55:30.965 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 74015139 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6829", 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 74015139 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.181:6825/74015139", 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.181:6827/74015139", 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.181:6831/74015139", 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.181:6829/74015139", 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:55:30.966 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 5, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b", 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 33, 2024-05-10T09:55:30.967 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6809", 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6812", 2024-05-10T09:55:30.968 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6814", 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6816", 2024-05-10T09:55:30.969 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6822", 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.970 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6824", 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6819", 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.971 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6821", 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.181:6812/893112190", 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.181:6816/893112190", 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.181:6824/893112190", 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.181:6821/893112190", 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.972 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 6, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "6fa08610-ff9d-41d0-af8a-06d46f3388d7", 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 42, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:55:30.973 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6800", 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6802", 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6804", 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6807", 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6817", 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6820", 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6810", 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.977 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6813", 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.181:6802/1622048387", 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.181:6807/1622048387", 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.181:6820/1622048387", 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.181:6813/1622048387", 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:55:30.978 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 7, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "86869483-0d84-4d13-b78e-3bac8ac2ff03", 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 33, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:55:30.979 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6801", 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6803", 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6805", 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6806", 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6815", 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6818", 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.982 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6808", 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6811", 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.983 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.181:6803/3508953868", 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.181:6806/3508953868", 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.181:6818/3508953868", 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.181:6811/3508953868", 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_xinfo": [ 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 0, 2024-05-10T09:55:30.984 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.309797+0000", 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 1, 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:55:30.985 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:20.776872+0000", 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 2, 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.163014+0000", 2024-05-10T09:55:30.986 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 3, 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.344100+0000", 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.987 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 4, 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.292805+0000", 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 5, 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:55:30.988 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.412990+0000", 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 6, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:55:30.989 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.456741+0000", 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 7, 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.437150+0000", 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.990 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_upmap": [], 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_upmap_items": [ 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "3.19", 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 3, 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.991 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "3.21", 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 5, 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 1 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "3.36", 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 5, 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:55:30.992 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "3.39", 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 7, 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "4.9", 2024-05-10T09:55:30.993 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 1, 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 5 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "4.21", 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 3, 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:55:30.994 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_upmap_primaries": [], 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_temp": [], 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_temp": [], 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "blocklist": {}, 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "range_blocklist": {}, 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profiles": { 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "default": { 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-failure-domain": "osd", 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "k": "2", 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "m": "1", 2024-05-10T09:55:30.995 INFO:teuthology.orchestra.run.smithi042.stdout: "plugin": "jerasure", 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "technique": "reed_sol_van" 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps_queue": [], 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "new_removed_snaps": [], 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "new_purged_snaps": [], 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_node_flags": {}, 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "device_class_flags": {}, 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "stretch_mode": { 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "stretch_mode_enabled": false, 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "stretch_bucket_count": 0, 2024-05-10T09:55:30.996 INFO:teuthology.orchestra.run.smithi042.stdout: "degraded_stretch_mode": 0, 2024-05-10T09:55:30.997 INFO:teuthology.orchestra.run.smithi042.stdout: "recovering_stretch_mode": 0, 2024-05-10T09:55:30.997 INFO:teuthology.orchestra.run.smithi042.stdout: "stretch_mode_bucket": 0 2024-05-10T09:55:30.997 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:30.997 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:30.999 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:30.999 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:30.996+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:31.000 INFO:tasks.thrashosds.thrasher:j is {'epoch': 47, 'fsid': '7e1d9b5a-9708-485a-8c63-703e41c4a829', 'created': '2024-05-10T09:54:13.508887+0000', 'modified': '2024-05-10T09:55:30.395526+0000', 'last_up_change': '2024-05-10T09:54:24.495518+0000', 'last_in_change': '2024-05-10T09:54:15.752492+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T09:54:26.214148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-10T09:54:31.575111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-05-10T09:54:38.369592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-05-10T09:54:39.953615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-05-10T09:54:41.893433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-05-10T09:54:43.804869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-05-10T09:54:45.696998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-05-10T09:54:47.845498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '897c58ab-70e9-4a8d-b51f-cf9dc6cedd29', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6800', 'nonce': 3913515164}, {'type': 'v1', 'addr': '172.21.15.42:6801', 'nonce': 3913515164}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6802', 'nonce': 3913515164}, {'type': 'v1', 'addr': '172.21.15.42:6803', 'nonce': 3913515164}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6806', 'nonce': 3913515164}, {'type': 'v1', 'addr': '172.21.15.42:6807', 'nonce': 3913515164}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6804', 'nonce': 3913515164}, {'type': 'v1', 'addr': '172.21.15.42:6805', 'nonce': 3913515164}]}, 'public_addr': '172.21.15.42:6801/3913515164', 'cluster_addr': '172.21.15.42:6803/3913515164', 'heartbeat_back_addr': '172.21.15.42:6807/3913515164', 'heartbeat_front_addr': '172.21.15.42:6805/3913515164', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'fc75a63e-e69c-4efb-89cb-b599f6ded234', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6809', 'nonce': 2743871003}, {'type': 'v1', 'addr': '172.21.15.42:6811', 'nonce': 2743871003}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6813', 'nonce': 2743871003}, {'type': 'v1', 'addr': '172.21.15.42:6815', 'nonce': 2743871003}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6821', 'nonce': 2743871003}, {'type': 'v1', 'addr': '172.21.15.42:6823', 'nonce': 2743871003}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6817', 'nonce': 2743871003}, {'type': 'v1', 'addr': '172.21.15.42:6819', 'nonce': 2743871003}]}, 'public_addr': '172.21.15.42:6811/2743871003', 'cluster_addr': '172.21.15.42:6815/2743871003', 'heartbeat_back_addr': '172.21.15.42:6823/2743871003', 'heartbeat_front_addr': '172.21.15.42:6819/2743871003', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '18889f8e-3a4e-4ea7-b9b6-af9547e84e85', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6808', 'nonce': 3683869396}, {'type': 'v1', 'addr': '172.21.15.42:6810', 'nonce': 3683869396}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6812', 'nonce': 3683869396}, {'type': 'v1', 'addr': '172.21.15.42:6814', 'nonce': 3683869396}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6820', 'nonce': 3683869396}, {'type': 'v1', 'addr': '172.21.15.42:6822', 'nonce': 3683869396}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6816', 'nonce': 3683869396}, {'type': 'v1', 'addr': '172.21.15.42:6818', 'nonce': 3683869396}]}, 'public_addr': '172.21.15.42:6810/3683869396', 'cluster_addr': '172.21.15.42:6814/3683869396', 'heartbeat_back_addr': '172.21.15.42:6822/3683869396', 'heartbeat_front_addr': '172.21.15.42:6818/3683869396', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'a2720077-7595-48e4-9f86-60cd449b0d90', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6824', 'nonce': 125865404}, {'type': 'v1', 'addr': '172.21.15.42:6825', 'nonce': 125865404}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6826', 'nonce': 125865404}, {'type': 'v1', 'addr': '172.21.15.42:6827', 'nonce': 125865404}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6830', 'nonce': 125865404}, {'type': 'v1', 'addr': '172.21.15.42:6831', 'nonce': 125865404}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6828', 'nonce': 125865404}, {'type': 'v1', 'addr': '172.21.15.42:6829', 'nonce': 125865404}]}, 'public_addr': '172.21.15.42:6825/125865404', 'cluster_addr': '172.21.15.42:6827/125865404', 'heartbeat_back_addr': '172.21.15.42:6831/125865404', 'heartbeat_front_addr': '172.21.15.42:6829/125865404', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c271ae7d-8d4d-46a6-9273-8a52de33dd30', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6823', 'nonce': 74015139}, {'type': 'v1', 'addr': '172.21.15.181:6825', 'nonce': 74015139}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6826', 'nonce': 74015139}, {'type': 'v1', 'addr': '172.21.15.181:6827', 'nonce': 74015139}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6830', 'nonce': 74015139}, {'type': 'v1', 'addr': '172.21.15.181:6831', 'nonce': 74015139}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6828', 'nonce': 74015139}, {'type': 'v1', 'addr': '172.21.15.181:6829', 'nonce': 74015139}]}, 'public_addr': '172.21.15.181:6825/74015139', 'cluster_addr': '172.21.15.181:6827/74015139', 'heartbeat_back_addr': '172.21.15.181:6831/74015139', 'heartbeat_front_addr': '172.21.15.181:6829/74015139', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6809', 'nonce': 893112190}, {'type': 'v1', 'addr': '172.21.15.181:6812', 'nonce': 893112190}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6814', 'nonce': 893112190}, {'type': 'v1', 'addr': '172.21.15.181:6816', 'nonce': 893112190}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6822', 'nonce': 893112190}, {'type': 'v1', 'addr': '172.21.15.181:6824', 'nonce': 893112190}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6819', 'nonce': 893112190}, {'type': 'v1', 'addr': '172.21.15.181:6821', 'nonce': 893112190}]}, 'public_addr': '172.21.15.181:6812/893112190', 'cluster_addr': '172.21.15.181:6816/893112190', 'heartbeat_back_addr': '172.21.15.181:6824/893112190', 'heartbeat_front_addr': '172.21.15.181:6821/893112190', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6fa08610-ff9d-41d0-af8a-06d46f3388d7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6800', 'nonce': 1622048387}, {'type': 'v1', 'addr': '172.21.15.181:6802', 'nonce': 1622048387}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6804', 'nonce': 1622048387}, {'type': 'v1', 'addr': '172.21.15.181:6807', 'nonce': 1622048387}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6817', 'nonce': 1622048387}, {'type': 'v1', 'addr': '172.21.15.181:6820', 'nonce': 1622048387}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6810', 'nonce': 1622048387}, {'type': 'v1', 'addr': '172.21.15.181:6813', 'nonce': 1622048387}]}, 'public_addr': '172.21.15.181:6802/1622048387', 'cluster_addr': '172.21.15.181:6807/1622048387', 'heartbeat_back_addr': '172.21.15.181:6820/1622048387', 'heartbeat_front_addr': '172.21.15.181:6813/1622048387', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '86869483-0d84-4d13-b78e-3bac8ac2ff03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6801', 'nonce': 3508953868}, {'type': 'v1', 'addr': '172.21.15.181:6803', 'nonce': 3508953868}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6805', 'nonce': 3508953868}, {'type': 'v1', 'addr': '172.21.15.181:6806', 'nonce': 3508953868}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6815', 'nonce': 3508953868}, {'type': 'v1', 'addr': '172.21.15.181:6818', 'nonce': 3508953868}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6808', 'nonce': 3508953868}, {'type': 'v1', 'addr': '172.21.15.181:6811', 'nonce': 3508953868}]}, 'public_addr': '172.21.15.181:6803/3508953868', 'cluster_addr': '172.21.15.181:6806/3508953868', 'heartbeat_back_addr': '172.21.15.181:6818/3508953868', 'heartbeat_front_addr': '172.21.15.181:6811/3508953868', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.309797+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:20.776872+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.163014+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.344100+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.292805+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.412990+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.456741+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.437150+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.19', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.21', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.36', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.39', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.9', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.21', 'mappings': [{'from': 3, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-10T09:55:31.001 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:55:31.099 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:31.096+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:31.168 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:31.169 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:31.169 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:31.169 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:31.169 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:31.183 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:31.200 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:31.196+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:31.302 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:31.296+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.677836005000003, 2024-05-10T09:55:31.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086530440000000004, 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "reached pg", 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670663+0000", 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1870000000000001e-06 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670697+0000", 2024-05-10T09:55:31.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4013000000000001e-05 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670734+0000", 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6449999999999998e-05 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670760+0000", 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6196000000000001e-05 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670897+0000", 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013763499999999999 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670912+0000", 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.417e-05 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.678965+0000", 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080535780000000005 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.679313+0000", 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034781500000000002 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.359 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.641522096999999, 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049225980000000003, 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706975+0000", 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.083e-06 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706996+0000", 2024-05-10T09:55:31.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1463000000000001e-05 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707016+0000", 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9639999999999998e-05 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707036+0000", 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9949000000000002e-05 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707643+0000", 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060738299999999997 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707688+0000", 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5201999999999999e-05 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711782+0000", 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040939649999999998 2024-05-10T09:55:31.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711896+0000", 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011391300000000001 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:47 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'2, mlcod=0'0)", 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 43.632533227000003, 2024-05-10T09:55:31.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039603599999999996, 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:31.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715965+0000", 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.04e-06 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715981+0000", 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716014+0000", 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3543000000000001e-05 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716035+0000", 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0849999999999999e-05 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716179+0000", 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014356199999999999 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716226+0000", 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7512000000000002e-05 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719825+0000", 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035986569999999999 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719923+0000", 2024-05-10T09:55:31.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8060000000000006e-05 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.589277430999999, 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010358320000000001, 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.369 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 211 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759222+0000", 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759238+0000", 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5889999999999999e-05 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759276+0000", 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8226000000000003e-05 2024-05-10T09:55:31.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759293+0000", 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7453999999999999e-05 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759495+0000", 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000201974 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2024-05-10T09:55:31.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759509+0000", 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.362e-05 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.765967+0000", 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006457717 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766268+0000", 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000301124 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766936+0000", 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00066803499999999998 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.768435+0000", 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014995150000000001 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769328+0000", 2024-05-10T09:55:31.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089229700000000001 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769474+0000", 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014578200000000001 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769577+0000", 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103199 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.504309012999997, 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034011599999999999, 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 232 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844190+0000", 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:55:31.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844202+0000", 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844234+0000", 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1822999999999997e-05 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844250+0000", 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6713000000000001e-05 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844385+0000", 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013458900000000001 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844620+0000", 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023536799999999999 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.845031+0000", 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041049700000000001 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.846532+0000", 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015012820000000001 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847430+0000", 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089785600000000004 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847520+0000", 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0303000000000006e-05 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847588+0000", 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7745999999999998e-05 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.381 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:272 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.478872483000004, 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036051189999999999, 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 272 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869626+0000", 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869636+0000", 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0013000000000001e-05 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869663+0000", 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7630000000000001e-05 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869682+0000", 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8403999999999999e-05 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869807+0000", 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012508199999999999 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870001+0000", 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019480499999999999 2024-05-10T09:55:31.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870357+0000", 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035530099999999998 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871669+0000", 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001311776 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.872980+0000", 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013111760000000001 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873124+0000", 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000144086 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873229+0000", 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104666 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.387 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:279 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.477722255000003, 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030980360000000002, 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.388 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 279 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870776+0000", 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1569999999999998e-06 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870789+0000", 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2756e-05 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870814+0000", 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5726999999999999e-05 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870833+0000", 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870974+0000", 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014081200000000001 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871320+0000", 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034598000000000002 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871968+0000", 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064825199999999999 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873503+0000", 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534671 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873681+0000", 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178066 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873790+0000", 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109106 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873872+0000", 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1848999999999995e-05 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:314 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.471795411000002, 2024-05-10T09:55:31.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051436470000000003, 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 314 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876703+0000", 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876716+0000", 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.29e-05 2024-05-10T09:55:31.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876746+0000", 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0289000000000001e-05 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876766+0000", 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9936999999999999e-05 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876915+0000", 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148632 2024-05-10T09:55:31.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877123+0000", 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000208622 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877524+0000", 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040038299999999998 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881305+0000", 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037810109999999999 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881676+0000", 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000370854 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881761+0000", 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4997e-05 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881844+0000", 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3474999999999996e-05 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.446002864, 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029358380000000001, 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.399 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 406 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902496+0000", 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6690000000000002e-06 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902511+0000", 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5123000000000001e-05 2024-05-10T09:55:31.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902543+0000", 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.26e-05 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902564+0000", 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0835999999999998e-05 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902712+0000", 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148131 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902984+0000", 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027137500000000002 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.903362+0000", 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037871299999999998 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.904567+0000", 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012045890000000001 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905281+0000", 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071434299999999999 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905367+0000", 2024-05-10T09:55:31.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5833000000000003e-05 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905429+0000", 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1625999999999996e-05 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:493 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.39409886, 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050291299999999997, 2024-05-10T09:55:31.405 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 493 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954398+0000", 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3400000000000001e-06 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954405+0000", 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8329999999999996e-06 2024-05-10T09:55:31.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954424+0000", 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954435+0000", 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954516+0000", 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1138999999999997e-05 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954721+0000", 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020454800000000001 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955012+0000", 2024-05-10T09:55:31.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000290888 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956172+0000", 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011604510000000001 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959287+0000", 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031147750000000002 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959352+0000", 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4622000000000006e-05 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959426+0000", 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4413999999999996e-05 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.411 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:494 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.393984428000003, 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044303820000000001, 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 494 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954513+0000", 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2500000000000001e-06 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954521+0000", 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1729999999999995e-06 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954535+0000", 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4394e-05 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954545+0000", 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-06 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954661+0000", 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011643500000000001 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954872+0000", 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000210805 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955341+0000", 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046933700000000001 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956602+0000", 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001260323 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958742+0000", 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021402560000000001 2024-05-10T09:55:31.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958878+0000", 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013547099999999999 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958942+0000", 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4307999999999995e-05 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:503 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.417 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.387982733999998, 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003841995, 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 503 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960515+0000", 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2000000000000001e-06 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960528+0000", 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2476e-05 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960561+0000", 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3460000000000002e-05 2024-05-10T09:55:31.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960581+0000", 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9763e-05 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960707+0000", 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012605799999999999 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960841+0000", 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134122 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.961113+0000", 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027215799999999999 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964004+0000", 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002890849 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964166+0000", 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016143 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964261+0000", 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5128000000000001e-05 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964355+0000", 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4351000000000005e-05 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.424 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.283664616000003, 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029080270000000001, 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.425 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 633 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:31.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064834+0000", 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9330000000000001e-06 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064849+0000", 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5003e-05 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064881+0000", 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2162999999999997e-05 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064897+0000", 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5444e-05 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065013+0000", 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116662 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065239+0000", 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022532800000000001 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065553+0000", 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031410800000000001 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.066681+0000", 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001128038 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067537+0000", 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00085565999999999995 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067632+0000", 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5149000000000007e-05 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067739+0000", 2024-05-10T09:55:31.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107539 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 40.052387480999997, 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031802750000000002, 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.431 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 775 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:31.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296111+0000", 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5440000000000001e-06 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296126+0000", 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5243e-05 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296158+0000", 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1359000000000002e-05 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296173+0000", 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296308+0000", 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135592 2024-05-10T09:55:31.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296654+0000", 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034609799999999998 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.297217+0000", 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056229200000000004 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.298808+0000", 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015914010000000001 2024-05-10T09:55:31.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299121+0000", 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031244399999999999 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299209+0000", 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8159999999999996e-05 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299289+0000", 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9981999999999994e-05 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.436 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.973122676999999, 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003080607, 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 808 2024-05-10T09:55:31.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375392+0000", 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8366999999999999e-05 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375406+0000", 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4506e-05 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375438+0000", 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1869999999999998e-05 2024-05-10T09:55:31.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375453+0000", 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5204e-05 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375580+0000", 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012671500000000001 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375856+0000", 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027567200000000003 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.376172+0000", 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031694999999999998 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.377362+0000", 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011898880000000001 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378247+0000", 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088473399999999998 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378337+0000", 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0094999999999997e-05 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378454+0000", 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116606 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.442 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.959044345000002, 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032206259999999999, 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 814 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.443 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389454+0000", 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1629999999999999e-06 2024-05-10T09:55:31.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389467+0000", 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3414000000000001e-05 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389498+0000", 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0783e-05 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389513+0000", 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.485e-05 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389669+0000", 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015608899999999999 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390051+0000", 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038213400000000001 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390607+0000", 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055646199999999997 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392039+0000", 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014314519999999999 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392507+0000", 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046770999999999998 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392593+0000", 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6159e-05 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392672+0000", 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.941e-05 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.807060827999997, 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029667840000000001, 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.448 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 880 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541439+0000", 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541451+0000", 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2583e-05 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541484+0000", 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3176999999999998e-05 2024-05-10T09:55:31.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541501+0000", 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6249999999999999e-05 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541623+0000", 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012215199999999999 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541853+0000", 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023054799999999999 2024-05-10T09:55:31.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.542204+0000", 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035071100000000002 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.543359+0000", 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011545609999999999 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544248+0000", 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088955700000000002 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544335+0000", 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544402+0000", 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6408999999999994e-05 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.802869219999998, 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029184770000000001, 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 882 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545629+0000", 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1299999999999999e-06 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545640+0000", 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1663e-05 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545672+0000", 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1922999999999999e-05 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545691+0000", 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8583000000000001e-05 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545821+0000", 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012955599999999999 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545967+0000", 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014623199999999999 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.546238+0000", 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027076800000000001 2024-05-10T09:55:31.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.547400+0000", 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011622080000000001 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548341+0000", 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00094160900000000004 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548428+0000", 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6502999999999995e-05 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548545+0000", 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117302 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:31.459 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.799673212000002, 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002968301, 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 883 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:31.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548824+0000", 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7540000000000001e-06 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548835+0000", 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0243e-05 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548859+0000", 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4253e-05 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548873+0000", 2024-05-10T09:55:31.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4056999999999999e-05 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548984+0000", 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011150900000000001 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549223+0000", 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023871100000000001 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:55:31.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549550+0000", 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000327301 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.550681+0000", 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011309849999999999 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551571+0000", 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088975600000000001 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551662+0000", 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0956000000000001e-05 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551791+0000", 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012877599999999999 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.465 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 39.699488035000002, 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003259788, 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 925 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:31.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649010+0000", 2024-05-10T09:55:31.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1239999999999999e-06 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649021+0000", 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0766e-05 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649051+0000", 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0533000000000001e-05 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649067+0000", 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5446000000000001e-05 2024-05-10T09:55:31.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649189+0000", 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122576 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649413+0000", 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022339199999999999 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649726+0000", 2024-05-10T09:55:31.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031377100000000002 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.650954+0000", 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012274300000000001 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.651996+0000", 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001041922 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:31.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652156+0000", 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015990500000000001 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652268+0000", 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011192300000000001 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:31.471 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:31.475 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:31.475 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:31.468+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:31.479 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:55:31.483 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:55:31.487 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-05-10T09:55:30.405053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250792,"kb_used_data":5512,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754723928,"statfs":{"total":773094113280,"available":772837302272,"internally_reserved":0,"allocated":5644288,"data_stored":3214030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12746,"internal_metadata":251055670},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.216900"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162477+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:55:28.162477+0000","last_peered":"2024-05-10T09:55:28.162477+0000","last_clean":"2024-05-10T09:55:28.162477+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:55:28.162477+0000","last_undegraded":"2024-05-10T09:55:28.162477+0000","last_fullsized":"2024-05-10T09:55:28.162477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324436+0000","last_change":"2024-05-10T09:54:41.667015+0000","last_active":"2024-05-10T09:55:28.324436+0000","last_peered":"2024-05-10T09:55:28.324436+0000","last_clean":"2024-05-10T09:55:28.324436+0000","last_became_active":"2024-05-10T09:54:41.666273+0000","last_became_peered":"2024-05-10T09:54:41.666273+0000","last_unstale":"2024-05-10T09:55:28.324436+0000","last_undegraded":"2024-05-10T09:55:28.324436+0000","last_fullsized":"2024-05-10T09:55:28.324436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888180+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:55:27.888180+0000","last_peered":"2024-05-10T09:55:27.888180+0000","last_clean":"2024-05-10T09:55:27.888180+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:55:27.888180+0000","last_undegraded":"2024-05-10T09:55:27.888180+0000","last_fullsized":"2024-05-10T09:55:27.888180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161915+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:55:28.161915+0000","last_peered":"2024-05-10T09:55:28.161915+0000","last_clean":"2024-05-10T09:55:28.161915+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:55:28.161915+0000","last_undegraded":"2024-05-10T09:55:28.161915+0000","last_fullsized":"2024-05-10T09:55:28.161915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222178+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:55:28.222178+0000","last_peered":"2024-05-10T09:55:28.222178+0000","last_clean":"2024-05-10T09:55:28.222178+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:55:28.222178+0000","last_undegraded":"2024-05-10T09:55:28.222178+0000","last_fullsized":"2024-05-10T09:55:28.222178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393243+0000","last_change":"2024-05-10T09:54:41.653638+0000","last_active":"2024-05-10T09:55:27.393243+0000","last_peered":"2024-05-10T09:55:27.393243+0000","last_clean":"2024-05-10T09:55:27.393243+0000","last_became_active":"2024-05-10T09:54:41.652899+0000","last_became_peered":"2024-05-10T09:54:41.652899+0000","last_unstale":"2024-05-10T09:55:27.393243+0000","last_undegraded":"2024-05-10T09:55:27.393243+0000","last_fullsized":"2024-05-10T09:55:27.393243+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324082+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:55:28.324082+0000","last_peered":"2024-05-10T09:55:28.324082+0000","last_clean":"2024-05-10T09:55:28.324082+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:55:28.324082+0000","last_undegraded":"2024-05-10T09:55:28.324082+0000","last_fullsized":"2024-05-10T09:55:28.324082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224054+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:55:28.224054+0000","last_peered":"2024-05-10T09:55:28.224054+0000","last_clean":"2024-05-10T09:55:28.224054+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:55:28.224054+0000","last_undegraded":"2024-05-10T09:55:28.224054+0000","last_fullsized":"2024-05-10T09:55:28.224054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160699+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:55:28.160699+0000","last_peered":"2024-05-10T09:55:28.160699+0000","last_clean":"2024-05-10T09:55:28.160699+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:55:28.160699+0000","last_undegraded":"2024-05-10T09:55:28.160699+0000","last_fullsized":"2024-05-10T09:55:28.160699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276140+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:55:28.276140+0000","last_peered":"2024-05-10T09:55:28.276140+0000","last_clean":"2024-05-10T09:55:28.276140+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:55:28.276140+0000","last_undegraded":"2024-05-10T09:55:28.276140+0000","last_fullsized":"2024-05-10T09:55:28.276140+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324523+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:55:28.324523+0000","last_peered":"2024-05-10T09:55:28.324523+0000","last_clean":"2024-05-10T09:55:28.324523+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:55:28.324523+0000","last_undegraded":"2024-05-10T09:55:28.324523+0000","last_fullsized":"2024-05-10T09:55:28.324523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393546+0000","last_change":"2024-05-10T09:54:41.653073+0000","last_active":"2024-05-10T09:55:27.393546+0000","last_peered":"2024-05-10T09:55:27.393546+0000","last_clean":"2024-05-10T09:55:27.393546+0000","last_became_active":"2024-05-10T09:54:41.652296+0000","last_became_peered":"2024-05-10T09:54:41.652296+0000","last_unstale":"2024-05-10T09:55:27.393546+0000","last_undegraded":"2024-05-10T09:55:27.393546+0000","last_fullsized":"2024-05-10T09:55:27.393546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.391329+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:55:27.391329+0000","last_peered":"2024-05-10T09:55:27.391329+0000","last_clean":"2024-05-10T09:55:27.391329+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:55:27.391329+0000","last_undegraded":"2024-05-10T09:55:27.391329+0000","last_fullsized":"2024-05-10T09:55:27.391329+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325736+0000","last_change":"2024-05-10T09:54:41.671781+0000","last_active":"2024-05-10T09:55:28.325736+0000","last_peered":"2024-05-10T09:55:28.325736+0000","last_clean":"2024-05-10T09:55:28.325736+0000","last_became_active":"2024-05-10T09:54:41.668302+0000","last_became_peered":"2024-05-10T09:54:41.668302+0000","last_unstale":"2024-05-10T09:55:28.325736+0000","last_undegraded":"2024-05-10T09:55:28.325736+0000","last_fullsized":"2024-05-10T09:55:28.325736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:51.449905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395555+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:55:27.395555+0000","last_peered":"2024-05-10T09:55:27.395555+0000","last_clean":"2024-05-10T09:55:27.395555+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:55:27.395555+0000","last_undegraded":"2024-05-10T09:55:27.395555+0000","last_fullsized":"2024-05-10T09:55:27.395555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393933+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:55:27.393933+0000","last_peered":"2024-05-10T09:55:27.393933+0000","last_clean":"2024-05-10T09:55:27.393933+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:55:27.393933+0000","last_undegraded":"2024-05-10T09:55:27.393933+0000","last_fullsized":"2024-05-10T09:55:27.393933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392503+0000","last_change":"2024-05-10T09:54:41.650051+0000","last_active":"2024-05-10T09:55:27.392503+0000","last_peered":"2024-05-10T09:55:27.392503+0000","last_clean":"2024-05-10T09:55:27.392503+0000","last_became_active":"2024-05-10T09:54:41.649076+0000","last_became_peered":"2024-05-10T09:54:41.649076+0000","last_unstale":"2024-05-10T09:55:27.392503+0000","last_undegraded":"2024-05-10T09:55:27.392503+0000","last_fullsized":"2024-05-10T09:55:27.392503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162507+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:55:28.162507+0000","last_peered":"2024-05-10T09:55:28.162507+0000","last_clean":"2024-05-10T09:55:28.162507+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:55:28.162507+0000","last_undegraded":"2024-05-10T09:55:28.162507+0000","last_fullsized":"2024-05-10T09:55:28.162507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162188+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:55:28.162188+0000","last_peered":"2024-05-10T09:55:28.162188+0000","last_clean":"2024-05-10T09:55:28.162188+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:55:28.162188+0000","last_undegraded":"2024-05-10T09:55:28.162188+0000","last_fullsized":"2024-05-10T09:55:28.162188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":59,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276378+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:55:28.276378+0000","last_peered":"2024-05-10T09:55:28.276378+0000","last_clean":"2024-05-10T09:55:28.276378+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:55:28.276378+0000","last_undegraded":"2024-05-10T09:55:28.276378+0000","last_fullsized":"2024-05-10T09:55:28.276378+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324649+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:55:28.324649+0000","last_peered":"2024-05-10T09:55:28.324649+0000","last_clean":"2024-05-10T09:55:28.324649+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:55:28.324649+0000","last_undegraded":"2024-05-10T09:55:28.324649+0000","last_fullsized":"2024-05-10T09:55:28.324649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276622+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:55:28.276622+0000","last_peered":"2024-05-10T09:55:28.276622+0000","last_clean":"2024-05-10T09:55:28.276622+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:55:28.276622+0000","last_undegraded":"2024-05-10T09:55:28.276622+0000","last_fullsized":"2024-05-10T09:55:28.276622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.391769+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:55:27.391769+0000","last_peered":"2024-05-10T09:55:27.391769+0000","last_clean":"2024-05-10T09:55:27.391769+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:55:27.391769+0000","last_undegraded":"2024-05-10T09:55:27.391769+0000","last_fullsized":"2024-05-10T09:55:27.391769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393793+0000","last_change":"2024-05-10T09:54:39.645559+0000","last_active":"2024-05-10T09:55:27.393793+0000","last_peered":"2024-05-10T09:55:27.393793+0000","last_clean":"2024-05-10T09:55:27.393793+0000","last_became_active":"2024-05-10T09:54:39.644846+0000","last_became_peered":"2024-05-10T09:54:39.644846+0000","last_unstale":"2024-05-10T09:55:27.393793+0000","last_undegraded":"2024-05-10T09:55:27.393793+0000","last_fullsized":"2024-05-10T09:55:27.393793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392515+0000","last_change":"2024-05-10T09:54:41.649115+0000","last_active":"2024-05-10T09:55:27.392515+0000","last_peered":"2024-05-10T09:55:27.392515+0000","last_clean":"2024-05-10T09:55:27.392515+0000","last_became_active":"2024-05-10T09:54:41.647430+0000","last_became_peered":"2024-05-10T09:54:41.647430+0000","last_unstale":"2024-05-10T09:55:27.392515+0000","last_undegraded":"2024-05-10T09:55:27.392515+0000","last_fullsized":"2024-05-10T09:55:27.392515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:42.765522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395025+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:55:27.395025+0000","last_peered":"2024-05-10T09:55:27.395025+0000","last_clean":"2024-05-10T09:55:27.395025+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:55:27.395025+0000","last_undegraded":"2024-05-10T09:55:27.395025+0000","last_fullsized":"2024-05-10T09:55:27.395025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393685+0000","last_change":"2024-05-10T09:54:41.682344+0000","last_active":"2024-05-10T09:55:27.393685+0000","last_peered":"2024-05-10T09:55:27.393685+0000","last_clean":"2024-05-10T09:55:27.393685+0000","last_became_active":"2024-05-10T09:54:41.681757+0000","last_became_peered":"2024-05-10T09:54:41.681757+0000","last_unstale":"2024-05-10T09:55:27.393685+0000","last_undegraded":"2024-05-10T09:55:27.393685+0000","last_fullsized":"2024-05-10T09:55:27.393685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224092+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:55:28.224092+0000","last_peered":"2024-05-10T09:55:28.224092+0000","last_clean":"2024-05-10T09:55:28.224092+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:55:28.224092+0000","last_undegraded":"2024-05-10T09:55:28.224092+0000","last_fullsized":"2024-05-10T09:55:28.224092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392216+0000","last_change":"2024-05-10T09:54:49.721834+0000","last_active":"2024-05-10T09:55:27.392216+0000","last_peered":"2024-05-10T09:55:27.392216+0000","last_clean":"2024-05-10T09:55:27.392216+0000","last_became_active":"2024-05-10T09:54:49.721053+0000","last_became_peered":"2024-05-10T09:54:49.721053+0000","last_unstale":"2024-05-10T09:55:27.392216+0000","last_undegraded":"2024-05-10T09:55:27.392216+0000","last_fullsized":"2024-05-10T09:55:27.392216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:57.380622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396450+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:55:27.396450+0000","last_peered":"2024-05-10T09:55:27.396450+0000","last_clean":"2024-05-10T09:55:27.396450+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:55:27.396450+0000","last_undegraded":"2024-05-10T09:55:27.396450+0000","last_fullsized":"2024-05-10T09:55:27.396450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160696+0000","last_change":"2024-05-10T09:54:39.650251+0000","last_active":"2024-05-10T09:55:28.160696+0000","last_peered":"2024-05-10T09:55:28.160696+0000","last_clean":"2024-05-10T09:55:28.160696+0000","last_became_active":"2024-05-10T09:54:39.649230+0000","last_became_peered":"2024-05-10T09:54:39.649230+0000","last_unstale":"2024-05-10T09:55:28.160696+0000","last_undegraded":"2024-05-10T09:55:28.160696+0000","last_fullsized":"2024-05-10T09:55:28.160696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325214+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:55:28.325214+0000","last_peered":"2024-05-10T09:55:28.325214+0000","last_clean":"2024-05-10T09:55:28.325214+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:55:28.325214+0000","last_undegraded":"2024-05-10T09:55:28.325214+0000","last_fullsized":"2024-05-10T09:55:28.325214+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":58,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225012+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:55:28.225012+0000","last_peered":"2024-05-10T09:55:28.225012+0000","last_clean":"2024-05-10T09:55:28.225012+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:55:28.225012+0000","last_undegraded":"2024-05-10T09:55:28.225012+0000","last_fullsized":"2024-05-10T09:55:28.225012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162371+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:55:28.162371+0000","last_peered":"2024-05-10T09:55:28.162371+0000","last_clean":"2024-05-10T09:55:28.162371+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:55:28.162371+0000","last_undegraded":"2024-05-10T09:55:28.162371+0000","last_fullsized":"2024-05-10T09:55:28.162371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324336+0000","last_change":"2024-05-10T09:54:49.714649+0000","last_active":"2024-05-10T09:55:28.324336+0000","last_peered":"2024-05-10T09:55:28.324336+0000","last_clean":"2024-05-10T09:55:28.324336+0000","last_became_active":"2024-05-10T09:54:49.713854+0000","last_became_peered":"2024-05-10T09:54:49.713854+0000","last_unstale":"2024-05-10T09:55:28.324336+0000","last_undegraded":"2024-05-10T09:55:28.324336+0000","last_fullsized":"2024-05-10T09:55:28.324336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325845+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:55:28.325845+0000","last_peered":"2024-05-10T09:55:28.325845+0000","last_clean":"2024-05-10T09:55:28.325845+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:55:28.325845+0000","last_undegraded":"2024-05-10T09:55:28.325845+0000","last_fullsized":"2024-05-10T09:55:28.325845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224249+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:55:28.224249+0000","last_peered":"2024-05-10T09:55:28.224249+0000","last_clean":"2024-05-10T09:55:28.224249+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:55:28.224249+0000","last_undegraded":"2024-05-10T09:55:28.224249+0000","last_fullsized":"2024-05-10T09:55:28.224249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396243+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:55:27.396243+0000","last_peered":"2024-05-10T09:55:27.396243+0000","last_clean":"2024-05-10T09:55:27.396243+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:55:27.396243+0000","last_undegraded":"2024-05-10T09:55:27.396243+0000","last_fullsized":"2024-05-10T09:55:27.396243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":51,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393772+0000","last_change":"2024-05-10T09:54:45.672737+0000","last_active":"2024-05-10T09:55:27.393772+0000","last_peered":"2024-05-10T09:55:27.393772+0000","last_clean":"2024-05-10T09:55:27.393772+0000","last_became_active":"2024-05-10T09:54:45.671969+0000","last_became_peered":"2024-05-10T09:54:45.671969+0000","last_unstale":"2024-05-10T09:55:27.393772+0000","last_undegraded":"2024-05-10T09:55:27.393772+0000","last_fullsized":"2024-05-10T09:55:27.393772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394321+0000","last_change":"2024-05-10T09:54:47.705920+0000","last_active":"2024-05-10T09:55:27.394321+0000","last_peered":"2024-05-10T09:55:27.394321+0000","last_clean":"2024-05-10T09:55:27.394321+0000","last_became_active":"2024-05-10T09:54:47.705078+0000","last_became_peered":"2024-05-10T09:54:47.705078+0000","last_unstale":"2024-05-10T09:55:27.394321+0000","last_undegraded":"2024-05-10T09:55:27.394321+0000","last_fullsized":"2024-05-10T09:55:27.394321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.223731+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:55:28.223731+0000","last_peered":"2024-05-10T09:55:28.223731+0000","last_clean":"2024-05-10T09:55:28.223731+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:55:28.223731+0000","last_undegraded":"2024-05-10T09:55:28.223731+0000","last_fullsized":"2024-05-10T09:55:28.223731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225766+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:55:28.225766+0000","last_peered":"2024-05-10T09:55:28.225766+0000","last_clean":"2024-05-10T09:55:28.225766+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:55:28.225766+0000","last_undegraded":"2024-05-10T09:55:28.225766+0000","last_fullsized":"2024-05-10T09:55:28.225766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160721+0000","last_change":"2024-05-10T09:54:39.656953+0000","last_active":"2024-05-10T09:55:28.160721+0000","last_peered":"2024-05-10T09:55:28.160721+0000","last_clean":"2024-05-10T09:55:28.160721+0000","last_became_active":"2024-05-10T09:54:39.656385+0000","last_became_peered":"2024-05-10T09:54:39.656385+0000","last_unstale":"2024-05-10T09:55:28.160721+0000","last_undegraded":"2024-05-10T09:55:28.160721+0000","last_fullsized":"2024-05-10T09:55:28.160721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.397518+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:55:27.397518+0000","last_peered":"2024-05-10T09:55:27.397518+0000","last_clean":"2024-05-10T09:55:27.397518+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:55:27.397518+0000","last_undegraded":"2024-05-10T09:55:27.397518+0000","last_fullsized":"2024-05-10T09:55:27.397518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":57,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392169+0000","last_change":"2024-05-10T09:54:45.682487+0000","last_active":"2024-05-10T09:55:27.392169+0000","last_peered":"2024-05-10T09:55:27.392169+0000","last_clean":"2024-05-10T09:55:27.392169+0000","last_became_active":"2024-05-10T09:54:45.681037+0000","last_became_peered":"2024-05-10T09:54:45.681037+0000","last_unstale":"2024-05-10T09:55:27.392169+0000","last_undegraded":"2024-05-10T09:55:27.392169+0000","last_fullsized":"2024-05-10T09:55:27.392169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:31.890143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162124+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:55:28.162124+0000","last_peered":"2024-05-10T09:55:28.162124+0000","last_clean":"2024-05-10T09:55:28.162124+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:55:28.162124+0000","last_undegraded":"2024-05-10T09:55:28.162124+0000","last_fullsized":"2024-05-10T09:55:28.162124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392761+0000","last_change":"2024-05-10T09:54:49.698020+0000","last_active":"2024-05-10T09:55:27.392761+0000","last_peered":"2024-05-10T09:55:27.392761+0000","last_clean":"2024-05-10T09:55:27.392761+0000","last_became_active":"2024-05-10T09:54:49.697266+0000","last_became_peered":"2024-05-10T09:54:49.697266+0000","last_unstale":"2024-05-10T09:55:27.392761+0000","last_undegraded":"2024-05-10T09:55:27.392761+0000","last_fullsized":"2024-05-10T09:55:27.392761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:03.046232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.397055+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:55:27.397055+0000","last_peered":"2024-05-10T09:55:27.397055+0000","last_clean":"2024-05-10T09:55:27.397055+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:55:27.397055+0000","last_undegraded":"2024-05-10T09:55:27.397055+0000","last_fullsized":"2024-05-10T09:55:27.397055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275633+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:55:28.275633+0000","last_peered":"2024-05-10T09:55:28.275633+0000","last_clean":"2024-05-10T09:55:28.275633+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:55:28.275633+0000","last_undegraded":"2024-05-10T09:55:28.275633+0000","last_fullsized":"2024-05-10T09:55:28.275633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325285+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:55:28.325285+0000","last_peered":"2024-05-10T09:55:28.325285+0000","last_clean":"2024-05-10T09:55:28.325285+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:55:28.325285+0000","last_undegraded":"2024-05-10T09:55:28.325285+0000","last_fullsized":"2024-05-10T09:55:28.325285+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":58,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161970+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:55:28.161970+0000","last_peered":"2024-05-10T09:55:28.161970+0000","last_clean":"2024-05-10T09:55:28.161970+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:55:28.161970+0000","last_undegraded":"2024-05-10T09:55:28.161970+0000","last_fullsized":"2024-05-10T09:55:28.161970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395467+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:55:27.395467+0000","last_peered":"2024-05-10T09:55:27.395467+0000","last_clean":"2024-05-10T09:55:27.395467+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:55:27.395467+0000","last_undegraded":"2024-05-10T09:55:27.395467+0000","last_fullsized":"2024-05-10T09:55:27.395467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324611+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:55:28.324611+0000","last_peered":"2024-05-10T09:55:28.324611+0000","last_clean":"2024-05-10T09:55:28.324611+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:55:28.324611+0000","last_undegraded":"2024-05-10T09:55:28.324611+0000","last_fullsized":"2024-05-10T09:55:28.324611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160760+0000","last_change":"2024-05-10T09:54:39.655305+0000","last_active":"2024-05-10T09:55:28.160760+0000","last_peered":"2024-05-10T09:55:28.160760+0000","last_clean":"2024-05-10T09:55:28.160760+0000","last_became_active":"2024-05-10T09:54:39.654853+0000","last_became_peered":"2024-05-10T09:54:39.654853+0000","last_unstale":"2024-05-10T09:55:28.160760+0000","last_undegraded":"2024-05-10T09:55:28.160760+0000","last_fullsized":"2024-05-10T09:55:28.160760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161661+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:55:28.161661+0000","last_peered":"2024-05-10T09:55:28.161661+0000","last_clean":"2024-05-10T09:55:28.161661+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:55:28.161661+0000","last_undegraded":"2024-05-10T09:55:28.161661+0000","last_fullsized":"2024-05-10T09:55:28.161661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":73,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324332+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:55:28.324332+0000","last_peered":"2024-05-10T09:55:28.324332+0000","last_clean":"2024-05-10T09:55:28.324332+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:55:28.324332+0000","last_undegraded":"2024-05-10T09:55:28.324332+0000","last_fullsized":"2024-05-10T09:55:28.324332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.886961+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:55:27.886961+0000","last_peered":"2024-05-10T09:55:27.886961+0000","last_clean":"2024-05-10T09:55:27.886961+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:55:27.886961+0000","last_undegraded":"2024-05-10T09:55:27.886961+0000","last_fullsized":"2024-05-10T09:55:27.886961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324962+0000","last_change":"2024-05-10T09:54:49.714403+0000","last_active":"2024-05-10T09:55:28.324962+0000","last_peered":"2024-05-10T09:55:28.324962+0000","last_clean":"2024-05-10T09:55:28.324962+0000","last_became_active":"2024-05-10T09:54:49.713603+0000","last_became_peered":"2024-05-10T09:54:49.713603+0000","last_unstale":"2024-05-10T09:55:28.324962+0000","last_undegraded":"2024-05-10T09:55:28.324962+0000","last_fullsized":"2024-05-10T09:55:28.324962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":55,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393078+0000","last_change":"2024-05-10T09:55:19.501633+0000","last_active":"2024-05-10T09:55:27.393078+0000","last_peered":"2024-05-10T09:55:27.393078+0000","last_clean":"2024-05-10T09:55:27.393078+0000","last_became_active":"2024-05-10T09:55:19.500931+0000","last_became_peered":"2024-05-10T09:55:19.500931+0000","last_unstale":"2024-05-10T09:55:27.393078+0000","last_undegraded":"2024-05-10T09:55:27.393078+0000","last_fullsized":"2024-05-10T09:55:27.393078+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:02.287302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160906+0000","last_change":"2024-05-10T09:54:39.653238+0000","last_active":"2024-05-10T09:55:28.160906+0000","last_peered":"2024-05-10T09:55:28.160906+0000","last_clean":"2024-05-10T09:55:28.160906+0000","last_became_active":"2024-05-10T09:54:39.652480+0000","last_became_peered":"2024-05-10T09:54:39.652480+0000","last_unstale":"2024-05-10T09:55:28.160906+0000","last_undegraded":"2024-05-10T09:55:28.160906+0000","last_fullsized":"2024-05-10T09:55:28.160906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:14.288277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.390973+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:55:27.390973+0000","last_peered":"2024-05-10T09:55:27.390973+0000","last_clean":"2024-05-10T09:55:27.390973+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:55:27.390973+0000","last_undegraded":"2024-05-10T09:55:27.390973+0000","last_fullsized":"2024-05-10T09:55:27.390973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":58,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395578+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:55:27.395578+0000","last_peered":"2024-05-10T09:55:27.395578+0000","last_clean":"2024-05-10T09:55:27.395578+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:55:27.395578+0000","last_undegraded":"2024-05-10T09:55:27.395578+0000","last_fullsized":"2024-05-10T09:55:27.395578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392608+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:55:27.392608+0000","last_peered":"2024-05-10T09:55:27.392608+0000","last_clean":"2024-05-10T09:55:27.392608+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:55:27.392608+0000","last_undegraded":"2024-05-10T09:55:27.392608+0000","last_fullsized":"2024-05-10T09:55:27.392608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276111+0000","last_change":"2024-05-10T09:54:49.713266+0000","last_active":"2024-05-10T09:55:28.276111+0000","last_peered":"2024-05-10T09:55:28.276111+0000","last_clean":"2024-05-10T09:55:28.276111+0000","last_became_active":"2024-05-10T09:54:49.712512+0000","last_became_peered":"2024-05-10T09:54:49.712512+0000","last_unstale":"2024-05-10T09:55:28.276111+0000","last_undegraded":"2024-05-10T09:55:28.276111+0000","last_fullsized":"2024-05-10T09:55:28.276111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:27:03.281217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276139+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:55:28.276139+0000","last_peered":"2024-05-10T09:55:28.276139+0000","last_clean":"2024-05-10T09:55:28.276139+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:55:28.276139+0000","last_undegraded":"2024-05-10T09:55:28.276139+0000","last_fullsized":"2024-05-10T09:55:28.276139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162555+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:55:28.162555+0000","last_peered":"2024-05-10T09:55:28.162555+0000","last_clean":"2024-05-10T09:55:28.162555+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:55:28.162555+0000","last_undegraded":"2024-05-10T09:55:28.162555+0000","last_fullsized":"2024-05-10T09:55:28.162555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392603+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:55:27.392603+0000","last_peered":"2024-05-10T09:55:27.392603+0000","last_clean":"2024-05-10T09:55:27.392603+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:55:27.392603+0000","last_undegraded":"2024-05-10T09:55:27.392603+0000","last_fullsized":"2024-05-10T09:55:27.392603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161329+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:55:28.161329+0000","last_peered":"2024-05-10T09:55:28.161329+0000","last_clean":"2024-05-10T09:55:28.161329+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:55:28.161329+0000","last_undegraded":"2024-05-10T09:55:28.161329+0000","last_fullsized":"2024-05-10T09:55:28.161329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.223386+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:55:28.223386+0000","last_peered":"2024-05-10T09:55:28.223386+0000","last_clean":"2024-05-10T09:55:28.223386+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:55:28.223386+0000","last_undegraded":"2024-05-10T09:55:28.223386+0000","last_fullsized":"2024-05-10T09:55:28.223386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225006+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:55:28.225006+0000","last_peered":"2024-05-10T09:55:28.225006+0000","last_clean":"2024-05-10T09:55:28.225006+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:55:28.225006+0000","last_undegraded":"2024-05-10T09:55:28.225006+0000","last_fullsized":"2024-05-10T09:55:28.225006+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224799+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:55:28.224799+0000","last_peered":"2024-05-10T09:55:28.224799+0000","last_clean":"2024-05-10T09:55:28.224799+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:55:28.224799+0000","last_undegraded":"2024-05-10T09:55:28.224799+0000","last_fullsized":"2024-05-10T09:55:28.224799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.323761+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:55:28.323761+0000","last_peered":"2024-05-10T09:55:28.323761+0000","last_clean":"2024-05-10T09:55:28.323761+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:55:28.323761+0000","last_undegraded":"2024-05-10T09:55:28.323761+0000","last_fullsized":"2024-05-10T09:55:28.323761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.391925+0000","last_change":"2024-05-10T09:54:43.670736+0000","last_active":"2024-05-10T09:55:27.391925+0000","last_peered":"2024-05-10T09:55:27.391925+0000","last_clean":"2024-05-10T09:55:27.391925+0000","last_became_active":"2024-05-10T09:54:43.670051+0000","last_became_peered":"2024-05-10T09:54:43.670051+0000","last_unstale":"2024-05-10T09:55:27.391925+0000","last_undegraded":"2024-05-10T09:55:27.391925+0000","last_fullsized":"2024-05-10T09:55:27.391925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:06.739493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":65,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.223619+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:55:28.223619+0000","last_peered":"2024-05-10T09:55:28.223619+0000","last_clean":"2024-05-10T09:55:28.223619+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:55:28.223619+0000","last_undegraded":"2024-05-10T09:55:28.223619+0000","last_fullsized":"2024-05-10T09:55:28.223619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.390748+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:55:27.390748+0000","last_peered":"2024-05-10T09:55:27.390748+0000","last_clean":"2024-05-10T09:55:27.390748+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:55:27.390748+0000","last_undegraded":"2024-05-10T09:55:27.390748+0000","last_fullsized":"2024-05-10T09:55:27.390748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.887845+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:55:27.887845+0000","last_peered":"2024-05-10T09:55:27.887845+0000","last_clean":"2024-05-10T09:55:27.887845+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:55:27.887845+0000","last_undegraded":"2024-05-10T09:55:27.887845+0000","last_fullsized":"2024-05-10T09:55:27.887845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394162+0000","last_change":"2024-05-10T09:54:41.660216+0000","last_active":"2024-05-10T09:55:27.394162+0000","last_peered":"2024-05-10T09:55:27.394162+0000","last_clean":"2024-05-10T09:55:27.394162+0000","last_became_active":"2024-05-10T09:54:41.659431+0000","last_became_peered":"2024-05-10T09:54:41.659431+0000","last_unstale":"2024-05-10T09:55:27.394162+0000","last_undegraded":"2024-05-10T09:55:27.394162+0000","last_fullsized":"2024-05-10T09:55:27.394162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394702+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:55:27.394702+0000","last_peered":"2024-05-10T09:55:27.394702+0000","last_clean":"2024-05-10T09:55:27.394702+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:55:27.394702+0000","last_undegraded":"2024-05-10T09:55:27.394702+0000","last_fullsized":"2024-05-10T09:55:27.394702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.391863+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:55:27.391863+0000","last_peered":"2024-05-10T09:55:27.391863+0000","last_clean":"2024-05-10T09:55:27.391863+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:55:27.391863+0000","last_undegraded":"2024-05-10T09:55:27.391863+0000","last_fullsized":"2024-05-10T09:55:27.391863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":61,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394466+0000","last_change":"2024-05-10T09:54:45.680787+0000","last_active":"2024-05-10T09:55:27.394466+0000","last_peered":"2024-05-10T09:55:27.394466+0000","last_clean":"2024-05-10T09:55:27.394466+0000","last_became_active":"2024-05-10T09:54:45.680051+0000","last_became_peered":"2024-05-10T09:54:45.680051+0000","last_unstale":"2024-05-10T09:55:27.394466+0000","last_undegraded":"2024-05-10T09:55:27.394466+0000","last_fullsized":"2024-05-10T09:55:27.394466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222458+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:55:28.222458+0000","last_peered":"2024-05-10T09:55:28.222458+0000","last_clean":"2024-05-10T09:55:28.222458+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:55:28.222458+0000","last_undegraded":"2024-05-10T09:55:28.222458+0000","last_fullsized":"2024-05-10T09:55:28.222458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394074+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:55:27.394074+0000","last_peered":"2024-05-10T09:55:27.394074+0000","last_clean":"2024-05-10T09:55:27.394074+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:55:27.394074+0000","last_undegraded":"2024-05-10T09:55:27.394074+0000","last_fullsized":"2024-05-10T09:55:27.394074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393675+0000","last_change":"2024-05-10T09:54:41.642683+0000","last_active":"2024-05-10T09:55:27.393675+0000","last_peered":"2024-05-10T09:55:27.393675+0000","last_clean":"2024-05-10T09:55:27.393675+0000","last_became_active":"2024-05-10T09:54:41.641669+0000","last_became_peered":"2024-05-10T09:54:41.641669+0000","last_unstale":"2024-05-10T09:55:27.393675+0000","last_undegraded":"2024-05-10T09:55:27.393675+0000","last_fullsized":"2024-05-10T09:55:27.393675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275030+0000","last_change":"2024-05-10T09:54:39.642724+0000","last_active":"2024-05-10T09:55:28.275030+0000","last_peered":"2024-05-10T09:55:28.275030+0000","last_clean":"2024-05-10T09:55:28.275030+0000","last_became_active":"2024-05-10T09:54:39.641876+0000","last_became_peered":"2024-05-10T09:54:39.641876+0000","last_unstale":"2024-05-10T09:55:28.275030+0000","last_undegraded":"2024-05-10T09:55:28.275030+0000","last_fullsized":"2024-05-10T09:55:28.275030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:46.367837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.887439+0000","last_change":"2024-05-10T09:54:43.676085+0000","last_active":"2024-05-10T09:55:27.887439+0000","last_peered":"2024-05-10T09:55:27.887439+0000","last_clean":"2024-05-10T09:55:27.887439+0000","last_became_active":"2024-05-10T09:54:43.675436+0000","last_became_peered":"2024-05-10T09:54:43.675436+0000","last_unstale":"2024-05-10T09:55:27.887439+0000","last_undegraded":"2024-05-10T09:55:27.887439+0000","last_fullsized":"2024-05-10T09:55:27.887439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:44.545569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393509+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:55:27.393509+0000","last_peered":"2024-05-10T09:55:27.393509+0000","last_clean":"2024-05-10T09:55:27.393509+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:55:27.393509+0000","last_undegraded":"2024-05-10T09:55:27.393509+0000","last_fullsized":"2024-05-10T09:55:27.393509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394486+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:55:27.394486+0000","last_peered":"2024-05-10T09:55:27.394486+0000","last_clean":"2024-05-10T09:55:27.394486+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:55:27.394486+0000","last_undegraded":"2024-05-10T09:55:27.394486+0000","last_fullsized":"2024-05-10T09:55:27.394486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.886603+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:55:27.886603+0000","last_peered":"2024-05-10T09:55:27.886603+0000","last_clean":"2024-05-10T09:55:27.886603+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:55:27.886603+0000","last_undegraded":"2024-05-10T09:55:27.886603+0000","last_fullsized":"2024-05-10T09:55:27.886603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394932+0000","last_change":"2024-05-10T09:54:41.679291+0000","last_active":"2024-05-10T09:55:27.394932+0000","last_peered":"2024-05-10T09:55:27.394932+0000","last_clean":"2024-05-10T09:55:27.394932+0000","last_became_active":"2024-05-10T09:54:41.678293+0000","last_became_peered":"2024-05-10T09:54:41.678293+0000","last_unstale":"2024-05-10T09:55:27.394932+0000","last_undegraded":"2024-05-10T09:55:27.394932+0000","last_fullsized":"2024-05-10T09:55:27.394932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:51.449905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394049+0000","last_change":"2024-05-10T09:54:39.616968+0000","last_active":"2024-05-10T09:55:27.394049+0000","last_peered":"2024-05-10T09:55:27.394049+0000","last_clean":"2024-05-10T09:55:27.394049+0000","last_became_active":"2024-05-10T09:54:39.616425+0000","last_became_peered":"2024-05-10T09:54:39.616425+0000","last_unstale":"2024-05-10T09:55:27.394049+0000","last_undegraded":"2024-05-10T09:55:27.394049+0000","last_fullsized":"2024-05-10T09:55:27.394049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:46.367837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325295+0000","last_change":"2024-05-10T09:54:43.678495+0000","last_active":"2024-05-10T09:55:28.325295+0000","last_peered":"2024-05-10T09:55:28.325295+0000","last_clean":"2024-05-10T09:55:28.325295+0000","last_became_active":"2024-05-10T09:54:43.677157+0000","last_became_peered":"2024-05-10T09:54:43.677157+0000","last_unstale":"2024-05-10T09:55:28.325295+0000","last_undegraded":"2024-05-10T09:55:28.325295+0000","last_fullsized":"2024-05-10T09:55:28.325295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:56:58.560484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":57,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395639+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:55:27.395639+0000","last_peered":"2024-05-10T09:55:27.395639+0000","last_clean":"2024-05-10T09:55:27.395639+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:55:27.395639+0000","last_undegraded":"2024-05-10T09:55:27.395639+0000","last_fullsized":"2024-05-10T09:55:27.395639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276346+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:55:28.276346+0000","last_peered":"2024-05-10T09:55:28.276346+0000","last_clean":"2024-05-10T09:55:28.276346+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:55:28.276346+0000","last_undegraded":"2024-05-10T09:55:28.276346+0000","last_fullsized":"2024-05-10T09:55:28.276346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393022+0000","last_change":"2024-05-10T09:54:49.702101+0000","last_active":"2024-05-10T09:55:27.393022+0000","last_peered":"2024-05-10T09:55:27.393022+0000","last_clean":"2024-05-10T09:55:27.393022+0000","last_became_active":"2024-05-10T09:54:49.701351+0000","last_became_peered":"2024-05-10T09:54:49.701351+0000","last_unstale":"2024-05-10T09:55:27.393022+0000","last_undegraded":"2024-05-10T09:55:27.393022+0000","last_fullsized":"2024-05-10T09:55:27.393022+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888296+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:55:27.888296+0000","last_peered":"2024-05-10T09:55:27.888296+0000","last_clean":"2024-05-10T09:55:27.888296+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:55:27.888296+0000","last_undegraded":"2024-05-10T09:55:27.888296+0000","last_fullsized":"2024-05-10T09:55:27.888296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395826+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:55:27.395826+0000","last_peered":"2024-05-10T09:55:27.395826+0000","last_clean":"2024-05-10T09:55:27.395826+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:55:27.395826+0000","last_undegraded":"2024-05-10T09:55:27.395826+0000","last_fullsized":"2024-05-10T09:55:27.395826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394719+0000","last_change":"2024-05-10T09:54:43.670667+0000","last_active":"2024-05-10T09:55:27.394719+0000","last_peered":"2024-05-10T09:55:27.394719+0000","last_clean":"2024-05-10T09:55:27.394719+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:55:27.394719+0000","last_undegraded":"2024-05-10T09:55:27.394719+0000","last_fullsized":"2024-05-10T09:55:27.394719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":70,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325057+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:55:28.325057+0000","last_peered":"2024-05-10T09:55:28.325057+0000","last_clean":"2024-05-10T09:55:28.325057+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:55:28.325057+0000","last_undegraded":"2024-05-10T09:55:28.325057+0000","last_fullsized":"2024-05-10T09:55:28.325057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275231+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:55:28.275231+0000","last_peered":"2024-05-10T09:55:28.275231+0000","last_clean":"2024-05-10T09:55:28.275231+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:55:28.275231+0000","last_undegraded":"2024-05-10T09:55:28.275231+0000","last_fullsized":"2024-05-10T09:55:28.275231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.886865+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:55:27.886865+0000","last_peered":"2024-05-10T09:55:27.886865+0000","last_clean":"2024-05-10T09:55:27.886865+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:55:27.886865+0000","last_undegraded":"2024-05-10T09:55:27.886865+0000","last_fullsized":"2024-05-10T09:55:27.886865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276554+0000","last_change":"2024-05-10T09:54:41.676551+0000","last_active":"2024-05-10T09:55:28.276554+0000","last_peered":"2024-05-10T09:55:28.276554+0000","last_clean":"2024-05-10T09:55:28.276554+0000","last_became_active":"2024-05-10T09:54:41.675775+0000","last_became_peered":"2024-05-10T09:54:41.675775+0000","last_unstale":"2024-05-10T09:55:28.276554+0000","last_undegraded":"2024-05-10T09:55:28.276554+0000","last_fullsized":"2024-05-10T09:55:28.276554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:41.940007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":156,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161375+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:55:28.161375+0000","last_peered":"2024-05-10T09:55:28.161375+0000","last_clean":"2024-05-10T09:55:28.161375+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:55:28.161375+0000","last_undegraded":"2024-05-10T09:55:28.161375+0000","last_fullsized":"2024-05-10T09:55:28.161375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324985+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:55:28.324985+0000","last_peered":"2024-05-10T09:55:28.324985+0000","last_clean":"2024-05-10T09:55:28.324985+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:55:28.324985+0000","last_undegraded":"2024-05-10T09:55:28.324985+0000","last_fullsized":"2024-05-10T09:55:28.324985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394316+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:55:27.394316+0000","last_peered":"2024-05-10T09:55:27.394316+0000","last_clean":"2024-05-10T09:55:27.394316+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:55:27.394316+0000","last_undegraded":"2024-05-10T09:55:27.394316+0000","last_fullsized":"2024-05-10T09:55:27.394316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161962+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:55:28.161962+0000","last_peered":"2024-05-10T09:55:28.161962+0000","last_clean":"2024-05-10T09:55:28.161962+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:55:28.161962+0000","last_undegraded":"2024-05-10T09:55:28.161962+0000","last_fullsized":"2024-05-10T09:55:28.161962+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":69,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325826+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:55:28.325826+0000","last_peered":"2024-05-10T09:55:28.325826+0000","last_clean":"2024-05-10T09:55:28.325826+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:55:28.325826+0000","last_undegraded":"2024-05-10T09:55:28.325826+0000","last_fullsized":"2024-05-10T09:55:28.325826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225187+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:55:28.225187+0000","last_peered":"2024-05-10T09:55:28.225187+0000","last_clean":"2024-05-10T09:55:28.225187+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:55:28.225187+0000","last_undegraded":"2024-05-10T09:55:28.225187+0000","last_fullsized":"2024-05-10T09:55:28.225187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275393+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:55:28.275393+0000","last_peered":"2024-05-10T09:55:28.275393+0000","last_clean":"2024-05-10T09:55:28.275393+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:55:28.275393+0000","last_undegraded":"2024-05-10T09:55:28.275393+0000","last_fullsized":"2024-05-10T09:55:28.275393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225585+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:55:28.225585+0000","last_peered":"2024-05-10T09:55:28.225585+0000","last_clean":"2024-05-10T09:55:28.225585+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:55:28.225585+0000","last_undegraded":"2024-05-10T09:55:28.225585+0000","last_fullsized":"2024-05-10T09:55:28.225585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161261+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:55:28.161261+0000","last_peered":"2024-05-10T09:55:28.161261+0000","last_clean":"2024-05-10T09:55:28.161261+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:55:28.161261+0000","last_undegraded":"2024-05-10T09:55:28.161261+0000","last_fullsized":"2024-05-10T09:55:28.161261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222080+0000","last_change":"2024-05-10T09:54:39.641338+0000","last_active":"2024-05-10T09:55:28.222080+0000","last_peered":"2024-05-10T09:55:28.222080+0000","last_clean":"2024-05-10T09:55:28.222080+0000","last_became_active":"2024-05-10T09:54:39.641097+0000","last_became_peered":"2024-05-10T09:54:39.641097+0000","last_unstale":"2024-05-10T09:55:28.222080+0000","last_undegraded":"2024-05-10T09:55:28.222080+0000","last_fullsized":"2024-05-10T09:55:28.222080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.326049+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:55:28.326049+0000","last_peered":"2024-05-10T09:55:28.326049+0000","last_clean":"2024-05-10T09:55:28.326049+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:55:28.326049+0000","last_undegraded":"2024-05-10T09:55:28.326049+0000","last_fullsized":"2024-05-10T09:55:28.326049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":92,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.887215+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:55:27.887215+0000","last_peered":"2024-05-10T09:55:27.887215+0000","last_clean":"2024-05-10T09:55:27.887215+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:55:27.887215+0000","last_undegraded":"2024-05-10T09:55:27.887215+0000","last_fullsized":"2024-05-10T09:55:27.887215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160915+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:55:28.160915+0000","last_peered":"2024-05-10T09:55:28.160915+0000","last_clean":"2024-05-10T09:55:28.160915+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:55:28.160915+0000","last_undegraded":"2024-05-10T09:55:28.160915+0000","last_fullsized":"2024-05-10T09:55:28.160915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.886439+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:55:27.886439+0000","last_peered":"2024-05-10T09:55:27.886439+0000","last_clean":"2024-05-10T09:55:27.886439+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:55:27.886439+0000","last_undegraded":"2024-05-10T09:55:27.886439+0000","last_fullsized":"2024-05-10T09:55:27.886439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888466+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:55:27.888466+0000","last_peered":"2024-05-10T09:55:27.888466+0000","last_clean":"2024-05-10T09:55:27.888466+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:55:27.888466+0000","last_undegraded":"2024-05-10T09:55:27.888466+0000","last_fullsized":"2024-05-10T09:55:27.888466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392195+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:55:27.392195+0000","last_peered":"2024-05-10T09:55:27.392195+0000","last_clean":"2024-05-10T09:55:27.392195+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:55:27.392195+0000","last_undegraded":"2024-05-10T09:55:27.392195+0000","last_fullsized":"2024-05-10T09:55:27.392195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.885609+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:55:27.885609+0000","last_peered":"2024-05-10T09:55:27.885609+0000","last_clean":"2024-05-10T09:55:27.885609+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:55:27.885609+0000","last_undegraded":"2024-05-10T09:55:27.885609+0000","last_fullsized":"2024-05-10T09:55:27.885609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":47,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394753+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:55:27.394753+0000","last_peered":"2024-05-10T09:55:27.394753+0000","last_clean":"2024-05-10T09:55:27.394753+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:55:27.394753+0000","last_undegraded":"2024-05-10T09:55:27.394753+0000","last_fullsized":"2024-05-10T09:55:27.394753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":72,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162306+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:55:28.162306+0000","last_peered":"2024-05-10T09:55:28.162306+0000","last_clean":"2024-05-10T09:55:28.162306+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:55:28.162306+0000","last_undegraded":"2024-05-10T09:55:28.162306+0000","last_fullsized":"2024-05-10T09:55:28.162306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222178+0000","last_change":"2024-05-10T09:54:47.692709+0000","last_active":"2024-05-10T09:55:28.222178+0000","last_peered":"2024-05-10T09:55:28.222178+0000","last_clean":"2024-05-10T09:55:28.222178+0000","last_became_active":"2024-05-10T09:54:47.691803+0000","last_became_peered":"2024-05-10T09:54:47.691803+0000","last_unstale":"2024-05-10T09:55:28.222178+0000","last_undegraded":"2024-05-10T09:55:28.222178+0000","last_fullsized":"2024-05-10T09:55:28.222178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395316+0000","last_change":"2024-05-10T09:54:49.720781+0000","last_active":"2024-05-10T09:55:27.395316+0000","last_peered":"2024-05-10T09:55:27.395316+0000","last_clean":"2024-05-10T09:55:27.395316+0000","last_became_active":"2024-05-10T09:54:49.719403+0000","last_became_peered":"2024-05-10T09:54:49.719403+0000","last_unstale":"2024-05-10T09:55:27.395316+0000","last_undegraded":"2024-05-10T09:55:27.395316+0000","last_fullsized":"2024-05-10T09:55:27.395316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:39.459750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888350+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:55:27.888350+0000","last_peered":"2024-05-10T09:55:27.888350+0000","last_clean":"2024-05-10T09:55:27.888350+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:55:27.888350+0000","last_undegraded":"2024-05-10T09:55:27.888350+0000","last_fullsized":"2024-05-10T09:55:27.888350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324756+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:55:28.324756+0000","last_peered":"2024-05-10T09:55:28.324756+0000","last_clean":"2024-05-10T09:55:28.324756+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:55:28.324756+0000","last_undegraded":"2024-05-10T09:55:28.324756+0000","last_fullsized":"2024-05-10T09:55:28.324756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393323+0000","last_change":"2024-05-10T09:54:39.625577+0000","last_active":"2024-05-10T09:55:27.393323+0000","last_peered":"2024-05-10T09:55:27.393323+0000","last_clean":"2024-05-10T09:55:27.393323+0000","last_became_active":"2024-05-10T09:54:39.624844+0000","last_became_peered":"2024-05-10T09:54:39.624844+0000","last_unstale":"2024-05-10T09:55:27.393323+0000","last_undegraded":"2024-05-10T09:55:27.393323+0000","last_fullsized":"2024-05-10T09:55:27.393323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:17:12.050190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224715+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:55:28.224715+0000","last_peered":"2024-05-10T09:55:28.224715+0000","last_clean":"2024-05-10T09:55:28.224715+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:55:28.224715+0000","last_undegraded":"2024-05-10T09:55:28.224715+0000","last_fullsized":"2024-05-10T09:55:28.224715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396339+0000","last_change":"2024-05-10T09:54:45.683260+0000","last_active":"2024-05-10T09:55:27.396339+0000","last_peered":"2024-05-10T09:55:27.396339+0000","last_clean":"2024-05-10T09:55:27.396339+0000","last_became_active":"2024-05-10T09:54:45.682646+0000","last_became_peered":"2024-05-10T09:54:45.682646+0000","last_unstale":"2024-05-10T09:55:27.396339+0000","last_undegraded":"2024-05-10T09:55:27.396339+0000","last_fullsized":"2024-05-10T09:55:27.396339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:07.295363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276566+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:55:28.276566+0000","last_peered":"2024-05-10T09:55:28.276566+0000","last_clean":"2024-05-10T09:55:28.276566+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:55:28.276566+0000","last_undegraded":"2024-05-10T09:55:28.276566+0000","last_fullsized":"2024-05-10T09:55:28.276566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324187+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:55:28.324187+0000","last_peered":"2024-05-10T09:55:28.324187+0000","last_clean":"2024-05-10T09:55:28.324187+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:55:28.324187+0000","last_undegraded":"2024-05-10T09:55:28.324187+0000","last_fullsized":"2024-05-10T09:55:28.324187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.886920+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:55:27.886920+0000","last_peered":"2024-05-10T09:55:27.886920+0000","last_clean":"2024-05-10T09:55:27.886920+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:55:27.886920+0000","last_undegraded":"2024-05-10T09:55:27.886920+0000","last_fullsized":"2024-05-10T09:55:27.886920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.323963+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:55:28.323963+0000","last_peered":"2024-05-10T09:55:28.323963+0000","last_clean":"2024-05-10T09:55:28.323963+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:55:28.323963+0000","last_undegraded":"2024-05-10T09:55:28.323963+0000","last_fullsized":"2024-05-10T09:55:28.323963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888120+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:55:27.888120+0000","last_peered":"2024-05-10T09:55:27.888120+0000","last_clean":"2024-05-10T09:55:27.888120+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:55:27.888120+0000","last_undegraded":"2024-05-10T09:55:27.888120+0000","last_fullsized":"2024-05-10T09:55:27.888120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224250+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:55:28.224250+0000","last_peered":"2024-05-10T09:55:28.224250+0000","last_clean":"2024-05-10T09:55:28.224250+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:55:28.224250+0000","last_undegraded":"2024-05-10T09:55:28.224250+0000","last_fullsized":"2024-05-10T09:55:28.224250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":74,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.223541+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:55:28.223541+0000","last_peered":"2024-05-10T09:55:28.223541+0000","last_clean":"2024-05-10T09:55:28.223541+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:55:28.223541+0000","last_undegraded":"2024-05-10T09:55:28.223541+0000","last_fullsized":"2024-05-10T09:55:28.223541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392590+0000","last_change":"2024-05-10T09:54:47.714622+0000","last_active":"2024-05-10T09:55:27.392590+0000","last_peered":"2024-05-10T09:55:27.392590+0000","last_clean":"2024-05-10T09:55:27.392590+0000","last_became_active":"2024-05-10T09:54:47.713840+0000","last_became_peered":"2024-05-10T09:54:47.713840+0000","last_unstale":"2024-05-10T09:55:27.392590+0000","last_undegraded":"2024-05-10T09:55:27.392590+0000","last_fullsized":"2024-05-10T09:55:27.392590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224651+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:55:28.224651+0000","last_peered":"2024-05-10T09:55:28.224651+0000","last_clean":"2024-05-10T09:55:28.224651+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:55:28.224651+0000","last_undegraded":"2024-05-10T09:55:28.224651+0000","last_fullsized":"2024-05-10T09:55:28.224651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224794+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:55:28.224794+0000","last_peered":"2024-05-10T09:55:28.224794+0000","last_clean":"2024-05-10T09:55:28.224794+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:55:28.224794+0000","last_undegraded":"2024-05-10T09:55:28.224794+0000","last_fullsized":"2024-05-10T09:55:28.224794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.885438+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:55:27.885438+0000","last_peered":"2024-05-10T09:55:27.885438+0000","last_clean":"2024-05-10T09:55:27.885438+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:55:27.885438+0000","last_undegraded":"2024-05-10T09:55:27.885438+0000","last_fullsized":"2024-05-10T09:55:27.885438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162682+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:55:28.162682+0000","last_peered":"2024-05-10T09:55:28.162682+0000","last_clean":"2024-05-10T09:55:28.162682+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:55:28.162682+0000","last_undegraded":"2024-05-10T09:55:28.162682+0000","last_fullsized":"2024-05-10T09:55:28.162682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":48,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275978+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:55:28.275978+0000","last_peered":"2024-05-10T09:55:28.275978+0000","last_clean":"2024-05-10T09:55:28.275978+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:55:28.275978+0000","last_undegraded":"2024-05-10T09:55:28.275978+0000","last_fullsized":"2024-05-10T09:55:28.275978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":63,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.886043+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:55:27.886043+0000","last_peered":"2024-05-10T09:55:27.886043+0000","last_clean":"2024-05-10T09:55:27.886043+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:55:27.886043+0000","last_undegraded":"2024-05-10T09:55:27.886043+0000","last_fullsized":"2024-05-10T09:55:27.886043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324737+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:55:28.324737+0000","last_peered":"2024-05-10T09:55:28.324737+0000","last_clean":"2024-05-10T09:55:28.324737+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:55:28.324737+0000","last_undegraded":"2024-05-10T09:55:28.324737+0000","last_fullsized":"2024-05-10T09:55:28.324737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.397177+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:55:27.397177+0000","last_peered":"2024-05-10T09:55:27.397177+0000","last_clean":"2024-05-10T09:55:27.397177+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:55:27.397177+0000","last_undegraded":"2024-05-10T09:55:27.397177+0000","last_fullsized":"2024-05-10T09:55:27.397177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395057+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:55:27.395057+0000","last_peered":"2024-05-10T09:55:27.395057+0000","last_clean":"2024-05-10T09:55:27.395057+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:55:27.395057+0000","last_undegraded":"2024-05-10T09:55:27.395057+0000","last_fullsized":"2024-05-10T09:55:27.395057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396905+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:55:27.396905+0000","last_peered":"2024-05-10T09:55:27.396905+0000","last_clean":"2024-05-10T09:55:27.396905+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:55:27.396905+0000","last_undegraded":"2024-05-10T09:55:27.396905+0000","last_fullsized":"2024-05-10T09:55:27.396905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888337+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:55:27.888337+0000","last_peered":"2024-05-10T09:55:27.888337+0000","last_clean":"2024-05-10T09:55:27.888337+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:55:27.888337+0000","last_undegraded":"2024-05-10T09:55:27.888337+0000","last_fullsized":"2024-05-10T09:55:27.888337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393021+0000","last_change":"2024-05-10T09:54:43.675983+0000","last_active":"2024-05-10T09:55:27.393021+0000","last_peered":"2024-05-10T09:55:27.393021+0000","last_clean":"2024-05-10T09:55:27.393021+0000","last_became_active":"2024-05-10T09:54:43.675216+0000","last_became_peered":"2024-05-10T09:54:43.675216+0000","last_unstale":"2024-05-10T09:55:27.393021+0000","last_undegraded":"2024-05-10T09:55:27.393021+0000","last_fullsized":"2024-05-10T09:55:27.393021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:04.447968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":57,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393302+0000","last_change":"2024-05-10T09:54:45.678454+0000","last_active":"2024-05-10T09:55:27.393302+0000","last_peered":"2024-05-10T09:55:27.393302+0000","last_clean":"2024-05-10T09:55:27.393302+0000","last_became_active":"2024-05-10T09:54:45.677332+0000","last_became_peered":"2024-05-10T09:54:45.677332+0000","last_unstale":"2024-05-10T09:55:27.393302+0000","last_undegraded":"2024-05-10T09:55:27.393302+0000","last_fullsized":"2024-05-10T09:55:27.393302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396300+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:55:27.396300+0000","last_peered":"2024-05-10T09:55:27.396300+0000","last_clean":"2024-05-10T09:55:27.396300+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:55:27.396300+0000","last_undegraded":"2024-05-10T09:55:27.396300+0000","last_fullsized":"2024-05-10T09:55:27.396300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224332+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:55:28.224332+0000","last_peered":"2024-05-10T09:55:28.224332+0000","last_clean":"2024-05-10T09:55:28.224332+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:55:28.224332+0000","last_undegraded":"2024-05-10T09:55:28.224332+0000","last_fullsized":"2024-05-10T09:55:28.224332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393266+0000","last_change":"2024-05-10T09:54:41.666849+0000","last_active":"2024-05-10T09:55:27.393266+0000","last_peered":"2024-05-10T09:55:27.393266+0000","last_clean":"2024-05-10T09:55:27.393266+0000","last_became_active":"2024-05-10T09:54:41.666154+0000","last_became_peered":"2024-05-10T09:54:41.666154+0000","last_unstale":"2024-05-10T09:55:27.393266+0000","last_undegraded":"2024-05-10T09:55:27.393266+0000","last_fullsized":"2024-05-10T09:55:27.393266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:02.444561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225822+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:55:28.225822+0000","last_peered":"2024-05-10T09:55:28.225822+0000","last_clean":"2024-05-10T09:55:28.225822+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:55:28.225822+0000","last_undegraded":"2024-05-10T09:55:28.225822+0000","last_fullsized":"2024-05-10T09:55:28.225822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276784+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:55:28.276784+0000","last_peered":"2024-05-10T09:55:28.276784+0000","last_clean":"2024-05-10T09:55:28.276784+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:55:28.276784+0000","last_undegraded":"2024-05-10T09:55:28.276784+0000","last_fullsized":"2024-05-10T09:55:28.276784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394792+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:55:27.394792+0000","last_peered":"2024-05-10T09:55:27.394792+0000","last_clean":"2024-05-10T09:55:27.394792+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:55:27.394792+0000","last_undegraded":"2024-05-10T09:55:27.394792+0000","last_fullsized":"2024-05-10T09:55:27.394792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":78,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161698+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:55:28.161698+0000","last_peered":"2024-05-10T09:55:28.161698+0000","last_clean":"2024-05-10T09:55:28.161698+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:55:28.161698+0000","last_undegraded":"2024-05-10T09:55:28.161698+0000","last_fullsized":"2024-05-10T09:55:28.161698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392825+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:55:27.392825+0000","last_peered":"2024-05-10T09:55:27.392825+0000","last_clean":"2024-05-10T09:55:27.392825+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:55:27.392825+0000","last_undegraded":"2024-05-10T09:55:27.392825+0000","last_fullsized":"2024-05-10T09:55:27.392825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325045+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:55:28.325045+0000","last_peered":"2024-05-10T09:55:28.325045+0000","last_clean":"2024-05-10T09:55:28.325045+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:55:28.325045+0000","last_undegraded":"2024-05-10T09:55:28.325045+0000","last_fullsized":"2024-05-10T09:55:28.325045+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225027+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:55:28.225027+0000","last_peered":"2024-05-10T09:55:28.225027+0000","last_clean":"2024-05-10T09:55:28.225027+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:55:28.225027+0000","last_undegraded":"2024-05-10T09:55:28.225027+0000","last_fullsized":"2024-05-10T09:55:28.225027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392987+0000","last_change":"2024-05-10T09:54:41.679647+0000","last_active":"2024-05-10T09:55:27.392987+0000","last_peered":"2024-05-10T09:55:27.392987+0000","last_clean":"2024-05-10T09:55:27.392987+0000","last_became_active":"2024-05-10T09:54:41.676614+0000","last_became_peered":"2024-05-10T09:54:41.676614+0000","last_unstale":"2024-05-10T09:55:27.392987+0000","last_undegraded":"2024-05-10T09:55:27.392987+0000","last_fullsized":"2024-05-10T09:55:27.392987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393683+0000","last_change":"2024-05-10T09:54:39.641072+0000","last_active":"2024-05-10T09:55:27.393683+0000","last_peered":"2024-05-10T09:55:27.393683+0000","last_clean":"2024-05-10T09:55:27.393683+0000","last_became_active":"2024-05-10T09:54:39.632868+0000","last_became_peered":"2024-05-10T09:54:39.632868+0000","last_unstale":"2024-05-10T09:55:27.393683+0000","last_undegraded":"2024-05-10T09:55:27.393683+0000","last_fullsized":"2024-05-10T09:55:27.393683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.887172+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:55:27.887172+0000","last_peered":"2024-05-10T09:55:27.887172+0000","last_clean":"2024-05-10T09:55:27.887172+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:55:27.887172+0000","last_undegraded":"2024-05-10T09:55:27.887172+0000","last_fullsized":"2024-05-10T09:55:27.887172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":61,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392114+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:55:27.392114+0000","last_peered":"2024-05-10T09:55:27.392114+0000","last_clean":"2024-05-10T09:55:27.392114+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:55:27.392114+0000","last_undegraded":"2024-05-10T09:55:27.392114+0000","last_fullsized":"2024-05-10T09:55:27.392114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394335+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:55:27.394335+0000","last_peered":"2024-05-10T09:55:27.394335+0000","last_clean":"2024-05-10T09:55:27.394335+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:55:27.394335+0000","last_undegraded":"2024-05-10T09:55:27.394335+0000","last_fullsized":"2024-05-10T09:55:27.394335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396041+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:55:27.396041+0000","last_peered":"2024-05-10T09:55:27.396041+0000","last_clean":"2024-05-10T09:55:27.396041+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:55:27.396041+0000","last_undegraded":"2024-05-10T09:55:27.396041+0000","last_fullsized":"2024-05-10T09:55:27.396041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.886807+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:55:27.886807+0000","last_peered":"2024-05-10T09:55:27.886807+0000","last_clean":"2024-05-10T09:55:27.886807+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:55:27.886807+0000","last_undegraded":"2024-05-10T09:55:27.886807+0000","last_fullsized":"2024-05-10T09:55:27.886807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160843+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:55:28.160843+0000","last_peered":"2024-05-10T09:55:28.160843+0000","last_clean":"2024-05-10T09:55:28.160843+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:55:28.160843+0000","last_undegraded":"2024-05-10T09:55:28.160843+0000","last_fullsized":"2024-05-10T09:55:28.160843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395091+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:55:27.395091+0000","last_peered":"2024-05-10T09:55:27.395091+0000","last_clean":"2024-05-10T09:55:27.395091+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:55:27.395091+0000","last_undegraded":"2024-05-10T09:55:27.395091+0000","last_fullsized":"2024-05-10T09:55:27.395091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.223409+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:55:28.223409+0000","last_peered":"2024-05-10T09:55:28.223409+0000","last_clean":"2024-05-10T09:55:28.223409+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:55:28.223409+0000","last_undegraded":"2024-05-10T09:55:28.223409+0000","last_fullsized":"2024-05-10T09:55:28.223409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162125+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:55:28.162125+0000","last_peered":"2024-05-10T09:55:28.162125+0000","last_clean":"2024-05-10T09:55:28.162125+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:55:28.162125+0000","last_undegraded":"2024-05-10T09:55:28.162125+0000","last_fullsized":"2024-05-10T09:55:28.162125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224449+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:55:28.224449+0000","last_peered":"2024-05-10T09:55:28.224449+0000","last_clean":"2024-05-10T09:55:28.224449+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:55:28.224449+0000","last_undegraded":"2024-05-10T09:55:28.224449+0000","last_fullsized":"2024-05-10T09:55:28.224449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393136+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:55:27.393136+0000","last_peered":"2024-05-10T09:55:27.393136+0000","last_clean":"2024-05-10T09:55:27.393136+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:55:27.393136+0000","last_undegraded":"2024-05-10T09:55:27.393136+0000","last_fullsized":"2024-05-10T09:55:27.393136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.326098+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:55:28.326098+0000","last_peered":"2024-05-10T09:55:28.326098+0000","last_clean":"2024-05-10T09:55:28.326098+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:55:28.326098+0000","last_undegraded":"2024-05-10T09:55:28.326098+0000","last_fullsized":"2024-05-10T09:55:28.326098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160950+0000","last_change":"2024-05-10T09:54:43.676605+0000","last_active":"2024-05-10T09:55:28.160950+0000","last_peered":"2024-05-10T09:55:28.160950+0000","last_clean":"2024-05-10T09:55:28.160950+0000","last_became_active":"2024-05-10T09:54:43.675860+0000","last_became_peered":"2024-05-10T09:54:43.675860+0000","last_unstale":"2024-05-10T09:55:28.160950+0000","last_undegraded":"2024-05-10T09:55:28.160950+0000","last_fullsized":"2024-05-10T09:55:28.160950+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:50.004032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":61,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394930+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:55:27.394930+0000","last_peered":"2024-05-10T09:55:27.394930+0000","last_clean":"2024-05-10T09:55:27.394930+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:55:27.394930+0000","last_undegraded":"2024-05-10T09:55:27.394930+0000","last_fullsized":"2024-05-10T09:55:27.394930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275885+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:55:28.275885+0000","last_peered":"2024-05-10T09:55:28.275885+0000","last_clean":"2024-05-10T09:55:28.275885+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:55:28.275885+0000","last_undegraded":"2024-05-10T09:55:28.275885+0000","last_fullsized":"2024-05-10T09:55:28.275885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324924+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:55:28.324924+0000","last_peered":"2024-05-10T09:55:28.324924+0000","last_clean":"2024-05-10T09:55:28.324924+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:55:28.324924+0000","last_undegraded":"2024-05-10T09:55:28.324924+0000","last_fullsized":"2024-05-10T09:55:28.324924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395303+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:55:27.395303+0000","last_peered":"2024-05-10T09:55:27.395303+0000","last_clean":"2024-05-10T09:55:27.395303+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:55:27.395303+0000","last_undegraded":"2024-05-10T09:55:27.395303+0000","last_fullsized":"2024-05-10T09:55:27.395303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225655+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:55:28.225655+0000","last_peered":"2024-05-10T09:55:28.225655+0000","last_clean":"2024-05-10T09:55:28.225655+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:55:28.225655+0000","last_undegraded":"2024-05-10T09:55:28.225655+0000","last_fullsized":"2024-05-10T09:55:28.225655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275896+0000","last_change":"2024-05-10T09:54:43.676597+0000","last_active":"2024-05-10T09:55:28.275896+0000","last_peered":"2024-05-10T09:55:28.275896+0000","last_clean":"2024-05-10T09:55:28.275896+0000","last_became_active":"2024-05-10T09:54:43.675870+0000","last_became_peered":"2024-05-10T09:54:43.675870+0000","last_unstale":"2024-05-10T09:55:28.275896+0000","last_undegraded":"2024-05-10T09:55:28.275896+0000","last_fullsized":"2024-05-10T09:55:28.275896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:56.842817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":58,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161571+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:55:28.161571+0000","last_peered":"2024-05-10T09:55:28.161571+0000","last_clean":"2024-05-10T09:55:28.161571+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:55:28.161571+0000","last_undegraded":"2024-05-10T09:55:28.161571+0000","last_fullsized":"2024-05-10T09:55:28.161571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.223937+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:55:28.223937+0000","last_peered":"2024-05-10T09:55:28.223937+0000","last_clean":"2024-05-10T09:55:28.223937+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:55:28.223937+0000","last_undegraded":"2024-05-10T09:55:28.223937+0000","last_fullsized":"2024-05-10T09:55:28.223937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276761+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:55:28.276761+0000","last_peered":"2024-05-10T09:55:28.276761+0000","last_clean":"2024-05-10T09:55:28.276761+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:55:28.276761+0000","last_undegraded":"2024-05-10T09:55:28.276761+0000","last_fullsized":"2024-05-10T09:55:28.276761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395749+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:55:27.395749+0000","last_peered":"2024-05-10T09:55:27.395749+0000","last_clean":"2024-05-10T09:55:27.395749+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:55:27.395749+0000","last_undegraded":"2024-05-10T09:55:27.395749+0000","last_fullsized":"2024-05-10T09:55:27.395749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225299+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:55:28.225299+0000","last_peered":"2024-05-10T09:55:28.225299+0000","last_clean":"2024-05-10T09:55:28.225299+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:55:28.225299+0000","last_undegraded":"2024-05-10T09:55:28.225299+0000","last_fullsized":"2024-05-10T09:55:28.225299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":65,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.887650+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:55:27.887650+0000","last_peered":"2024-05-10T09:55:27.887650+0000","last_clean":"2024-05-10T09:55:27.887650+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:55:27.887650+0000","last_undegraded":"2024-05-10T09:55:27.887650+0000","last_fullsized":"2024-05-10T09:55:27.887650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324085+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:55:28.324085+0000","last_peered":"2024-05-10T09:55:28.324085+0000","last_clean":"2024-05-10T09:55:28.324085+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:55:28.324085+0000","last_undegraded":"2024-05-10T09:55:28.324085+0000","last_fullsized":"2024-05-10T09:55:28.324085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394154+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:55:27.394154+0000","last_peered":"2024-05-10T09:55:27.394154+0000","last_clean":"2024-05-10T09:55:27.394154+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:55:27.394154+0000","last_undegraded":"2024-05-10T09:55:27.394154+0000","last_fullsized":"2024-05-10T09:55:27.394154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225397+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:55:28.225397+0000","last_peered":"2024-05-10T09:55:28.225397+0000","last_clean":"2024-05-10T09:55:28.225397+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:55:28.225397+0000","last_undegraded":"2024-05-10T09:55:28.225397+0000","last_fullsized":"2024-05-10T09:55:28.225397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":59,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.887020+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:55:27.887020+0000","last_peered":"2024-05-10T09:55:27.887020+0000","last_clean":"2024-05-10T09:55:27.887020+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:55:27.887020+0000","last_undegraded":"2024-05-10T09:55:27.887020+0000","last_fullsized":"2024-05-10T09:55:27.887020+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":48,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276636+0000","last_change":"2024-05-10T09:54:43.674945+0000","last_active":"2024-05-10T09:55:28.276636+0000","last_peered":"2024-05-10T09:55:28.276636+0000","last_clean":"2024-05-10T09:55:28.276636+0000","last_became_active":"2024-05-10T09:54:43.673932+0000","last_became_peered":"2024-05-10T09:54:43.673932+0000","last_unstale":"2024-05-10T09:55:28.276636+0000","last_undegraded":"2024-05-10T09:55:28.276636+0000","last_fullsized":"2024-05-10T09:55:28.276636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:00.830106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161889+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:55:28.161889+0000","last_peered":"2024-05-10T09:55:28.161889+0000","last_clean":"2024-05-10T09:55:28.161889+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:55:28.161889+0000","last_undegraded":"2024-05-10T09:55:28.161889+0000","last_fullsized":"2024-05-10T09:55:28.161889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888011+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:55:27.888011+0000","last_peered":"2024-05-10T09:55:27.888011+0000","last_clean":"2024-05-10T09:55:27.888011+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:55:27.888011+0000","last_undegraded":"2024-05-10T09:55:27.888011+0000","last_fullsized":"2024-05-10T09:55:27.888011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275831+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:55:28.275831+0000","last_peered":"2024-05-10T09:55:28.275831+0000","last_clean":"2024-05-10T09:55:28.275831+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:55:28.275831+0000","last_undegraded":"2024-05-10T09:55:28.275831+0000","last_fullsized":"2024-05-10T09:55:28.275831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.397490+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:55:27.397490+0000","last_peered":"2024-05-10T09:55:27.397490+0000","last_clean":"2024-05-10T09:55:27.397490+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:55:27.397490+0000","last_undegraded":"2024-05-10T09:55:27.397490+0000","last_fullsized":"2024-05-10T09:55:27.397490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393750+0000","last_change":"2024-05-10T09:54:39.632152+0000","last_active":"2024-05-10T09:55:27.393750+0000","last_peered":"2024-05-10T09:55:27.393750+0000","last_clean":"2024-05-10T09:55:27.393750+0000","last_became_active":"2024-05-10T09:54:39.630880+0000","last_became_peered":"2024-05-10T09:54:39.630880+0000","last_unstale":"2024-05-10T09:55:27.393750+0000","last_undegraded":"2024-05-10T09:55:27.393750+0000","last_fullsized":"2024-05-10T09:55:27.393750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.311278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394451+0000","last_change":"2024-05-10T09:54:43.671543+0000","last_active":"2024-05-10T09:55:27.394451+0000","last_peered":"2024-05-10T09:55:27.394451+0000","last_clean":"2024-05-10T09:55:27.394451+0000","last_became_active":"2024-05-10T09:54:43.670617+0000","last_became_peered":"2024-05-10T09:54:43.670617+0000","last_unstale":"2024-05-10T09:55:27.394451+0000","last_undegraded":"2024-05-10T09:55:27.394451+0000","last_fullsized":"2024-05-10T09:55:27.394451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:57.236607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":61,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.397405+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:55:27.397405+0000","last_peered":"2024-05-10T09:55:27.397405+0000","last_clean":"2024-05-10T09:55:27.397405+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:55:27.397405+0000","last_undegraded":"2024-05-10T09:55:27.397405+0000","last_fullsized":"2024-05-10T09:55:27.397405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.885686+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:55:27.885686+0000","last_peered":"2024-05-10T09:55:27.885686+0000","last_clean":"2024-05-10T09:55:27.885686+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:55:27.885686+0000","last_undegraded":"2024-05-10T09:55:27.885686+0000","last_fullsized":"2024-05-10T09:55:27.885686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324366+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:55:28.324366+0000","last_peered":"2024-05-10T09:55:28.324366+0000","last_clean":"2024-05-10T09:55:28.324366+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:55:28.324366+0000","last_undegraded":"2024-05-10T09:55:28.324366+0000","last_fullsized":"2024-05-10T09:55:28.324366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392603+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:55:27.392603+0000","last_peered":"2024-05-10T09:55:27.392603+0000","last_clean":"2024-05-10T09:55:27.392603+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:55:27.392603+0000","last_undegraded":"2024-05-10T09:55:27.392603+0000","last_fullsized":"2024-05-10T09:55:27.392603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222598+0000","last_change":"2024-05-10T09:54:39.639964+0000","last_active":"2024-05-10T09:55:28.222598+0000","last_peered":"2024-05-10T09:55:28.222598+0000","last_clean":"2024-05-10T09:55:28.222598+0000","last_became_active":"2024-05-10T09:54:39.639586+0000","last_became_peered":"2024-05-10T09:54:39.639586+0000","last_unstale":"2024-05-10T09:55:28.222598+0000","last_undegraded":"2024-05-10T09:55:28.222598+0000","last_fullsized":"2024-05-10T09:55:28.222598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888299+0000","last_change":"2024-05-10T09:54:43.673579+0000","last_active":"2024-05-10T09:55:27.888299+0000","last_peered":"2024-05-10T09:55:27.888299+0000","last_clean":"2024-05-10T09:55:27.888299+0000","last_became_active":"2024-05-10T09:54:43.671699+0000","last_became_peered":"2024-05-10T09:54:43.671699+0000","last_unstale":"2024-05-10T09:55:27.888299+0000","last_undegraded":"2024-05-10T09:55:27.888299+0000","last_fullsized":"2024-05-10T09:55:27.888299+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:19.679507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":57,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394597+0000","last_change":"2024-05-10T09:54:46.137228+0000","last_active":"2024-05-10T09:55:27.394597+0000","last_peered":"2024-05-10T09:55:27.394597+0000","last_clean":"2024-05-10T09:55:27.394597+0000","last_became_active":"2024-05-10T09:54:46.136461+0000","last_became_peered":"2024-05-10T09:54:46.136461+0000","last_unstale":"2024-05-10T09:55:27.394597+0000","last_undegraded":"2024-05-10T09:55:27.394597+0000","last_fullsized":"2024-05-10T09:55:27.394597+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":49,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275152+0000","last_change":"2024-05-10T09:54:47.703168+0000","last_active":"2024-05-10T09:55:28.275152+0000","last_peered":"2024-05-10T09:55:28.275152+0000","last_clean":"2024-05-10T09:55:28.275152+0000","last_became_active":"2024-05-10T09:54:47.702370+0000","last_became_peered":"2024-05-10T09:54:47.702370+0000","last_unstale":"2024-05-10T09:55:28.275152+0000","last_undegraded":"2024-05-10T09:55:28.275152+0000","last_fullsized":"2024-05-10T09:55:28.275152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:23.880405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160832+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:55:28.160832+0000","last_peered":"2024-05-10T09:55:28.160832+0000","last_clean":"2024-05-10T09:55:28.160832+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:55:28.160832+0000","last_undegraded":"2024-05-10T09:55:28.160832+0000","last_fullsized":"2024-05-10T09:55:28.160832+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392876+0000","last_change":"2024-05-10T09:54:41.660113+0000","last_active":"2024-05-10T09:55:27.392876+0000","last_peered":"2024-05-10T09:55:27.392876+0000","last_clean":"2024-05-10T09:55:27.392876+0000","last_became_active":"2024-05-10T09:54:41.659372+0000","last_became_peered":"2024-05-10T09:54:41.659372+0000","last_unstale":"2024-05-10T09:55:27.392876+0000","last_undegraded":"2024-05-10T09:55:27.392876+0000","last_fullsized":"2024-05-10T09:55:27.392876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.323890+0000","last_change":"2024-05-10T09:54:39.665209+0000","last_active":"2024-05-10T09:55:28.323890+0000","last_peered":"2024-05-10T09:55:28.323890+0000","last_clean":"2024-05-10T09:55:28.323890+0000","last_became_active":"2024-05-10T09:54:39.664624+0000","last_became_peered":"2024-05-10T09:54:39.664624+0000","last_unstale":"2024-05-10T09:55:28.323890+0000","last_undegraded":"2024-05-10T09:55:28.323890+0000","last_fullsized":"2024-05-10T09:55:28.323890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:14.288277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161658+0000","last_change":"2024-05-10T09:54:43.676730+0000","last_active":"2024-05-10T09:55:28.161658+0000","last_peered":"2024-05-10T09:55:28.161658+0000","last_clean":"2024-05-10T09:55:28.161658+0000","last_became_active":"2024-05-10T09:54:43.676001+0000","last_became_peered":"2024-05-10T09:54:43.676001+0000","last_unstale":"2024-05-10T09:55:28.161658+0000","last_undegraded":"2024-05-10T09:55:28.161658+0000","last_fullsized":"2024-05-10T09:55:28.161658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:53.463036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":67,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324558+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:55:28.324558+0000","last_peered":"2024-05-10T09:55:28.324558+0000","last_clean":"2024-05-10T09:55:28.324558+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:55:28.324558+0000","last_undegraded":"2024-05-10T09:55:28.324558+0000","last_fullsized":"2024-05-10T09:55:28.324558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222902+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:55:28.222902+0000","last_peered":"2024-05-10T09:55:28.222902+0000","last_clean":"2024-05-10T09:55:28.222902+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:55:28.222902+0000","last_undegraded":"2024-05-10T09:55:28.222902+0000","last_fullsized":"2024-05-10T09:55:28.222902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162651+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:55:28.162651+0000","last_peered":"2024-05-10T09:55:28.162651+0000","last_clean":"2024-05-10T09:55:28.162651+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:55:28.162651+0000","last_undegraded":"2024-05-10T09:55:28.162651+0000","last_fullsized":"2024-05-10T09:55:28.162651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393501+0000","last_change":"2024-05-10T09:54:41.661977+0000","last_active":"2024-05-10T09:55:27.393501+0000","last_peered":"2024-05-10T09:55:27.393501+0000","last_clean":"2024-05-10T09:55:27.393501+0000","last_became_active":"2024-05-10T09:54:41.661196+0000","last_became_peered":"2024-05-10T09:54:41.661196+0000","last_unstale":"2024-05-10T09:55:27.393501+0000","last_undegraded":"2024-05-10T09:55:27.393501+0000","last_fullsized":"2024-05-10T09:55:27.393501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.323958+0000","last_change":"2024-05-10T09:54:39.660289+0000","last_active":"2024-05-10T09:55:28.323958+0000","last_peered":"2024-05-10T09:55:28.323958+0000","last_clean":"2024-05-10T09:55:28.323958+0000","last_became_active":"2024-05-10T09:54:39.659678+0000","last_became_peered":"2024-05-10T09:54:39.659678+0000","last_unstale":"2024-05-10T09:55:28.323958+0000","last_undegraded":"2024-05-10T09:55:28.323958+0000","last_fullsized":"2024-05-10T09:55:28.323958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324903+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:55:28.324903+0000","last_peered":"2024-05-10T09:55:28.324903+0000","last_clean":"2024-05-10T09:55:28.324903+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:55:28.324903+0000","last_undegraded":"2024-05-10T09:55:28.324903+0000","last_fullsized":"2024-05-10T09:55:28.324903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":58,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222910+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:55:28.222910+0000","last_peered":"2024-05-10T09:55:28.222910+0000","last_clean":"2024-05-10T09:55:28.222910+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:55:28.222910+0000","last_undegraded":"2024-05-10T09:55:28.222910+0000","last_fullsized":"2024-05-10T09:55:28.222910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275779+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:55:28.275779+0000","last_peered":"2024-05-10T09:55:28.275779+0000","last_clean":"2024-05-10T09:55:28.275779+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:55:28.275779+0000","last_undegraded":"2024-05-10T09:55:28.275779+0000","last_fullsized":"2024-05-10T09:55:28.275779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396261+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:55:27.396261+0000","last_peered":"2024-05-10T09:55:27.396261+0000","last_clean":"2024-05-10T09:55:27.396261+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:55:27.396261+0000","last_undegraded":"2024-05-10T09:55:27.396261+0000","last_fullsized":"2024-05-10T09:55:27.396261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393353+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:55:27.393353+0000","last_peered":"2024-05-10T09:55:27.393353+0000","last_clean":"2024-05-10T09:55:27.393353+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:55:27.393353+0000","last_undegraded":"2024-05-10T09:55:27.393353+0000","last_fullsized":"2024-05-10T09:55:27.393353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396659+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:55:27.396659+0000","last_peered":"2024-05-10T09:55:27.396659+0000","last_clean":"2024-05-10T09:55:27.396659+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:55:27.396659+0000","last_undegraded":"2024-05-10T09:55:27.396659+0000","last_fullsized":"2024-05-10T09:55:27.396659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":46,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392255+0000","last_change":"2024-05-10T09:54:43.671816+0000","last_active":"2024-05-10T09:55:27.392255+0000","last_peered":"2024-05-10T09:55:27.392255+0000","last_clean":"2024-05-10T09:55:27.392255+0000","last_became_active":"2024-05-10T09:54:43.670943+0000","last_became_peered":"2024-05-10T09:54:43.670943+0000","last_unstale":"2024-05-10T09:55:27.392255+0000","last_undegraded":"2024-05-10T09:55:27.392255+0000","last_fullsized":"2024-05-10T09:55:27.392255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":52,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395876+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:55:27.395876+0000","last_peered":"2024-05-10T09:55:27.395876+0000","last_clean":"2024-05-10T09:55:27.395876+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:55:27.395876+0000","last_undegraded":"2024-05-10T09:55:27.395876+0000","last_fullsized":"2024-05-10T09:55:27.395876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392613+0000","last_change":"2024-05-10T09:54:47.699451+0000","last_active":"2024-05-10T09:55:27.392613+0000","last_peered":"2024-05-10T09:55:27.392613+0000","last_clean":"2024-05-10T09:55:27.392613+0000","last_became_active":"2024-05-10T09:54:47.698655+0000","last_became_peered":"2024-05-10T09:54:47.698655+0000","last_unstale":"2024-05-10T09:55:27.392613+0000","last_undegraded":"2024-05-10T09:55:27.392613+0000","last_fullsized":"2024-05-10T09:55:27.392613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162170+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:55:28.162170+0000","last_peered":"2024-05-10T09:55:28.162170+0000","last_clean":"2024-05-10T09:55:28.162170+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:55:28.162170+0000","last_undegraded":"2024-05-10T09:55:28.162170+0000","last_fullsized":"2024-05-10T09:55:28.162170+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392539+0000","last_change":"2024-05-10T09:54:41.684964+0000","last_active":"2024-05-10T09:55:27.392539+0000","last_peered":"2024-05-10T09:55:27.392539+0000","last_clean":"2024-05-10T09:55:27.392539+0000","last_became_active":"2024-05-10T09:54:41.684444+0000","last_became_peered":"2024-05-10T09:54:41.684444+0000","last_unstale":"2024-05-10T09:55:27.392539+0000","last_undegraded":"2024-05-10T09:55:27.392539+0000","last_fullsized":"2024-05-10T09:55:27.392539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225631+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:55:28.225631+0000","last_peered":"2024-05-10T09:55:28.225631+0000","last_clean":"2024-05-10T09:55:28.225631+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:55:28.225631+0000","last_undegraded":"2024-05-10T09:55:28.225631+0000","last_fullsized":"2024-05-10T09:55:28.225631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":47,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.886241+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:55:27.886241+0000","last_peered":"2024-05-10T09:55:27.886241+0000","last_clean":"2024-05-10T09:55:27.886241+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:55:27.886241+0000","last_undegraded":"2024-05-10T09:55:27.886241+0000","last_fullsized":"2024-05-10T09:55:27.886241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":58,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392936+0000","last_change":"2024-05-10T09:54:45.674702+0000","last_active":"2024-05-10T09:55:27.392936+0000","last_peered":"2024-05-10T09:55:27.392936+0000","last_clean":"2024-05-10T09:55:27.392936+0000","last_became_active":"2024-05-10T09:54:45.674013+0000","last_became_peered":"2024-05-10T09:54:45.674013+0000","last_unstale":"2024-05-10T09:55:27.392936+0000","last_undegraded":"2024-05-10T09:55:27.392936+0000","last_fullsized":"2024-05-10T09:55:27.392936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:22:07.295363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222752+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:55:28.222752+0000","last_peered":"2024-05-10T09:55:28.222752+0000","last_clean":"2024-05-10T09:55:28.222752+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:55:28.222752+0000","last_undegraded":"2024-05-10T09:55:28.222752+0000","last_fullsized":"2024-05-10T09:55:28.222752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394521+0000","last_change":"2024-05-10T09:54:49.704641+0000","last_active":"2024-05-10T09:55:27.394521+0000","last_peered":"2024-05-10T09:55:27.394521+0000","last_clean":"2024-05-10T09:55:27.394521+0000","last_became_active":"2024-05-10T09:54:49.703849+0000","last_became_peered":"2024-05-10T09:54:49.703849+0000","last_unstale":"2024-05-10T09:55:27.394521+0000","last_undegraded":"2024-05-10T09:55:27.394521+0000","last_fullsized":"2024-05-10T09:55:27.394521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.888205+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:55:27.888205+0000","last_peered":"2024-05-10T09:55:27.888205+0000","last_clean":"2024-05-10T09:55:27.888205+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:55:27.888205+0000","last_undegraded":"2024-05-10T09:55:27.888205+0000","last_fullsized":"2024-05-10T09:55:27.888205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275575+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:55:28.275575+0000","last_peered":"2024-05-10T09:55:28.275575+0000","last_clean":"2024-05-10T09:55:28.275575+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:55:28.275575+0000","last_undegraded":"2024-05-10T09:55:28.275575+0000","last_fullsized":"2024-05-10T09:55:28.275575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.887889+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:55:27.887889+0000","last_peered":"2024-05-10T09:55:27.887889+0000","last_clean":"2024-05-10T09:55:27.887889+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:55:27.887889+0000","last_undegraded":"2024-05-10T09:55:27.887889+0000","last_fullsized":"2024-05-10T09:55:27.887889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":59,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.391753+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:55:27.391753+0000","last_peered":"2024-05-10T09:55:27.391753+0000","last_clean":"2024-05-10T09:55:27.391753+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:55:27.391753+0000","last_undegraded":"2024-05-10T09:55:27.391753+0000","last_fullsized":"2024-05-10T09:55:27.391753+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325209+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:55:28.325209+0000","last_peered":"2024-05-10T09:55:28.325209+0000","last_clean":"2024-05-10T09:55:28.325209+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:55:28.325209+0000","last_undegraded":"2024-05-10T09:55:28.325209+0000","last_fullsized":"2024-05-10T09:55:28.325209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.323698+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:55:28.323698+0000","last_peered":"2024-05-10T09:55:28.323698+0000","last_clean":"2024-05-10T09:55:28.323698+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:55:28.323698+0000","last_undegraded":"2024-05-10T09:55:28.323698+0000","last_fullsized":"2024-05-10T09:55:28.323698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.887830+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:55:27.887830+0000","last_peered":"2024-05-10T09:55:27.887830+0000","last_clean":"2024-05-10T09:55:27.887830+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:55:27.887830+0000","last_undegraded":"2024-05-10T09:55:27.887830+0000","last_fullsized":"2024-05-10T09:55:27.887830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.222452+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:55:28.222452+0000","last_peered":"2024-05-10T09:55:28.222452+0000","last_clean":"2024-05-10T09:55:28.222452+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:55:28.222452+0000","last_undegraded":"2024-05-10T09:55:28.222452+0000","last_fullsized":"2024-05-10T09:55:28.222452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395519+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:55:27.395519+0000","last_peered":"2024-05-10T09:55:27.395519+0000","last_clean":"2024-05-10T09:55:27.395519+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:55:27.395519+0000","last_undegraded":"2024-05-10T09:55:27.395519+0000","last_fullsized":"2024-05-10T09:55:27.395519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.396813+0000","last_change":"2024-05-10T09:54:39.617575+0000","last_active":"2024-05-10T09:55:27.396813+0000","last_peered":"2024-05-10T09:55:27.396813+0000","last_clean":"2024-05-10T09:55:27.396813+0000","last_became_active":"2024-05-10T09:54:39.617225+0000","last_became_peered":"2024-05-10T09:54:39.617225+0000","last_unstale":"2024-05-10T09:55:27.396813+0000","last_undegraded":"2024-05-10T09:55:27.396813+0000","last_fullsized":"2024-05-10T09:55:27.396813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393687+0000","last_change":"2024-05-10T09:54:41.685433+0000","last_active":"2024-05-10T09:55:27.393687+0000","last_peered":"2024-05-10T09:55:27.393687+0000","last_clean":"2024-05-10T09:55:27.393687+0000","last_became_active":"2024-05-10T09:54:41.684722+0000","last_became_peered":"2024-05-10T09:54:41.684722+0000","last_unstale":"2024-05-10T09:55:27.393687+0000","last_undegraded":"2024-05-10T09:55:27.393687+0000","last_fullsized":"2024-05-10T09:55:27.393687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.885538+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:55:27.885538+0000","last_peered":"2024-05-10T09:55:27.885538+0000","last_clean":"2024-05-10T09:55:27.885538+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:55:27.885538+0000","last_undegraded":"2024-05-10T09:55:27.885538+0000","last_fullsized":"2024-05-10T09:55:27.885538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.391065+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:55:27.391065+0000","last_peered":"2024-05-10T09:55:27.391065+0000","last_clean":"2024-05-10T09:55:27.391065+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:55:27.391065+0000","last_undegraded":"2024-05-10T09:55:27.391065+0000","last_fullsized":"2024-05-10T09:55:27.391065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.276505+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:55:28.276505+0000","last_peered":"2024-05-10T09:55:28.276505+0000","last_clean":"2024-05-10T09:55:28.276505+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:55:28.276505+0000","last_undegraded":"2024-05-10T09:55:28.276505+0000","last_fullsized":"2024-05-10T09:55:28.276505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275511+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:55:28.275511+0000","last_peered":"2024-05-10T09:55:28.275511+0000","last_clean":"2024-05-10T09:55:28.275511+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:55:28.275511+0000","last_undegraded":"2024-05-10T09:55:28.275511+0000","last_fullsized":"2024-05-10T09:55:28.275511+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.397141+0000","last_change":"2024-05-10T09:54:39.637008+0000","last_active":"2024-05-10T09:55:27.397141+0000","last_peered":"2024-05-10T09:55:27.397141+0000","last_clean":"2024-05-10T09:55:27.397141+0000","last_became_active":"2024-05-10T09:54:39.636614+0000","last_became_peered":"2024-05-10T09:54:39.636614+0000","last_unstale":"2024-05-10T09:55:27.397141+0000","last_undegraded":"2024-05-10T09:55:27.397141+0000","last_fullsized":"2024-05-10T09:55:27.397141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225434+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:55:28.225434+0000","last_peered":"2024-05-10T09:55:28.225434+0000","last_clean":"2024-05-10T09:55:28.225434+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:55:28.225434+0000","last_undegraded":"2024-05-10T09:55:28.225434+0000","last_fullsized":"2024-05-10T09:55:28.225434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.323642+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:55:28.323642+0000","last_peered":"2024-05-10T09:55:28.323642+0000","last_clean":"2024-05-10T09:55:28.323642+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:55:28.323642+0000","last_undegraded":"2024-05-10T09:55:28.323642+0000","last_fullsized":"2024-05-10T09:55:28.323642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394826+0000","last_change":"2024-05-10T09:54:41.643172+0000","last_active":"2024-05-10T09:55:27.394826+0000","last_peered":"2024-05-10T09:55:27.394826+0000","last_clean":"2024-05-10T09:55:27.394826+0000","last_became_active":"2024-05-10T09:54:41.642434+0000","last_became_peered":"2024-05-10T09:54:41.642434+0000","last_unstale":"2024-05-10T09:55:27.394826+0000","last_undegraded":"2024-05-10T09:55:27.394826+0000","last_fullsized":"2024-05-10T09:55:27.394826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.393611+0000","last_change":"2024-05-10T09:54:39.617844+0000","last_active":"2024-05-10T09:55:27.393611+0000","last_peered":"2024-05-10T09:55:27.393611+0000","last_clean":"2024-05-10T09:55:27.393611+0000","last_became_active":"2024-05-10T09:54:39.617265+0000","last_became_peered":"2024-05-10T09:54:39.617265+0000","last_unstale":"2024-05-10T09:55:27.393611+0000","last_undegraded":"2024-05-10T09:55:27.393611+0000","last_fullsized":"2024-05-10T09:55:27.393611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392781+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:55:27.392781+0000","last_peered":"2024-05-10T09:55:27.392781+0000","last_clean":"2024-05-10T09:55:27.392781+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:55:27.392781+0000","last_undegraded":"2024-05-10T09:55:27.392781+0000","last_fullsized":"2024-05-10T09:55:27.392781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324664+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:55:28.324664+0000","last_peered":"2024-05-10T09:55:28.324664+0000","last_clean":"2024-05-10T09:55:28.324664+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:55:28.324664+0000","last_undegraded":"2024-05-10T09:55:28.324664+0000","last_fullsized":"2024-05-10T09:55:28.324664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.394352+0000","last_change":"2024-05-10T09:54:41.677847+0000","last_active":"2024-05-10T09:55:27.394352+0000","last_peered":"2024-05-10T09:55:27.394352+0000","last_clean":"2024-05-10T09:55:27.394352+0000","last_became_active":"2024-05-10T09:54:41.675368+0000","last_became_peered":"2024-05-10T09:54:41.675368+0000","last_unstale":"2024-05-10T09:55:27.394352+0000","last_undegraded":"2024-05-10T09:55:27.394352+0000","last_fullsized":"2024-05-10T09:55:27.394352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.224308+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:55:28.224308+0000","last_peered":"2024-05-10T09:55:28.224308+0000","last_clean":"2024-05-10T09:55:28.224308+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:55:28.224308+0000","last_undegraded":"2024-05-10T09:55:28.224308+0000","last_fullsized":"2024-05-10T09:55:28.224308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.162042+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:55:28.162042+0000","last_peered":"2024-05-10T09:55:28.162042+0000","last_clean":"2024-05-10T09:55:28.162042+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:55:28.162042+0000","last_undegraded":"2024-05-10T09:55:28.162042+0000","last_fullsized":"2024-05-10T09:55:28.162042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.275079+0000","last_change":"2024-05-10T09:54:39.646096+0000","last_active":"2024-05-10T09:55:28.275079+0000","last_peered":"2024-05-10T09:55:28.275079+0000","last_clean":"2024-05-10T09:55:28.275079+0000","last_became_active":"2024-05-10T09:54:39.645148+0000","last_became_peered":"2024-05-10T09:54:39.645148+0000","last_unstale":"2024-05-10T09:55:28.275079+0000","last_undegraded":"2024-05-10T09:55:28.275079+0000","last_fullsized":"2024-05-10T09:55:28.275079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.223604+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:55:28.223604+0000","last_peered":"2024-05-10T09:55:28.223604+0000","last_clean":"2024-05-10T09:55:28.223604+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:55:28.223604+0000","last_undegraded":"2024-05-10T09:55:28.223604+0000","last_fullsized":"2024-05-10T09:55:28.223604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.160696+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:55:28.160696+0000","last_peered":"2024-05-10T09:55:28.160696+0000","last_clean":"2024-05-10T09:55:28.160696+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:55:28.160696+0000","last_undegraded":"2024-05-10T09:55:28.160696+0000","last_fullsized":"2024-05-10T09:55:28.160696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.392904+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:55:27.392904+0000","last_peered":"2024-05-10T09:55:27.392904+0000","last_clean":"2024-05-10T09:55:27.392904+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:55:27.392904+0000","last_undegraded":"2024-05-10T09:55:27.392904+0000","last_fullsized":"2024-05-10T09:55:27.392904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.395285+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:55:27.395285+0000","last_peered":"2024-05-10T09:55:27.395285+0000","last_clean":"2024-05-10T09:55:27.395285+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:55:27.395285+0000","last_undegraded":"2024-05-10T09:55:27.395285+0000","last_fullsized":"2024-05-10T09:55:27.395285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.161132+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:55:28.161132+0000","last_peered":"2024-05-10T09:55:28.161132+0000","last_clean":"2024-05-10T09:55:28.161132+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:55:28.161132+0000","last_undegraded":"2024-05-10T09:55:28.161132+0000","last_fullsized":"2024-05-10T09:55:28.161132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.326096+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:55:28.326096+0000","last_peered":"2024-05-10T09:55:28.326096+0000","last_clean":"2024-05-10T09:55:28.326096+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:55:28.326096+0000","last_undegraded":"2024-05-10T09:55:28.326096+0000","last_fullsized":"2024-05-10T09:55:28.326096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.324770+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:55:28.324770+0000","last_peered":"2024-05-10T09:55:28.324770+0000","last_clean":"2024-05-10T09:55:28.324770+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:55:28.324770+0000","last_undegraded":"2024-05-10T09:55:28.324770+0000","last_fullsized":"2024-05-10T09:55:28.324770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.225307+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:55:28.225307+0000","last_peered":"2024-05-10T09:55:28.225307+0000","last_clean":"2024-05-10T09:55:28.225307+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:55:28.225307+0000","last_undegraded":"2024-05-10T09:55:28.225307+0000","last_fullsized":"2024-05-10T09:55:28.225307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":54,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:27.885417+0000","last_change":"2024-05-10T09:54:39.644558+0000","last_active":"2024-05-10T09:55:27.885417+0000","last_peered":"2024-05-10T09:55:27.885417+0000","last_clean":"2024-05-10T09:55:27.885417+0000","last_became_active":"2024-05-10T09:54:39.644263+0000","last_became_peered":"2024-05-10T09:54:39.644263+0000","last_unstale":"2024-05-10T09:55:27.885417+0000","last_undegraded":"2024-05-10T09:55:27.885417+0000","last_fullsized":"2024-05-10T09:55:27.885417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:45:25.147666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-10T09:55:28.325968+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:55:28.325968+0000","last_peered":"2024-05-10T09:55:28.325968+0000","last_clean":"2024-05-10T09:55:28.325968+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:55:28.325968+0000","last_undegraded":"2024-05-10T09:55:28.325968+0000","last_fullsized":"2024-05-10T09:55:28.325968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1163264,"data_stored":844675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":255076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":254475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":536576,"data_stored":254138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35888,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335952,"statfs":{"total":96636764160,"available":96600014848,"internally_reserved":0,"allocated":561152,"data_stored":254043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35860,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335980,"statfs":{"total":96636764160,"available":96600043520,"internally_reserved":0,"allocated":532480,"data_stored":253209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1146880,"data_stored":844517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35888,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335952,"statfs":{"total":96636764160,"available":96600014848,"internally_reserved":0,"allocated":561152,"data_stored":253897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:55:31.498 INFO:tasks.thrashosds.thrasher:Setting 4.1b to [1, 5] 2024-05-10T09:55:31.498 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.1b', '1', '5'] 2024-05-10T09:55:31.498 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.1b 1 5 2024-05-10T09:55:31.547 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:31.573 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:31.568+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:31.649 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:31.649 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:31.650 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:31.664 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:31.674 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:31.668+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:31.727 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:31.727 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:31.755 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:31.756 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:31.774 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:31.774 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:31.775 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:31.772+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:31.791 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:31.791 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:31.811 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:31.811 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:31.832 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:31.832 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:31.832 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:31.832 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:31.847 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:31.852 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:31.852 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:31.871 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:31.872 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:31.894 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:31.892+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:31.972 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:31.972 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:31.976 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:31.976+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:31.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:32.077 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:32.072+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:32.155 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:32.156 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:32.171 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:32.178 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:32.176+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:32.279 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:32.280+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:32.338 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:32.338 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:32.352 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:32.398 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:32.396+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:32.406 INFO:teuthology.orchestra.run.smithi042.stderr:set 4.1b pg_upmap mapping to [1,5] 2024-05-10T09:55:32.432 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:55:32.476 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:32.476 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:32.483 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:32.480+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:32.490 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:32.580 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:32.576+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:32.656 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:32.656 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:32.671 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:32.682 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:32.676+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:32.782 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:32.776+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:32.841 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:32.842 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:32.856 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:32.902 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:32.900+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:32.980 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:32.980 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:32.984 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:32.980+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:32.994 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:33.084 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:33.080+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:33.129 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:33.129 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:33.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:33.191 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:33.188+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:33.268 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:33.268 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:33.283 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:33.327 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:33.324+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:33.386 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:33.380+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:33.408 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:55:33.460 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:33.461 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:33.475 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:33.487 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:33.484+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:33.588 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:33.584+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:33.638 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:33.639 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:33.655 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:33.699 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:33.696+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:33.782 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:33.782 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:33.790 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:33.784+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:33.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:33.890 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:33.890 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:33.888+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:33.968 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:33.968 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:33.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:33.991 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:33.992+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:34.038 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:34.038 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:34.055 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:34.072 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:34.072 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:34.090 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:34.090 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:34.092 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:34.088+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:34.110 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:34.111 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:34.117 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:34.117 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:34.117 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:34.118 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:34.135 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:34.136 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:34.136 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:34.158 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:34.158 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:34.179 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:34.180 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:34.193 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:34.188+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:34.252 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:34.252 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:34.253 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:34.253 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:34.253 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:34.266 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:34.311 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:34.308+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:34.396 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:34.396 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:34.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:34.396 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:34.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.396 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:34.396 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:34.396 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 50.668897248, 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:55:34.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:55:34.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:55:34.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:34.402 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 46.668428175000003, 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:55:34.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.534170007999997, 2024-05-10T09:55:34.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:55:34.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.413 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.414 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.520742693000003, 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:55:34.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:55:34.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.174095809000001, 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.421 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:55:34.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.426 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.170157033000002, 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.427 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:55:34.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:55:34.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.131215803000003, 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.433 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:55:34.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:34.439 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.995924221999999, 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:55:34.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.445 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.992165122000003, 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.446 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:55:34.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.940737593999998, 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.452 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:34.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:55:34.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.937142452000003, 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:55:34.458 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:55:34.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:55:34.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.927282486000003, 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:55:34.464 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:55:34.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:55:34.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.879666333000003, 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:55:34.470 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:55:34.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.875568549, 2024-05-10T09:55:34.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.481 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.786640052999999, 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:55:34.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:55:34.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:55:34.487 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.781704421000001, 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.488 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:55:34.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:34.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:34.493 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.688542773000002, 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:55:34.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.684342254999997, 2024-05-10T09:55:34.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:55:34.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.674485058999998, 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:55:34.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.511 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 42.669815528000001, 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:34.512 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:55:34.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.517 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:34.518 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:34.518 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:34.518 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:34.392+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:34.520 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:34.520 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:34.520+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:34.620 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:34.616+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:34.697 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:34.697 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:34.697 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:34.697 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:34.711 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:34.755 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:34.752+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:34.821 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:34.816+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:34.885 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:34.885 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:34.885 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:34.885 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:34.885 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:34.899 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:34.943 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:34.940+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:35.024 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:35.020+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:35.072 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:35.072 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:35.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:35.072 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:35.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 49.389027441000003, 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086496530000000002, 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 44 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.073 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679869+0000", 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3719999999999999e-06 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679880+0000", 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0854e-05 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679902+0000", 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2464e-05 2024-05-10T09:55:35.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679932+0000", 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9726999999999998e-05 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680032+0000", 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010032299999999999 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680042+0000", 2024-05-10T09:55:35.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3510000000000008e-06 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688283+0000", 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082418319999999993 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688516+0000", 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023273 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 44.337875140000001, 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035922279999999998, 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 207 2024-05-10T09:55:35.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731022+0000", 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7140000000000002e-06 2024-05-10T09:55:35.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731035+0000", 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3339999999999999e-05 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731069+0000", 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4102e-05 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731086+0000", 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6889999999999999e-05 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731309+0000", 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022293599999999999 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731595+0000", 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028612400000000001 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:35.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.732083+0000", 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048802300000000003 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.733712+0000", 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001629339 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734464+0000", 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075213400000000001 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734544+0000", 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9653000000000005e-05 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734611+0000", 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6972999999999997e-05 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 44.284092000999998, 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003743836, 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 216 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.084 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784805+0000", 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5730000000000002e-06 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784817+0000", 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.277e-05 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784854+0000", 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6205999999999999e-05 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784873+0000", 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9749999999999999e-05 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785009+0000", 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013592300000000001 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785241+0000", 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000232031 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785673+0000", 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043218999999999999 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.787225+0000", 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015515259999999999 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788269+0000", 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001043906 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788425+0000", 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155742 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788546+0000", 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012121900000000001 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.089 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 44.244008561999998, 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034684479999999998, 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.090 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 227 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:35.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824888+0000", 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6960000000000001e-06 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824901+0000", 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3144e-05 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824932+0000", 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0273e-05 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824948+0000", 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6402999999999999e-05 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825065+0000", 2024-05-10T09:55:35.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011705300000000001 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825277+0000", 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021180099999999999 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825698+0000", 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042071399999999998 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.827222+0000", 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015247489999999999 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828074+0000", 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085207100000000003 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828231+0000", 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015675199999999999 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828354+0000", 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012279200000000001 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 44.235914393000002, 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032440870000000001, 2024-05-10T09:55:35.096 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 229 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832982+0000", 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6429999999999999e-06 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832995+0000", 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2979999999999999e-05 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833026+0000", 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0383e-05 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833041+0000", 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4922999999999999e-05 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833158+0000", 2024-05-10T09:55:35.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011791299999999999 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833366+0000", 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020795500000000001 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833777+0000", 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000410331 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.835291+0000", 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015140329999999999 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836021+0000", 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00073029400000000004 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836105+0000", 2024-05-10T09:55:35.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3666999999999997e-05 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836224+0000", 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118965 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 44.228704897, 2024-05-10T09:55:35.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034732550000000002, 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 231 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840191+0000", 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.996e-06 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840203+0000", 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1523e-05 2024-05-10T09:55:35.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840229+0000", 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6713e-05 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840244+0000", 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4243999999999999e-05 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840361+0000", 2024-05-10T09:55:35.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011759199999999999 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840612+0000", 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025127500000000002 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.841027+0000", 2024-05-10T09:55:35.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00041445099999999998 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.842473+0000", 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001446536 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843387+0000", 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091381700000000004 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843543+0000", 2024-05-10T09:55:35.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155379 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843662+0000", 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011972900000000001 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:680 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:35.109 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.964358161, 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029268050000000002, 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 680 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104538+0000", 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4399999999999999e-06 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104552+0000", 2024-05-10T09:55:35.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104589+0000", 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6671000000000002e-05 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104607+0000", 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7943000000000001e-05 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104729+0000", 2024-05-10T09:55:35.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012238700000000001 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104918+0000", 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018902200000000001 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.105255+0000", 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033649500000000002 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106322+0000", 2024-05-10T09:55:35.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001067389 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107175+0000", 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085289000000000003 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107340+0000", 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016486199999999999 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107463+0000", 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012261999999999999 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.878941505, 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029077830000000002, 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.115 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 730 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:35.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189955+0000", 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1600000000000001e-06 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189966+0000", 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1739999999999999e-05 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189998+0000", 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1229999999999997e-05 2024-05-10T09:55:35.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190012+0000", 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4769e-05 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190156+0000", 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014340300000000001 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190368+0000", 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000211895 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190680+0000", 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031250499999999998 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.191743+0000", 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010630749999999999 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192700+0000", 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095679700000000001 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192785+0000", 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5205999999999997e-05 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192860+0000", 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5003e-05 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.120 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.865334861999997, 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033316309999999998, 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.121 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 736 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203561+0000", 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3439999999999999e-06 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203573+0000", 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1996e-05 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203611+0000", 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7577000000000003e-05 2024-05-10T09:55:35.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203626+0000", 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5217e-05 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203813+0000", 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018622499999999999 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204026+0000", 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000213542 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204352+0000", 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032619799999999998 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.205489+0000", 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011368649999999999 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206609+0000", 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011194919999999999 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206768+0000", 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015959200000000001 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206891+0000", 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122583 2024-05-10T09:55:35.126 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.861052215000001, 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031971209999999998, 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.127 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 738 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207844+0000", 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7269999999999999e-06 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207853+0000", 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8630000000000003e-06 2024-05-10T09:55:35.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207879+0000", 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5219999999999999e-05 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207891+0000", 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208029+0000", 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013824599999999999 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208278+0000", 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024847399999999999 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208777+0000", 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049937099999999997 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210173+0000", 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013959560000000001 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210892+0000", 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071904200000000003 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210976+0000", 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4105999999999997e-05 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.211039+0000", 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2535999999999999e-05 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.133 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.708461354000001, 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003393713, 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 802 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360435+0000", 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.08e-06 2024-05-10T09:55:35.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360446+0000", 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1457000000000001e-05 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360476+0000", 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0153000000000001e-05 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360491+0000", 2024-05-10T09:55:35.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5024e-05 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360652+0000", 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361013+0000", 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036118400000000002 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361578+0000", 2024-05-10T09:55:35.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056503900000000004 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.362848+0000", 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001270094 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363541+0000", 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069264200000000004 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363699+0000", 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158672 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363826+0000", 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012694599999999999 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:35.139 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.703862082999997, 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003036015, 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 804 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:35.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365034+0000", 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.03e-06 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365045+0000", 2024-05-10T09:55:35.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.114e-05 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365079+0000", 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3726000000000002e-05 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365094+0000", 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5384e-05 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365225+0000", 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013112900000000001 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365460+0000", 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000234754 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365938+0000", 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047798399999999998 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367189+0000", 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012510209999999999 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367802+0000", 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000612935 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367964+0000", 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016159900000000001 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.368068+0000", 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104313 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.651383782000003, 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030128820000000001, 2024-05-10T09:55:35.145 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 826 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417513+0000", 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3130000000000001e-06 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417525+0000", 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2574e-05 2024-05-10T09:55:35.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417556+0000", 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0790000000000002e-05 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417571+0000", 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4976e-05 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417704+0000", 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013354299999999999 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417944+0000", 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023976800000000001 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.418281+0000", 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033648800000000002 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.419414+0000", 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011336580000000001 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420370+0000", 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095544 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420455+0000", 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5675999999999998e-05 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420523+0000", 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7656000000000004e-05 2024-05-10T09:55:35.150 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.548818922999999, 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032627770000000001, 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 871 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520077+0000", 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9470000000000002e-06 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520091+0000", 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3586e-05 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520120+0000", 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9167e-05 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520135+0000", 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4946000000000001e-05 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520288+0000", 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015277300000000001 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520668+0000", 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038034700000000001 2024-05-10T09:55:35.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.521266+0000", 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059778200000000004 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.522481+0000", 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001215591 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523188+0000", 2024-05-10T09:55:35.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070687500000000004 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523273+0000", 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5169999999999999e-05 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523338+0000", 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4592999999999996e-05 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.513516785999997, 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003478835, 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 886 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.157 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555379+0000", 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.243e-06 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555392+0000", 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2225999999999999e-05 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555423+0000", 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0994000000000002e-05 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555438+0000", 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5143000000000001e-05 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555594+0000", 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156009 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555974+0000", 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037971400000000002 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.556522+0000", 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054812199999999995 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.557713+0000", 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011910060000000001 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558707+0000", 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099478600000000011 2024-05-10T09:55:35.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558794+0000", 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6142000000000003e-05 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558856+0000", 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.245e-05 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.492321650000001, 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003113457, 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 895 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576574+0000", 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:35.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576585+0000", 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0924000000000001e-05 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576615+0000", 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0066e-05 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576630+0000", 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4693e-05 2024-05-10T09:55:35.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576745+0000", 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011446300000000001 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576974+0000", 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022977100000000001 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.577315+0000", 2024-05-10T09:55:35.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034073099999999999 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.578411+0000", 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001095752 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579411+0000", 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099999000000000008 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579570+0000", 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015879499999999999 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579686+0000", 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116259 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:35.168 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.488316292, 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029848890000000001, 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 897 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580579+0000", 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.313e-06 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580587+0000", 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6969999999999993e-06 2024-05-10T09:55:35.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580609+0000", 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2263e-05 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580620+0000", 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1293e-05 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580743+0000", 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122299 2024-05-10T09:55:35.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580998+0000", 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025569500000000001 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.581477+0000", 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047893000000000002 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.582608+0000", 2024-05-10T09:55:35.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131232 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583301+0000", 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000692839 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583453+0000", 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000151562 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583563+0000", 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010976600000000001 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.485195244000003, 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032632500000000001, 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.174 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 898 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583701+0000", 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.854e-06 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583729+0000", 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8498999999999999e-05 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583761+0000", 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622999999999999e-05 2024-05-10T09:55:35.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583776+0000", 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.517e-05 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583913+0000", 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137453 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584254+0000", 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034036400000000001 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584799+0000", 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054493300000000005 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586086+0000", 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012870410000000001 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586691+0000", 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060565800000000002 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586848+0000", 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156973 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586962+0000", 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113682 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.179 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.480896743999999, 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003187517, 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 900 2024-05-10T09:55:35.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587999+0000", 2024-05-10T09:55:35.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.663e-06 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588024+0000", 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5432999999999999e-05 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588048+0000", 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3666e-05 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588059+0000", 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1174e-05 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588178+0000", 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118416 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588398+0000", 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220485 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:35.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588860+0000", 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046165300000000002 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590173+0000", 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013134469999999999 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590917+0000", 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074345200000000002 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591067+0000", 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015018900000000001 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591185+0000", 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117939 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:35.185 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.398553495000002, 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031097049999999999, 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 934 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:35.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670343+0000", 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670355+0000", 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1647e-05 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670384+0000", 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670405+0000", 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0296e-05 2024-05-10T09:55:35.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670553+0000", 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014783900000000001 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670880+0000", 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032728100000000001 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.671207+0000", 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032735799999999998 2024-05-10T09:55:35.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.672408+0000", 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001201045 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673285+0000", 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087693700000000005 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:35.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673383+0000", 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8321999999999998e-05 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673450+0000", 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6723999999999993e-05 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:35.191 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:35.193 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:35.193 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:35.188+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:35.294 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:35.292+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:35.327 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:35.327 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:35.327 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:35.327 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:35.341 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:35.395 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:35.392+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:35.436 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:55:35.496 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:35.492+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:35.510 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:35.510 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:35.510 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:35.510 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:35.510 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:35.525 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:35.596 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:35.592+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:35.654 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:35.654 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.980515701999998, 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086530440000000004, 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "reached pg", 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.655 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670663+0000", 2024-05-10T09:55:35.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1870000000000001e-06 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670697+0000", 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4013000000000001e-05 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670734+0000", 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6449999999999998e-05 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670760+0000", 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6196000000000001e-05 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670897+0000", 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013763499999999999 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670912+0000", 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.417e-05 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.678965+0000", 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080535780000000005 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.679313+0000", 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034781500000000002 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:35.659 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.944201794000001, 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049225980000000003, 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706975+0000", 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.083e-06 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706996+0000", 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1463000000000001e-05 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707016+0000", 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9639999999999998e-05 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707036+0000", 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9949000000000002e-05 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707643+0000", 2024-05-10T09:55:35.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060738299999999997 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707688+0000", 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5201999999999999e-05 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711782+0000", 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040939649999999998 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711896+0000", 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011391300000000001 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:47 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'2, mlcod=0'0)", 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 47.935212923999998, 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039603599999999996, 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.664 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715965+0000", 2024-05-10T09:55:35.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.04e-06 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715981+0000", 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716014+0000", 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3543000000000001e-05 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716035+0000", 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0849999999999999e-05 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716179+0000", 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014356199999999999 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716226+0000", 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7512000000000002e-05 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719825+0000", 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035986569999999999 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719923+0000", 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8060000000000006e-05 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:35.668 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.891957128000001, 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010358320000000001, 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 211 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759222+0000", 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759238+0000", 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5889999999999999e-05 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759276+0000", 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8226000000000003e-05 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759293+0000", 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7453999999999999e-05 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759495+0000", 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000201974 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759509+0000", 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.362e-05 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.765967+0000", 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006457717 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766268+0000", 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000301124 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766936+0000", 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00066803499999999998 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.768435+0000", 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014995150000000001 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769328+0000", 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089229700000000001 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769474+0000", 2024-05-10T09:55:35.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014578200000000001 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769577+0000", 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103199 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.806988709999999, 2024-05-10T09:55:35.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034011599999999999, 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 232 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844190+0000", 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844202+0000", 2024-05-10T09:55:35.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844234+0000", 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1822999999999997e-05 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844250+0000", 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6713000000000001e-05 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844385+0000", 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013458900000000001 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844620+0000", 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023536799999999999 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.845031+0000", 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041049700000000001 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.846532+0000", 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015012820000000001 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847430+0000", 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089785600000000004 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847520+0000", 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0303000000000006e-05 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847588+0000", 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7745999999999998e-05 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:272 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.781552179999998, 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036051189999999999, 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.681 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 272 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869626+0000", 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869636+0000", 2024-05-10T09:55:35.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0013000000000001e-05 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869663+0000", 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7630000000000001e-05 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869682+0000", 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8403999999999999e-05 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869807+0000", 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012508199999999999 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870001+0000", 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019480499999999999 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870357+0000", 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035530099999999998 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871669+0000", 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001311776 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.872980+0000", 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013111760000000001 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873124+0000", 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000144086 2024-05-10T09:55:35.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873229+0000", 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104666 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:279 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.780401951999998, 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030980360000000002, 2024-05-10T09:55:35.687 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 279 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870776+0000", 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1569999999999998e-06 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870789+0000", 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2756e-05 2024-05-10T09:55:35.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870814+0000", 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5726999999999999e-05 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870833+0000", 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870974+0000", 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014081200000000001 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871320+0000", 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034598000000000002 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871968+0000", 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064825199999999999 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873503+0000", 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534671 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873681+0000", 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178066 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873790+0000", 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109106 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873872+0000", 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1848999999999995e-05 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:314 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.774475107999997, 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051436470000000003, 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.693 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 314 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876703+0000", 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876716+0000", 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.29e-05 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876746+0000", 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0289000000000001e-05 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876766+0000", 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9936999999999999e-05 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876915+0000", 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148632 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877123+0000", 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000208622 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877524+0000", 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040038299999999998 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881305+0000", 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037810109999999999 2024-05-10T09:55:35.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881676+0000", 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000370854 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881761+0000", 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4997e-05 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881844+0000", 2024-05-10T09:55:35.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3474999999999996e-05 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.748682561000003, 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029358380000000001, 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.699 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 406 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902496+0000", 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6690000000000002e-06 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902511+0000", 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5123000000000001e-05 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902543+0000", 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.26e-05 2024-05-10T09:55:35.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902564+0000", 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0835999999999998e-05 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902712+0000", 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148131 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902984+0000", 2024-05-10T09:55:35.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027137500000000002 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.903362+0000", 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037871299999999998 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.904567+0000", 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012045890000000001 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905281+0000", 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071434299999999999 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905367+0000", 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5833000000000003e-05 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905429+0000", 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1625999999999996e-05 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:493 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.696778557000002, 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050291299999999997, 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 493 2024-05-10T09:55:35.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954398+0000", 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3400000000000001e-06 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954405+0000", 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8329999999999996e-06 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954424+0000", 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954435+0000", 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954516+0000", 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1138999999999997e-05 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954721+0000", 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020454800000000001 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955012+0000", 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000290888 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956172+0000", 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011604510000000001 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959287+0000", 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031147750000000002 2024-05-10T09:55:35.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959352+0000", 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4622000000000006e-05 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959426+0000", 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4413999999999996e-05 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.710 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:494 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.696664124999998, 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044303820000000001, 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 494 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.711 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954513+0000", 2024-05-10T09:55:35.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2500000000000001e-06 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954521+0000", 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1729999999999995e-06 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954535+0000", 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4394e-05 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954545+0000", 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-06 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954661+0000", 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011643500000000001 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954872+0000", 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000210805 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955341+0000", 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046933700000000001 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956602+0000", 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001260323 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958742+0000", 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021402560000000001 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958878+0000", 2024-05-10T09:55:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013547099999999999 2024-05-10T09:55:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958942+0000", 2024-05-10T09:55:35.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4307999999999995e-05 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:503 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.690662431, 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003841995, 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.718 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 503 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960515+0000", 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2000000000000001e-06 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960528+0000", 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2476e-05 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960561+0000", 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3460000000000002e-05 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960581+0000", 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9763e-05 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960707+0000", 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012605799999999999 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960841+0000", 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134122 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.961113+0000", 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027215799999999999 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964004+0000", 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002890849 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964166+0000", 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016143 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964261+0000", 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5128000000000001e-05 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964355+0000", 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4351000000000005e-05 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.723 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.586344312999998, 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029080270000000001, 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 633 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064834+0000", 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9330000000000001e-06 2024-05-10T09:55:35.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064849+0000", 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5003e-05 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064881+0000", 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2162999999999997e-05 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064897+0000", 2024-05-10T09:55:35.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5444e-05 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065013+0000", 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116662 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065239+0000", 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022532800000000001 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065553+0000", 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031410800000000001 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.066681+0000", 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001128038 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067537+0000", 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00085565999999999995 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067632+0000", 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5149000000000007e-05 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067739+0000", 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107539 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.729 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.355067177999999, 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031802750000000002, 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 775 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296111+0000", 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5440000000000001e-06 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296126+0000", 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5243e-05 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296158+0000", 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1359000000000002e-05 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296173+0000", 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296308+0000", 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135592 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296654+0000", 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034609799999999998 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.297217+0000", 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056229200000000004 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.298808+0000", 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015914010000000001 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299121+0000", 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031244399999999999 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299209+0000", 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8159999999999996e-05 2024-05-10T09:55:35.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299289+0000", 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9981999999999994e-05 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.275802374000001, 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003080607, 2024-05-10T09:55:35.735 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 808 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375392+0000", 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8366999999999999e-05 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375406+0000", 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4506e-05 2024-05-10T09:55:35.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375438+0000", 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1869999999999998e-05 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375453+0000", 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5204e-05 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375580+0000", 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012671500000000001 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375856+0000", 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027567200000000003 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.376172+0000", 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031694999999999998 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.377362+0000", 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011898880000000001 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378247+0000", 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088473399999999998 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378337+0000", 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0094999999999997e-05 2024-05-10T09:55:35.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378454+0000", 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116606 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.261724041999997, 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032206259999999999, 2024-05-10T09:55:35.741 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 814 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389454+0000", 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1629999999999999e-06 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389467+0000", 2024-05-10T09:55:35.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3414000000000001e-05 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389498+0000", 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0783e-05 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389513+0000", 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.485e-05 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389669+0000", 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015608899999999999 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390051+0000", 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038213400000000001 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390607+0000", 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055646199999999997 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392039+0000", 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014314519999999999 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392507+0000", 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046770999999999998 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392593+0000", 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6159e-05 2024-05-10T09:55:35.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392672+0000", 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.941e-05 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.109740524999999, 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029667840000000001, 2024-05-10T09:55:35.747 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 880 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541439+0000", 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541451+0000", 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2583e-05 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541484+0000", 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3176999999999998e-05 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541501+0000", 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6249999999999999e-05 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541623+0000", 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012215199999999999 2024-05-10T09:55:35.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541853+0000", 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023054799999999999 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.542204+0000", 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035071100000000002 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.543359+0000", 2024-05-10T09:55:35.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011545609999999999 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544248+0000", 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088955700000000002 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544335+0000", 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544402+0000", 2024-05-10T09:55:35.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6408999999999994e-05 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.105548917, 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029184770000000001, 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.753 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 882 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545629+0000", 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1299999999999999e-06 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545640+0000", 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1663e-05 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545672+0000", 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1922999999999999e-05 2024-05-10T09:55:35.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545691+0000", 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8583000000000001e-05 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545821+0000", 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012955599999999999 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545967+0000", 2024-05-10T09:55:35.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014623199999999999 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.546238+0000", 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027076800000000001 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.547400+0000", 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011622080000000001 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548341+0000", 2024-05-10T09:55:35.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00094160900000000004 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548428+0000", 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6502999999999995e-05 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548545+0000", 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117302 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.102352908999997, 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002968301, 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 883 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.759 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548824+0000", 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7540000000000001e-06 2024-05-10T09:55:35.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548835+0000", 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0243e-05 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548859+0000", 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4253e-05 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548873+0000", 2024-05-10T09:55:35.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4056999999999999e-05 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548984+0000", 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011150900000000001 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549223+0000", 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023871100000000001 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549550+0000", 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000327301 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.550681+0000", 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011309849999999999 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551571+0000", 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088975600000000001 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551662+0000", 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0956000000000001e-05 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551791+0000", 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012877599999999999 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:35.764 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.002167731999997, 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003259788, 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 925 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649010+0000", 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1239999999999999e-06 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:35.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649021+0000", 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0766e-05 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649051+0000", 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0533000000000001e-05 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649067+0000", 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5446000000000001e-05 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:35.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649189+0000", 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122576 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649413+0000", 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022339199999999999 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649726+0000", 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031377100000000002 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.650954+0000", 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012274300000000001 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.651996+0000", 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001041922 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652156+0000", 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015990500000000001 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:35.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652268+0000", 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011192300000000001 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:35.770 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:35.771 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:35.772 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:35.768+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:35.872 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:35.872+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:35.942 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:35.942 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:35.942 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:35.956 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:35.973 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:35.968+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:36.074 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:36.072+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:36.081 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:36.081 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:36.081 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:36.081 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:36.081 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:36.095 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:36.175 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:36.172+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:36.199 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:36.261 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.538286173000003, 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003342228, 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 41 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720248+0000", 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.17e-06 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720259+0000", 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1362999999999999e-05 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720290+0000", 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1245999999999999e-05 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720326+0000", 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5769999999999998e-05 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720467+0000", 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014139299999999999 2024-05-10T09:55:36.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720848+0000", 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038087700000000001 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.721316+0000", 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000468159 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.722880+0000", 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001563839 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723331+0000", 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000450603 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723447+0000", 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115742 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723588+0000", 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014106599999999999 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.462866140999999, 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036007420000000001, 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.268 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 39 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:36.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795667+0000", 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.883e-06 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795677+0000", 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5359999999999998e-06 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795702+0000", 2024-05-10T09:55:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4927e-05 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795716+0000", 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3828999999999999e-05 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795878+0000", 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162373 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.796006+0000", 2024-05-10T09:55:36.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012822199999999999 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.799266+0000", 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032599719999999999 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.543660148999997, 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056055200000000001, 2024-05-10T09:55:36.272 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714875+0000", 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.303e-06 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714893+0000", 2024-05-10T09:55:36.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8668000000000002e-05 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714927+0000", 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3519999999999998e-05 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714948+0000", 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0911e-05 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715113+0000", 2024-05-10T09:55:36.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016473599999999999 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715512+0000", 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039976900000000001 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715816+0000", 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000303417 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719016+0000", 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032006589999999998 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720317+0000", 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013003859999999999 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720396+0000", 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9043999999999997e-05 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720477+0000", 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1106999999999994e-05 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491083450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.537683954000002, 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050150489999999997, 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.278 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720849+0000", 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5740000000000001e-06 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720857+0000", 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2339999999999994e-06 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720878+0000", 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0939000000000001e-05 2024-05-10T09:55:36.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720890+0000", 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1863e-05 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720993+0000", 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102446 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721163+0000", 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017038700000000001 2024-05-10T09:55:36.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721496+0000", 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00033285399999999999 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.723818+0000", 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002322246 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725574+0000", 2024-05-10T09:55:36.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001755288 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725705+0000", 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131345 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725863+0000", 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157873 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.534673009999999, 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033784850000000001, 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 205 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723863+0000", 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9369999999999997e-06 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723879+0000", 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.662e-05 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723917+0000", 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7462999999999997e-05 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723936+0000", 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9049999999999999e-05 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724071+0000", 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013534500000000001 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724296+0000", 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000224766 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724714+0000", 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041791000000000002 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.726248+0000", 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534168 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727037+0000", 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00078889400000000005 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727121+0000", 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4109000000000004e-05 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727237+0000", 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116223 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.458694739000002, 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034944860000000002, 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.289 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 220 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799840+0000", 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.88e-06 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799852+0000", 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2597e-05 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799878+0000", 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.563e-05 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799892+0000", 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800078+0000", 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018622800000000001 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800286+0000", 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020734900000000001 2024-05-10T09:55:36.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800679+0000", 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039302599999999999 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.802102+0000", 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014227090000000001 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803181+0000", 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001079602 2024-05-10T09:55:36.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803265+0000", 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4085999999999994e-05 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803331+0000", 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6175999999999998e-05 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.447969942, 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033216510000000001, 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 223 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810564+0000", 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0099999999999998e-06 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810576+0000", 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1919999999999999e-05 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810604+0000", 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8293000000000002e-05 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810618+0000", 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.453e-05 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810739+0000", 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120559 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810974+0000", 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023486500000000001 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.811410+0000", 2024-05-10T09:55:36.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043620699999999998 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.812739+0000", 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013293929999999999 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813736+0000", 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00099665600000000006 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813819+0000", 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3024999999999999e-05 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813883+0000", 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4193e-05 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:36.300 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.440604432000001, 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034076969999999999, 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 225 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817929+0000", 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9800000000000001e-06 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817940+0000", 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1263e-05 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817966+0000", 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5517e-05 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817981+0000", 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.508e-05 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818160+0000", 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017946800000000001 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818375+0000", 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021470500000000001 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818799+0000", 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042364600000000002 2024-05-10T09:55:36.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.820054+0000", 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012555439999999999 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821175+0000", 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011206720000000001 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821267+0000", 2024-05-10T09:55:36.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2164999999999996e-05 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821335+0000", 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7657000000000006e-05 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:36.306 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.436817538, 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031354019999999998, 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 226 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821716+0000", 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0329999999999998e-06 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821726+0000", 2024-05-10T09:55:36.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821758+0000", 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1109000000000003e-05 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821795+0000", 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7262999999999999e-05 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821923+0000", 2024-05-10T09:55:36.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127906 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822156+0000", 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233231 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822572+0000", 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041563400000000001 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.823868+0000", 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00129623 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824698+0000", 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083007700000000003 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824784+0000", 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5636000000000005e-05 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824849+0000", 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5986000000000001e-05 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.406939199, 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031471559999999999, 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.312 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 234 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:36.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851595+0000", 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851606+0000", 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1039999999999999e-05 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851637+0000", 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1572999999999997e-05 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851653+0000", 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851833+0000", 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017961100000000001 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852052+0000", 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000219905 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852491+0000", 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043847999999999999 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.853823+0000", 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013323670000000001 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854589+0000", 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076523699999999999 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854679+0000", 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0660000000000003e-05 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854740+0000", 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0396000000000002e-05 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.317 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:431 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.344654829, 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031636749999999999, 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.318 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 431 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913878+0000", 2024-05-10T09:55:36.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4699999999999999e-06 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913885+0000", 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7830000000000001e-06 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913899+0000", 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3550000000000001e-05 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913910+0000", 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1116e-05 2024-05-10T09:55:36.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914037+0000", 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012750899999999999 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914363+0000", 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032586799999999999 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914907+0000", 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054394199999999995 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916597+0000", 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016898 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916905+0000", 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030769499999999997 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916982+0000", 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7809e-05 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.917040+0000", 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8133000000000001e-05 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:442 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.323 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.339568216000004, 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031368049999999999, 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 442 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918965+0000", 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.654e-06 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918973+0000", 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0730000000000005e-06 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918999+0000", 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5437000000000001e-05 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919011+0000", 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140000000000001e-05 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919129+0000", 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118539 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919440+0000", 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031087500000000001 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919767+0000", 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032684599999999999 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921033+0000", 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001266348 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921785+0000", 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075156400000000003 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921937+0000", 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015235800000000001 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.922100+0000", 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016297100000000001 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:493 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.303340620999997, 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038321729999999999, 2024-05-10T09:55:36.329 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955193+0000", 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.514e-06 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955205+0000", 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2395000000000001e-05 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955230+0000", 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4939e-05 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955242+0000", 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1989e-05 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955399+0000", 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015761700000000001 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955455+0000", 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5946999999999998e-05 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958922+0000", 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034661230000000002 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959023+0000", 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101649 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:531 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:36.333 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.279613169999998, 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033419700000000001, 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978920+0000", 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.646e-06 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978932+0000", 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1746000000000001e-05 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978957+0000", 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5425000000000001e-05 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978970+0000", 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3186e-05 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979090+0000", 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119621 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979128+0000", 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7765999999999997e-05 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982128+0000", 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030005269999999998 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982260+0000", 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132053 2024-05-10T09:55:36.337 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:532 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.277668472999999, 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040928650000000002, 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980865+0000", 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.531e-06 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980875+0000", 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0749e-05 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980899+0000", 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4031000000000001e-05 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980911+0000", 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1897e-05 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981024+0000", 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112574 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981067+0000", 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3556000000000001e-05 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984876+0000", 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003808624 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984956+0000", 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9902999999999997e-05 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.033034780999998, 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035004300000000001, 2024-05-10T09:55:36.342 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 745 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225500+0000", 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3100000000000001e-06 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225513+0000", 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.278e-05 2024-05-10T09:55:36.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225544+0000", 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0573e-05 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225559+0000", 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.522e-05 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225710+0000", 2024-05-10T09:55:36.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015115899999999999 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226066+0000", 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035624300000000001 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226622+0000", 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055600300000000001 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.227855+0000", 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012332510000000001 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228722+0000", 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00086697599999999999 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228885+0000", 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162969 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228997+0000", 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111946 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:747 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 45.028313273999999, 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032519850000000002, 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.348 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 747 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230220+0000", 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6559999999999999e-06 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230228+0000", 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.824e-06 2024-05-10T09:55:36.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230248+0000", 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230259+0000", 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1406999999999999e-05 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230372+0000", 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112829 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230596+0000", 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022375499999999999 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.231055+0000", 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045978700000000002 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.232387+0000", 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013311589999999999 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233206+0000", 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081972000000000002 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233359+0000", 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152683 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233470+0000", 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111419 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.990342277000003, 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031982120000000002, 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.354 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 763 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:36.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268191+0000", 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0360000000000001e-06 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268202+0000", 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.043e-05 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268234+0000", 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1847000000000002e-05 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268255+0000", 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1590000000000002e-05 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268443+0000", 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018751799999999999 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268670+0000", 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022725499999999999 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268993+0000", 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032307800000000003 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.270123+0000", 2024-05-10T09:55:36.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011297709999999999 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271173+0000", 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010499019999999999 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271257+0000", 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3901999999999997e-05 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271388+0000", 2024-05-10T09:55:36.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013088299999999999 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.844404003999998, 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034247800000000001, 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.360 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 825 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414129+0000", 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.657e-06 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414140+0000", 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414159+0000", 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8805999999999999e-05 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414170+0000", 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1007e-05 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414280+0000", 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110115 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414524+0000", 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244405 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.415025+0000", 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00050059300000000002 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.416518+0000", 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014937889999999999 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417272+0000", 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075359400000000001 2024-05-10T09:55:36.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417420+0000", 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148009 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417552+0000", 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013230499999999999 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 44.61725611, 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003571369, 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 922 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:36.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641278+0000", 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.097e-06 2024-05-10T09:55:36.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641289+0000", 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1163e-05 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641320+0000", 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1600000000000002e-05 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641342+0000", 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2089000000000001e-05 2024-05-10T09:55:36.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641594+0000", 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025150200000000002 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642155+0000", 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056140900000000002 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642609+0000", 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045330000000000001 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.643594+0000", 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098517900000000009 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644692+0000", 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010985039999999999 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644782+0000", 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9837000000000001e-05 2024-05-10T09:55:36.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644847+0000", 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4689000000000004e-05 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:36.371 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:36.372 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:36.373 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:36.373 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:36.368+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:36.373 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:36.375 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:36.376 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:36.392 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:36.392 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:36.409 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:36.409 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:36.428 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:36.428 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:55:36.450 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:36.450 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:36.470 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:36.470 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:36.473 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:36.468+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:36.490 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:36.490 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:36.504 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:36.504 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:36.518 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:36.575 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:36.572+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:36.640 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:36.640 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:36.653 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:36.676 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:36.672+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:36.777 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:36.772+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:36.819 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:36.819 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:36.835 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:36.878 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:36.876+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:36.978 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:36.975+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:37.004 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:37.004 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:37.018 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:37.080 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:37.075+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:37.141 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:37.142 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:37.156 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:37.180 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:37.175+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:37.278 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:37.278 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:37.282 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:37.280+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:37.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:37.383 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:37.379+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:37.428 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:37.428 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:37.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:37.491 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:37.487+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:37.584 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:37.579+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:37.620 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:37.620 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:37.634 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:37.723 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:37.719+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:37.786 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:37.779+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:37.803 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:37.803 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:37.819 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:37.907 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:37.903+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:37.986 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:37.984+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:37.991 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:37.991 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:38.005 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:38.087 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:38.084+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:38.175 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:38.175 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:38.188 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:38.188+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:38.189 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:38.288 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:38.284+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:38.316 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:38.316 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:38.330 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:38.389 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:38.388+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:38.459 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:38.462 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:55:38.475 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:38.490 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:38.488+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:38.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:38.591 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:38.588+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:38.639 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:38.639 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:38.662 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:38.663 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:38.663 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:38.680 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:38.680 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:38.691 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:38.688+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:38.697 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:38.697 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:38.715 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:38.715 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:38.736 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:38.736 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:38.757 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:38.757 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:38.779 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:38.779 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:38.782 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:38.782 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 55.057684909999999, 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.783 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:55:38.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:55:38.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:55:38.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.790 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 51.057215837000001, 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:55:38.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:55:38.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:55:38.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.797 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.922957670000002, 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.798 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:55:38.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:55:38.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:55:38.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.909530355000001, 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.805 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:55:38.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:55:38.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.812 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.562883470999999, 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.813 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:55:38.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:55:38.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.819 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.558944695000001, 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:55:38.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:55:38.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:55:38.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.826 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.520003465000002, 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:55:38.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.384711883999998, 2024-05-10T09:55:38.833 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.834 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:55:38.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:55:38.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.380952784000002, 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.840 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:55:38.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:55:38.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:55:38.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:55:38.846 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.329525255999997, 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:38.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:55:38.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:55:38.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:55:38.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.325930114000002, 2024-05-10T09:55:38.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.858 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:55:38.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.316070148000001, 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.861 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:55:38.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:38.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.867 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.268453995000002, 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:55:38.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:55:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:55:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:55:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.873 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.264356210999999, 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:55:38.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:55:38.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:55:38.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:55:38.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.175427714999998, 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.879 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:55:38.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.170492082999999, 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.885 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.888 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:55:38.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.077330435, 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.890 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:55:38.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.895 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.073129917000003, 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.896 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:55:38.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:55:38.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:55:38.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:55:38.900 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.063272720999997, 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.901 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:55:38.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:55:38.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:55:38.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:55:38.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.058603189999999, 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:38.906 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:38.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:55:38.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:55:38.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:55:38.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:38.911 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:38.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:38.914 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:38.914 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:38.915 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:38.907+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:39.014 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:39.012+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:39.085 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:39.085 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:39.085 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:39.085 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:39.099 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:39.147 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:39.143+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:39.216 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:39.211+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:39.225 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:39.225 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:39.225 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:39.225 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:39.225 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:39.239 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:39.316 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:39.316+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 53.729904955000002, 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086496530000000002, 2024-05-10T09:55:39.413 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 44 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679869+0000", 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3719999999999999e-06 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679880+0000", 2024-05-10T09:55:39.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0854e-05 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679902+0000", 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2464e-05 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679932+0000", 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9726999999999998e-05 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680032+0000", 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010032299999999999 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680042+0000", 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3510000000000008e-06 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688283+0000", 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082418319999999993 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688516+0000", 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023273 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.678752654, 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035922279999999998, 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.418 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 207 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:39.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731022+0000", 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7140000000000002e-06 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731035+0000", 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3339999999999999e-05 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731069+0000", 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4102e-05 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731086+0000", 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6889999999999999e-05 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731309+0000", 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022293599999999999 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731595+0000", 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028612400000000001 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.732083+0000", 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048802300000000003 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.733712+0000", 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001629339 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734464+0000", 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075213400000000001 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734544+0000", 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9653000000000005e-05 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734611+0000", 2024-05-10T09:55:39.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6972999999999997e-05 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.624969514999997, 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003743836, 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.424 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 216 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784805+0000", 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5730000000000002e-06 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784817+0000", 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.277e-05 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784854+0000", 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6205999999999999e-05 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784873+0000", 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9749999999999999e-05 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785009+0000", 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013592300000000001 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785241+0000", 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000232031 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785673+0000", 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043218999999999999 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.787225+0000", 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015515259999999999 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788269+0000", 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001043906 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788425+0000", 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155742 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788546+0000", 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012121900000000001 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.429 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.584886075999997, 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034684479999999998, 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.430 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 227 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824888+0000", 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6960000000000001e-06 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824901+0000", 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3144e-05 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824932+0000", 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0273e-05 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824948+0000", 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6402999999999999e-05 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825065+0000", 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011705300000000001 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825277+0000", 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021180099999999999 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:39.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825698+0000", 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042071399999999998 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.827222+0000", 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015247489999999999 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828074+0000", 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085207100000000003 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828231+0000", 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015675199999999999 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828354+0000", 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012279200000000001 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:39.435 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.576791907, 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032440870000000001, 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 229 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832982+0000", 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6429999999999999e-06 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832995+0000", 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2979999999999999e-05 2024-05-10T09:55:39.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833026+0000", 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0383e-05 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833041+0000", 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4922999999999999e-05 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833158+0000", 2024-05-10T09:55:39.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011791299999999999 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833366+0000", 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020795500000000001 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833777+0000", 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000410331 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.835291+0000", 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015140329999999999 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836021+0000", 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00073029400000000004 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836105+0000", 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3666999999999997e-05 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836224+0000", 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118965 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.569582410999999, 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034732550000000002, 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.441 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 231 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:39.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840191+0000", 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.996e-06 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840203+0000", 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1523e-05 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840229+0000", 2024-05-10T09:55:39.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6713e-05 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840244+0000", 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4243999999999999e-05 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840361+0000", 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011759199999999999 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840612+0000", 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025127500000000002 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.841027+0000", 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00041445099999999998 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.842473+0000", 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001446536 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843387+0000", 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091381700000000004 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843543+0000", 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155379 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843662+0000", 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011972900000000001 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:680 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.305235674999999, 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029268050000000002, 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 680 2024-05-10T09:55:39.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104538+0000", 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4399999999999999e-06 2024-05-10T09:55:39.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104552+0000", 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104589+0000", 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6671000000000002e-05 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104607+0000", 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7943000000000001e-05 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104729+0000", 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012238700000000001 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104918+0000", 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018902200000000001 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.105255+0000", 2024-05-10T09:55:39.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033649500000000002 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106322+0000", 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001067389 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107175+0000", 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085289000000000003 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107340+0000", 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016486199999999999 2024-05-10T09:55:39.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107463+0000", 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012261999999999999 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.219819018999999, 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029077830000000002, 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.452 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 730 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:39.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189955+0000", 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1600000000000001e-06 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189966+0000", 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1739999999999999e-05 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189998+0000", 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1229999999999997e-05 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190012+0000", 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4769e-05 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190156+0000", 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014340300000000001 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190368+0000", 2024-05-10T09:55:39.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000211895 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190680+0000", 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031250499999999998 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.191743+0000", 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010630749999999999 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192700+0000", 2024-05-10T09:55:39.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095679700000000001 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192785+0000", 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5205999999999997e-05 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192860+0000", 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5003e-05 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.206212376000003, 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033316309999999998, 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 736 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.458 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203561+0000", 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3439999999999999e-06 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203573+0000", 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1996e-05 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203611+0000", 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7577000000000003e-05 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203626+0000", 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5217e-05 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203813+0000", 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018622499999999999 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204026+0000", 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000213542 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204352+0000", 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032619799999999998 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.205489+0000", 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011368649999999999 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206609+0000", 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011194919999999999 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206768+0000", 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015959200000000001 2024-05-10T09:55:39.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206891+0000", 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122583 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.201929729, 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031971209999999998, 2024-05-10T09:55:39.463 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 738 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207844+0000", 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7269999999999999e-06 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207853+0000", 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8630000000000003e-06 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207879+0000", 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5219999999999999e-05 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207891+0000", 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208029+0000", 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013824599999999999 2024-05-10T09:55:39.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208278+0000", 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024847399999999999 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208777+0000", 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049937099999999997 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210173+0000", 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013959560000000001 2024-05-10T09:55:39.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210892+0000", 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071904200000000003 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210976+0000", 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4105999999999997e-05 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.211039+0000", 2024-05-10T09:55:39.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2535999999999999e-05 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.049338868, 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003393713, 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.469 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 802 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360435+0000", 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.08e-06 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360446+0000", 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1457000000000001e-05 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360476+0000", 2024-05-10T09:55:39.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0153000000000001e-05 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360491+0000", 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5024e-05 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360652+0000", 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361013+0000", 2024-05-10T09:55:39.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036118400000000002 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361578+0000", 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056503900000000004 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.362848+0000", 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001270094 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363541+0000", 2024-05-10T09:55:39.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069264200000000004 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363699+0000", 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158672 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363826+0000", 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012694599999999999 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 48.044739597000003, 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003036015, 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 804 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365034+0000", 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.03e-06 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365045+0000", 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.114e-05 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365079+0000", 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3726000000000002e-05 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365094+0000", 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5384e-05 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365225+0000", 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013112900000000001 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365460+0000", 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000234754 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365938+0000", 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047798399999999998 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367189+0000", 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012510209999999999 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367802+0000", 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000612935 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367964+0000", 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016159900000000001 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.368068+0000", 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104313 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.992261296000002, 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030128820000000001, 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.480 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 826 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417513+0000", 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3130000000000001e-06 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417525+0000", 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2574e-05 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417556+0000", 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0790000000000002e-05 2024-05-10T09:55:39.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417571+0000", 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4976e-05 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417704+0000", 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013354299999999999 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417944+0000", 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023976800000000001 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.418281+0000", 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033648800000000002 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.419414+0000", 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011336580000000001 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420370+0000", 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095544 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420455+0000", 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5675999999999998e-05 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420523+0000", 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7656000000000004e-05 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.889696436999998, 2024-05-10T09:55:39.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032627770000000001, 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 871 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520077+0000", 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9470000000000002e-06 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520091+0000", 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3586e-05 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520120+0000", 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9167e-05 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520135+0000", 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4946000000000001e-05 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520288+0000", 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015277300000000001 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520668+0000", 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038034700000000001 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.521266+0000", 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059778200000000004 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.522481+0000", 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001215591 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523188+0000", 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070687500000000004 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523273+0000", 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5169999999999999e-05 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523338+0000", 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4592999999999996e-05 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.490 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.854394300000003, 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003478835, 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 886 2024-05-10T09:55:39.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555379+0000", 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.243e-06 2024-05-10T09:55:39.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555392+0000", 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2225999999999999e-05 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555423+0000", 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0994000000000002e-05 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555438+0000", 2024-05-10T09:55:39.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5143000000000001e-05 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555594+0000", 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156009 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555974+0000", 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037971400000000002 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.556522+0000", 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054812199999999995 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.557713+0000", 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011910060000000001 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558707+0000", 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099478600000000011 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558794+0000", 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6142000000000003e-05 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558856+0000", 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.245e-05 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.496 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.833199164, 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003113457, 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 895 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576574+0000", 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576585+0000", 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0924000000000001e-05 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576615+0000", 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0066e-05 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576630+0000", 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4693e-05 2024-05-10T09:55:39.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576745+0000", 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011446300000000001 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576974+0000", 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022977100000000001 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.577315+0000", 2024-05-10T09:55:39.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034073099999999999 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.578411+0000", 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001095752 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579411+0000", 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099999000000000008 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579570+0000", 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015879499999999999 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579686+0000", 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116259 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.502 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.829193805999999, 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029848890000000001, 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 897 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580579+0000", 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.313e-06 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580587+0000", 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6969999999999993e-06 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580609+0000", 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2263e-05 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580620+0000", 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1293e-05 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580743+0000", 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122299 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580998+0000", 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025569500000000001 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.581477+0000", 2024-05-10T09:55:39.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047893000000000002 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.582608+0000", 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131232 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583301+0000", 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000692839 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583453+0000", 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000151562 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583563+0000", 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010976600000000001 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:39.508 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.826072758000002, 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032632500000000001, 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 898 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583701+0000", 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.854e-06 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583729+0000", 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8498999999999999e-05 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583761+0000", 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622999999999999e-05 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583776+0000", 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.517e-05 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583913+0000", 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137453 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584254+0000", 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034036400000000001 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584799+0000", 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054493300000000005 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586086+0000", 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012870410000000001 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586691+0000", 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060565800000000002 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586848+0000", 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156973 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586962+0000", 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113682 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.821774257999998, 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003187517, 2024-05-10T09:55:39.514 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 900 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587999+0000", 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.663e-06 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588024+0000", 2024-05-10T09:55:39.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5432999999999999e-05 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588048+0000", 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3666e-05 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588059+0000", 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1174e-05 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588178+0000", 2024-05-10T09:55:39.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118416 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588398+0000", 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220485 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588860+0000", 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046165300000000002 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590173+0000", 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013134469999999999 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590917+0000", 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074345200000000002 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591067+0000", 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015018900000000001 2024-05-10T09:55:39.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591185+0000", 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117939 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.739431009, 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031097049999999999, 2024-05-10T09:55:39.520 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 934 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670343+0000", 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670355+0000", 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1647e-05 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670384+0000", 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670405+0000", 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0296e-05 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670553+0000", 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014783900000000001 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670880+0000", 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032728100000000001 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.671207+0000", 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032735799999999998 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.672408+0000", 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001201045 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673285+0000", 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087693700000000005 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673383+0000", 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8321999999999998e-05 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673450+0000", 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6723999999999993e-05 2024-05-10T09:55:39.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:39.526 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:39.526 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:39.527 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:39.528 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:55:39.529 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:39.524+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:39.628 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:39.623+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:39.658 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:39.658 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:39.658 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:39.658 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:39.673 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:39.729 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:39.723+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:39.788 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:39.788 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:39.788 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:39.788 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:39.789 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:39.801 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:39.846 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:39.844+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:39.930 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.256834433000002, 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086530440000000004, 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "reached pg", 2024-05-10T09:55:39.931 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:39.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670663+0000", 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1870000000000001e-06 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670697+0000", 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4013000000000001e-05 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670734+0000", 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6449999999999998e-05 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670760+0000", 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6196000000000001e-05 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670897+0000", 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013763499999999999 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670912+0000", 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.417e-05 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.678965+0000", 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080535780000000005 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.679313+0000", 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034781500000000002 2024-05-10T09:55:39.935 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.220520524999998, 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049225980000000003, 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706975+0000", 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.083e-06 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706996+0000", 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1463000000000001e-05 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707016+0000", 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9639999999999998e-05 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707036+0000", 2024-05-10T09:55:39.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9949000000000002e-05 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707643+0000", 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060738299999999997 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707688+0000", 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5201999999999999e-05 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711782+0000", 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040939649999999998 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711896+0000", 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011391300000000001 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:47 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'2, mlcod=0'0)", 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:39.940 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.211531655000002, 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039603599999999996, 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715965+0000", 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.04e-06 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715981+0000", 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716014+0000", 2024-05-10T09:55:39.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3543000000000001e-05 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716035+0000", 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0849999999999999e-05 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716179+0000", 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014356199999999999 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716226+0000", 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7512000000000002e-05 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719825+0000", 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035986569999999999 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719923+0000", 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8060000000000006e-05 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.168275858999998, 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010358320000000001, 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 211 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.945 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759222+0000", 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759238+0000", 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5889999999999999e-05 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759276+0000", 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8226000000000003e-05 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759293+0000", 2024-05-10T09:55:39.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7453999999999999e-05 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759495+0000", 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000201974 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759509+0000", 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.362e-05 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.765967+0000", 2024-05-10T09:55:39.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006457717 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766268+0000", 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000301124 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766936+0000", 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00066803499999999998 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.768435+0000", 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014995150000000001 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769328+0000", 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089229700000000001 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769474+0000", 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014578200000000001 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769577+0000", 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103199 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.083307441000002, 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034011599999999999, 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.951 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 232 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844190+0000", 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844202+0000", 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844234+0000", 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1822999999999997e-05 2024-05-10T09:55:39.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844250+0000", 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6713000000000001e-05 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844385+0000", 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013458900000000001 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844620+0000", 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023536799999999999 2024-05-10T09:55:39.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.845031+0000", 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041049700000000001 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.846532+0000", 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015012820000000001 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847430+0000", 2024-05-10T09:55:39.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089785600000000004 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847520+0000", 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0303000000000006e-05 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847588+0000", 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7745999999999998e-05 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:272 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.057870911000002, 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036051189999999999, 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 272 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869626+0000", 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:39.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869636+0000", 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0013000000000001e-05 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869663+0000", 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7630000000000001e-05 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869682+0000", 2024-05-10T09:55:39.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8403999999999999e-05 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869807+0000", 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012508199999999999 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870001+0000", 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019480499999999999 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:39.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870357+0000", 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035530099999999998 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871669+0000", 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001311776 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.872980+0000", 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013111760000000001 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873124+0000", 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000144086 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873229+0000", 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104666 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.962 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:279 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.056720683000002, 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030980360000000002, 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 279 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870776+0000", 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1569999999999998e-06 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870789+0000", 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2756e-05 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870814+0000", 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5726999999999999e-05 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870833+0000", 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870974+0000", 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014081200000000001 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871320+0000", 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034598000000000002 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871968+0000", 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064825199999999999 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873503+0000", 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534671 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873681+0000", 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178066 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873790+0000", 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109106 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873872+0000", 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1848999999999995e-05 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:314 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.050793839000001, 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051436470000000003, 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.968 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 314 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876703+0000", 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876716+0000", 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.29e-05 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876746+0000", 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0289000000000001e-05 2024-05-10T09:55:39.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876766+0000", 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9936999999999999e-05 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876915+0000", 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148632 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877123+0000", 2024-05-10T09:55:39.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000208622 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877524+0000", 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040038299999999998 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881305+0000", 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037810109999999999 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881676+0000", 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000370854 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881761+0000", 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4997e-05 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881844+0000", 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3474999999999996e-05 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.025001291999999, 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029358380000000001, 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 406 2024-05-10T09:55:39.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902496+0000", 2024-05-10T09:55:39.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6690000000000002e-06 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902511+0000", 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5123000000000001e-05 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902543+0000", 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.26e-05 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902564+0000", 2024-05-10T09:55:39.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0835999999999998e-05 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902712+0000", 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148131 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902984+0000", 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027137500000000002 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.903362+0000", 2024-05-10T09:55:39.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037871299999999998 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.904567+0000", 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012045890000000001 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905281+0000", 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071434299999999999 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905367+0000", 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5833000000000003e-05 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905429+0000", 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1625999999999996e-05 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:493 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.973097287999998, 2024-05-10T09:55:39.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050291299999999997, 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 493 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954398+0000", 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3400000000000001e-06 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954405+0000", 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8329999999999996e-06 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954424+0000", 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954435+0000", 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954516+0000", 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1138999999999997e-05 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954721+0000", 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020454800000000001 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955012+0000", 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000290888 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956172+0000", 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011604510000000001 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959287+0000", 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031147750000000002 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959352+0000", 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4622000000000006e-05 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959426+0000", 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4413999999999996e-05 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:494 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.972982856000002, 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044303820000000001, 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 494 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954513+0000", 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2500000000000001e-06 2024-05-10T09:55:39.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954521+0000", 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1729999999999995e-06 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954535+0000", 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4394e-05 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954545+0000", 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-06 2024-05-10T09:55:39.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954661+0000", 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011643500000000001 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954872+0000", 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000210805 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955341+0000", 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046933700000000001 2024-05-10T09:55:39.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956602+0000", 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001260323 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958742+0000", 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021402560000000001 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958878+0000", 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013547099999999999 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958942+0000", 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4307999999999995e-05 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:503 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.966981162000003, 2024-05-10T09:55:39.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003841995, 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 503 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960515+0000", 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2000000000000001e-06 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960528+0000", 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2476e-05 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960561+0000", 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3460000000000002e-05 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960581+0000", 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9763e-05 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960707+0000", 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012605799999999999 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960841+0000", 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134122 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.961113+0000", 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027215799999999999 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964004+0000", 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002890849 2024-05-10T09:55:39.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964166+0000", 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016143 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964261+0000", 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5128000000000001e-05 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964355+0000", 2024-05-10T09:55:39.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4351000000000005e-05 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.862663044000001, 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029080270000000001, 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:39.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 633 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064834+0000", 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9330000000000001e-06 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064849+0000", 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5003e-05 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064881+0000", 2024-05-10T09:55:39.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2162999999999997e-05 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064897+0000", 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5444e-05 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065013+0000", 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116662 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:39.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065239+0000", 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022532800000000001 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065553+0000", 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031410800000000001 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.066681+0000", 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001128038 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067537+0000", 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00085565999999999995 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067632+0000", 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5149000000000007e-05 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067739+0000", 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107539 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.631385909000002, 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031802750000000002, 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 775 2024-05-10T09:55:40.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296111+0000", 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5440000000000001e-06 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296126+0000", 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5243e-05 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296158+0000", 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1359000000000002e-05 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296173+0000", 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296308+0000", 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135592 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296654+0000", 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034609799999999998 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:40.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.297217+0000", 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056229200000000004 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.298808+0000", 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015914010000000001 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299121+0000", 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031244399999999999 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299209+0000", 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8159999999999996e-05 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299289+0000", 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9981999999999994e-05 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:40.007 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.552121104999998, 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003080607, 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 808 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375392+0000", 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8366999999999999e-05 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375406+0000", 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4506e-05 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375438+0000", 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1869999999999998e-05 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375453+0000", 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5204e-05 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375580+0000", 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012671500000000001 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375856+0000", 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027567200000000003 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.376172+0000", 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031694999999999998 2024-05-10T09:55:40.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.377362+0000", 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011898880000000001 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378247+0000", 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088473399999999998 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378337+0000", 2024-05-10T09:55:40.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0094999999999997e-05 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378454+0000", 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116606 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.538042773000001, 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032206259999999999, 2024-05-10T09:55:40.013 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 814 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389454+0000", 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1629999999999999e-06 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389467+0000", 2024-05-10T09:55:40.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3414000000000001e-05 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389498+0000", 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0783e-05 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389513+0000", 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.485e-05 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389669+0000", 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015608899999999999 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390051+0000", 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038213400000000001 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390607+0000", 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055646199999999997 2024-05-10T09:55:40.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392039+0000", 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014314519999999999 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392507+0000", 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046770999999999998 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392593+0000", 2024-05-10T09:55:40.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6159e-05 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392672+0000", 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.941e-05 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.386059256000003, 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029667840000000001, 2024-05-10T09:55:40.019 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 880 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541439+0000", 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541451+0000", 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2583e-05 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541484+0000", 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3176999999999998e-05 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541501+0000", 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6249999999999999e-05 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541623+0000", 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012215199999999999 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541853+0000", 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023054799999999999 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.542204+0000", 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035071100000000002 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.543359+0000", 2024-05-10T09:55:40.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011545609999999999 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544248+0000", 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088955700000000002 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544335+0000", 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544402+0000", 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6408999999999994e-05 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.381867647999997, 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029184770000000001, 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.025 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 882 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545629+0000", 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1299999999999999e-06 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545640+0000", 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1663e-05 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545672+0000", 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1922999999999999e-05 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545691+0000", 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8583000000000001e-05 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545821+0000", 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012955599999999999 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545967+0000", 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014623199999999999 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.546238+0000", 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027076800000000001 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.547400+0000", 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011622080000000001 2024-05-10T09:55:40.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548341+0000", 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00094160900000000004 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548428+0000", 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6502999999999995e-05 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548545+0000", 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117302 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.37867164, 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002968301, 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.031 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 883 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548824+0000", 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7540000000000001e-06 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548835+0000", 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0243e-05 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548859+0000", 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4253e-05 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548873+0000", 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4056999999999999e-05 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548984+0000", 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011150900000000001 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549223+0000", 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023871100000000001 2024-05-10T09:55:40.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549550+0000", 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000327301 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.550681+0000", 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011309849999999999 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551571+0000", 2024-05-10T09:55:40.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088975600000000001 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551662+0000", 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0956000000000001e-05 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551791+0000", 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012877599999999999 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.036 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.278486463, 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003259788, 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 925 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.037 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649010+0000", 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1239999999999999e-06 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649021+0000", 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0766e-05 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649051+0000", 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0533000000000001e-05 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649067+0000", 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5446000000000001e-05 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649189+0000", 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122576 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649413+0000", 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022339199999999999 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649726+0000", 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031377100000000002 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.650954+0000", 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012274300000000001 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.651996+0000", 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001041922 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652156+0000", 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015990500000000001 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652268+0000", 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011192300000000001 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.042 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:40.043 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:39.928+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:40.043 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:40.045 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:40.039+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:40.146 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:40.144+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:40.212 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:40.212 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:40.212 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:40.212 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:40.225 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:40.247 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:40.243+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:40.348 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:40.344+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:40.390 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:40.390 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:40.390 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:40.390 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:40.390 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:40.404 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:40.448 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:40.443+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:40.549 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:40.543+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:40.573 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:40.573 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:40.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:40.573 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:40.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.573 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:40.573 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.850553593999997, 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003342228, 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 41 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720248+0000", 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.17e-06 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720259+0000", 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1362999999999999e-05 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720290+0000", 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1245999999999999e-05 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720326+0000", 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5769999999999998e-05 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720467+0000", 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014139299999999999 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720848+0000", 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038087700000000001 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.721316+0000", 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000468159 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.722880+0000", 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001563839 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723331+0000", 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000450603 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723447+0000", 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115742 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723588+0000", 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014106599999999999 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.775133562000001, 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036007420000000001, 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.579 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 39 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795667+0000", 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.883e-06 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795677+0000", 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5359999999999998e-06 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795702+0000", 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4927e-05 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795716+0000", 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3828999999999999e-05 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795878+0000", 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162373 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.796006+0000", 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012822199999999999 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.799266+0000", 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032599719999999999 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.855927569999999, 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056055200000000001, 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.583 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714875+0000", 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.303e-06 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714893+0000", 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8668000000000002e-05 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714927+0000", 2024-05-10T09:55:40.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3519999999999998e-05 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714948+0000", 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0911e-05 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715113+0000", 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016473599999999999 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715512+0000", 2024-05-10T09:55:40.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039976900000000001 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715816+0000", 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000303417 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719016+0000", 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032006589999999998 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720317+0000", 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013003859999999999 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720396+0000", 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9043999999999997e-05 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720477+0000", 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1106999999999994e-05 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491083450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.849951375000003, 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050150489999999997, 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720849+0000", 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5740000000000001e-06 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720857+0000", 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2339999999999994e-06 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720878+0000", 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0939000000000001e-05 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720890+0000", 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1863e-05 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720993+0000", 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102446 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721163+0000", 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017038700000000001 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721496+0000", 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00033285399999999999 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.723818+0000", 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002322246 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725574+0000", 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001755288 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725705+0000", 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131345 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725863+0000", 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157873 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.846940431, 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033784850000000001, 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.594 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 205 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:40.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723863+0000", 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9369999999999997e-06 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723879+0000", 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.662e-05 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723917+0000", 2024-05-10T09:55:40.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7462999999999997e-05 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723936+0000", 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9049999999999999e-05 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724071+0000", 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013534500000000001 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724296+0000", 2024-05-10T09:55:40.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000224766 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724714+0000", 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041791000000000002 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.726248+0000", 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534168 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727037+0000", 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00078889400000000005 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727121+0000", 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4109000000000004e-05 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727237+0000", 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116223 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.599 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.770962160000003, 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034944860000000002, 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.600 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 220 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799840+0000", 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.88e-06 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799852+0000", 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2597e-05 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799878+0000", 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.563e-05 2024-05-10T09:55:40.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799892+0000", 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800078+0000", 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018622800000000001 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800286+0000", 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020734900000000001 2024-05-10T09:55:40.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800679+0000", 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039302599999999999 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.802102+0000", 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014227090000000001 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803181+0000", 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001079602 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803265+0000", 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4085999999999994e-05 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803331+0000", 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6175999999999998e-05 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.605 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.760237363000002, 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033216510000000001, 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.606 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 223 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810564+0000", 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0099999999999998e-06 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810576+0000", 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1919999999999999e-05 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810604+0000", 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8293000000000002e-05 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810618+0000", 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.453e-05 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810739+0000", 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120559 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810974+0000", 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023486500000000001 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.811410+0000", 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043620699999999998 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.812739+0000", 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013293929999999999 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813736+0000", 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00099665600000000006 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813819+0000", 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3024999999999999e-05 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813883+0000", 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4193e-05 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.752871853000002, 2024-05-10T09:55:40.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034076969999999999, 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 225 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817929+0000", 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9800000000000001e-06 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817940+0000", 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1263e-05 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817966+0000", 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5517e-05 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817981+0000", 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.508e-05 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818160+0000", 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017946800000000001 2024-05-10T09:55:40.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818375+0000", 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021470500000000001 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818799+0000", 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042364600000000002 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.820054+0000", 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012555439999999999 2024-05-10T09:55:40.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821175+0000", 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011206720000000001 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821267+0000", 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2164999999999996e-05 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821335+0000", 2024-05-10T09:55:40.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7657000000000006e-05 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.749084959000001, 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031354019999999998, 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.617 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 226 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:40.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821716+0000", 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0329999999999998e-06 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821726+0000", 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821758+0000", 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1109000000000003e-05 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821795+0000", 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7262999999999999e-05 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821923+0000", 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127906 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822156+0000", 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233231 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822572+0000", 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041563400000000001 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.823868+0000", 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00129623 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824698+0000", 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083007700000000003 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824784+0000", 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5636000000000005e-05 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824849+0000", 2024-05-10T09:55:40.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5986000000000001e-05 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.719206620000001, 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031471559999999999, 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.623 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 234 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851595+0000", 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851606+0000", 2024-05-10T09:55:40.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1039999999999999e-05 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851637+0000", 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1572999999999997e-05 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851653+0000", 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851833+0000", 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017961100000000001 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852052+0000", 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000219905 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852491+0000", 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043847999999999999 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.853823+0000", 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013323670000000001 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854589+0000", 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076523699999999999 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854679+0000", 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0660000000000003e-05 2024-05-10T09:55:40.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854740+0000", 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0396000000000002e-05 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:431 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.656922250000001, 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031636749999999999, 2024-05-10T09:55:40.630 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 431 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913878+0000", 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4699999999999999e-06 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913885+0000", 2024-05-10T09:55:40.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7830000000000001e-06 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913899+0000", 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3550000000000001e-05 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913910+0000", 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1116e-05 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914037+0000", 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012750899999999999 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914363+0000", 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032586799999999999 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914907+0000", 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054394199999999995 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916597+0000", 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016898 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916905+0000", 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030769499999999997 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916982+0000", 2024-05-10T09:55:40.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7809e-05 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.917040+0000", 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8133000000000001e-05 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:442 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.651835636999998, 2024-05-10T09:55:40.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031368049999999999, 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 442 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918965+0000", 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.654e-06 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918973+0000", 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0730000000000005e-06 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918999+0000", 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5437000000000001e-05 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919011+0000", 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140000000000001e-05 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919129+0000", 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118539 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919440+0000", 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031087500000000001 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919767+0000", 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032684599999999999 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921033+0000", 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001266348 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921785+0000", 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075156400000000003 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921937+0000", 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015235800000000001 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.922100+0000", 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016297100000000001 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:493 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.615608041999998, 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038321729999999999, 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.642 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955193+0000", 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.514e-06 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955205+0000", 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2395000000000001e-05 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955230+0000", 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4939e-05 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955242+0000", 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1989e-05 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955399+0000", 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015761700000000001 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955455+0000", 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5946999999999998e-05 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958922+0000", 2024-05-10T09:55:40.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034661230000000002 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959023+0000", 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101649 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:531 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.591880590999999, 2024-05-10T09:55:40.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033419700000000001, 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978920+0000", 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.646e-06 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978932+0000", 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1746000000000001e-05 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978957+0000", 2024-05-10T09:55:40.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5425000000000001e-05 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978970+0000", 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3186e-05 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979090+0000", 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119621 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979128+0000", 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7765999999999997e-05 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982128+0000", 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030005269999999998 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982260+0000", 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132053 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.650 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:532 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.589935894, 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040928650000000002, 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:40.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980865+0000", 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.531e-06 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980875+0000", 2024-05-10T09:55:40.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0749e-05 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980899+0000", 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4031000000000001e-05 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980911+0000", 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1897e-05 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981024+0000", 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112574 2024-05-10T09:55:40.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981067+0000", 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3556000000000001e-05 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984876+0000", 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003808624 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984956+0000", 2024-05-10T09:55:40.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9902999999999997e-05 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.345302201999999, 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035004300000000001, 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.655 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 745 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225500+0000", 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3100000000000001e-06 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225513+0000", 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.278e-05 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225544+0000", 2024-05-10T09:55:40.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0573e-05 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225559+0000", 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.522e-05 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225710+0000", 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015115899999999999 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226066+0000", 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035624300000000001 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226622+0000", 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055600300000000001 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.227855+0000", 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012332510000000001 2024-05-10T09:55:40.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228722+0000", 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00086697599999999999 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228885+0000", 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162969 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228997+0000", 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111946 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.660 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:747 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.340580695, 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032519850000000002, 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 747 2024-05-10T09:55:40.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230220+0000", 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6559999999999999e-06 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230228+0000", 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.824e-06 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230248+0000", 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230259+0000", 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1406999999999999e-05 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230372+0000", 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112829 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230596+0000", 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022375499999999999 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.231055+0000", 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045978700000000002 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.232387+0000", 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013311589999999999 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233206+0000", 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081972000000000002 2024-05-10T09:55:40.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233359+0000", 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152683 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233470+0000", 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111419 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.302609697999998, 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031982120000000002, 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 763 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.667 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268191+0000", 2024-05-10T09:55:40.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0360000000000001e-06 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268202+0000", 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.043e-05 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268234+0000", 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1847000000000002e-05 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268255+0000", 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1590000000000002e-05 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268443+0000", 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018751799999999999 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268670+0000", 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022725499999999999 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268993+0000", 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032307800000000003 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.270123+0000", 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011297709999999999 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271173+0000", 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010499019999999999 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271257+0000", 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3901999999999997e-05 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271388+0000", 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013088299999999999 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:40.672 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 49.156671424999999, 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034247800000000001, 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 825 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:40.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414129+0000", 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.657e-06 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414140+0000", 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414159+0000", 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8805999999999999e-05 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414170+0000", 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1007e-05 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414280+0000", 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110115 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414524+0000", 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244405 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.415025+0000", 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00050059300000000002 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.416518+0000", 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014937889999999999 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417272+0000", 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075359400000000001 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417420+0000", 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148009 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417552+0000", 2024-05-10T09:55:40.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013230499999999999 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 48.929523531000001, 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003571369, 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:40.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 922 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:40.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641278+0000", 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.097e-06 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641289+0000", 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1163e-05 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641320+0000", 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1600000000000002e-05 2024-05-10T09:55:40.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641342+0000", 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2089000000000001e-05 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641594+0000", 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025150200000000002 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642155+0000", 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056140900000000002 2024-05-10T09:55:40.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642609+0000", 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045330000000000001 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.643594+0000", 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098517900000000009 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644692+0000", 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010985039999999999 2024-05-10T09:55:40.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644782+0000", 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9837000000000001e-05 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644847+0000", 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4689000000000004e-05 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:40.683 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:40.685 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:40.685 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:40.679+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:40.786 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:40.779+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:40.812 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:40.812 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:40.812 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:40.826 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:40.887 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:40.883+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:40.915 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:40.942 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:40.942 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:40.942 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:40.942 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:40.942 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:40.956 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:40.987 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:40.983+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:41.075 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:41.075 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.377149592999999, 2024-05-10T09:55:41.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.091 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.367000245, 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.092 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:55:41.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:55:41.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:55:41.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.397131627999997, 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:55:41.097 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:41.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:41.103 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.369074931, 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:41.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:55:41.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:55:41.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.108 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.354703821000001, 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:55:41.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:55:41.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:55:41.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.352017642, 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.114 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:41.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:55:41.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:55:41.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:55:41.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:41.119 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.257110449000002, 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:41.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.337540234000002, 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:55:41.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:55:41.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:55:41.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.293810151000002, 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:55:41.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:55:41.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:55:41.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.279197003999997, 2024-05-10T09:55:41.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:41.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.204467444000002, 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:55:41.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.186321081000003, 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.141 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:41.145 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.151566561000003, 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:41.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:55:41.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:55:41.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.149 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.150492348999997, 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:55:41.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:55:41.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.150000237999997, 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:55:41.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:55:41.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.147950647999998, 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:55:41.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.161 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.141706128999999, 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:41.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:55:41.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:55:41.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.138491704000003, 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.166 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.137318266000001, 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.170 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:55:41.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:55:41.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:55:41.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 50.085967889000003, 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:41.174 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:55:41.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:55:41.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:55:41.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:41.178 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:41.179 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:41.179 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:41.180 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:41.180 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:41.180 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:41.181 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:41.181 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:41.181 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:41.182 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:41.182 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:41.182 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:41.182 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:41.175+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:41.189 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:41.189 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:41.208 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:41.208 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:41.280 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:41.276+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:41.308 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:41.308 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:41.322 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:41.410 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:41.408+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:41.482 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:41.475+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:41.492 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:41.492 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:41.507 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:41.529 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:55:41.594 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:41.592+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:41.671 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:41.671 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:41.683 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:41.679+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:41.686 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:41.785 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:41.779+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:41.804 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:41.804 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:41.818 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:41.885 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:41.884+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:41.981 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:41.982 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:41.986 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:41.984+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:41.995 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:42.087 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:42.084+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:42.120 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:42.120 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:42.136 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:42.187 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:42.184+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:42.261 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:42.261 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:42.276 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:42.323 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:42.319+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:42.390 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:42.388+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:42.396 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:42.396 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:42.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:42.467 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:55:42.491 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:42.488+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:42.581 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:42.581 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:42.591 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:42.588+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:42.596 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:42.692 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:42.688+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:42.722 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:42.722 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:42.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:42.793 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:42.788+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:42.854 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:42.854 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:42.869 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:42.893 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:42.892+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:42.991 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:42.991 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:42.995 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:42.992+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:43.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:43.095 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:43.092+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:43.144 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:43.144 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:43.159 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:43.203 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:43.199+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:43.227 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:43.293 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:43.293 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:43.296 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:43.291+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:43.308 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:43.389 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:43.389 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:43.397 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:43.391+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:43.411 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:43.412 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:43.439 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:43.439 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:43.465 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:43.465 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:43.479 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:43.479 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 57.797817999000003, 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086496530000000002, 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 44 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679869+0000", 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3719999999999999e-06 2024-05-10T09:55:43.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679880+0000", 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0854e-05 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679902+0000", 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2464e-05 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679932+0000", 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9726999999999998e-05 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680032+0000", 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010032299999999999 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680042+0000", 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3510000000000008e-06 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688283+0000", 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082418319999999993 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688516+0000", 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023273 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:43.484 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.746665698000001, 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035922279999999998, 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 207 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:43.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731022+0000", 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7140000000000002e-06 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731035+0000", 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3339999999999999e-05 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731069+0000", 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4102e-05 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731086+0000", 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6889999999999999e-05 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731309+0000", 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022293599999999999 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731595+0000", 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028612400000000001 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.732083+0000", 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048802300000000003 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.733712+0000", 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001629339 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734464+0000", 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075213400000000001 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734544+0000", 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9653000000000005e-05 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734611+0000", 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6972999999999997e-05 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.692882558999997, 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003743836, 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.490 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 216 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784805+0000", 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5730000000000002e-06 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784817+0000", 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.277e-05 2024-05-10T09:55:43.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784854+0000", 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6205999999999999e-05 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784873+0000", 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9749999999999999e-05 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785009+0000", 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013592300000000001 2024-05-10T09:55:43.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785241+0000", 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000232031 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785673+0000", 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043218999999999999 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.787225+0000", 2024-05-10T09:55:43.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015515259999999999 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788269+0000", 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001043906 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788425+0000", 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155742 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788546+0000", 2024-05-10T09:55:43.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012121900000000001 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.652799119999997, 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034684479999999998, 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.496 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 227 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824888+0000", 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6960000000000001e-06 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824901+0000", 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3144e-05 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824932+0000", 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0273e-05 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824948+0000", 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6402999999999999e-05 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825065+0000", 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011705300000000001 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825277+0000", 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021180099999999999 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825698+0000", 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042071399999999998 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.827222+0000", 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015247489999999999 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828074+0000", 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085207100000000003 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828231+0000", 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015675199999999999 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828354+0000", 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012279200000000001 2024-05-10T09:55:43.501 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.644704951000001, 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032440870000000001, 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.502 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 229 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832982+0000", 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6429999999999999e-06 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832995+0000", 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2979999999999999e-05 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833026+0000", 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0383e-05 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833041+0000", 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4922999999999999e-05 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833158+0000", 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011791299999999999 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833366+0000", 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020795500000000001 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833777+0000", 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000410331 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.835291+0000", 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015140329999999999 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836021+0000", 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00073029400000000004 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836105+0000", 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3666999999999997e-05 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836224+0000", 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118965 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.507 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.637495455, 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034732550000000002, 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 231 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840191+0000", 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.996e-06 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840203+0000", 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1523e-05 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840229+0000", 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6713e-05 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840244+0000", 2024-05-10T09:55:43.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4243999999999999e-05 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840361+0000", 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011759199999999999 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840612+0000", 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025127500000000002 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:43.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.841027+0000", 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00041445099999999998 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.842473+0000", 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001446536 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843387+0000", 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091381700000000004 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843543+0000", 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155379 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843662+0000", 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011972900000000001 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:680 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:43.513 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.373148719, 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029268050000000002, 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 680 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104538+0000", 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4399999999999999e-06 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104552+0000", 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104589+0000", 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6671000000000002e-05 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104607+0000", 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7943000000000001e-05 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104729+0000", 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012238700000000001 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104918+0000", 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018902200000000001 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.105255+0000", 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033649500000000002 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106322+0000", 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001067389 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107175+0000", 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085289000000000003 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107340+0000", 2024-05-10T09:55:43.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016486199999999999 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107463+0000", 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012261999999999999 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.287732063, 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029077830000000002, 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.519 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 730 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189955+0000", 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1600000000000001e-06 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189966+0000", 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1739999999999999e-05 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189998+0000", 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1229999999999997e-05 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190012+0000", 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4769e-05 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190156+0000", 2024-05-10T09:55:43.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014340300000000001 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190368+0000", 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000211895 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190680+0000", 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031250499999999998 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.191743+0000", 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010630749999999999 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192700+0000", 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095679700000000001 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192785+0000", 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5205999999999997e-05 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192860+0000", 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5003e-05 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.274125419999997, 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033316309999999998, 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.525 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 736 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203561+0000", 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3439999999999999e-06 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203573+0000", 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1996e-05 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203611+0000", 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7577000000000003e-05 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203626+0000", 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5217e-05 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203813+0000", 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018622499999999999 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204026+0000", 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000213542 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204352+0000", 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032619799999999998 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.205489+0000", 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011368649999999999 2024-05-10T09:55:43.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206609+0000", 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011194919999999999 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206768+0000", 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015959200000000001 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206891+0000", 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122583 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.269842773000001, 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031971209999999998, 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.531 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 738 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207844+0000", 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7269999999999999e-06 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207853+0000", 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8630000000000003e-06 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207879+0000", 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5219999999999999e-05 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207891+0000", 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208029+0000", 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013824599999999999 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208278+0000", 2024-05-10T09:55:43.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024847399999999999 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208777+0000", 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049937099999999997 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210173+0000", 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013959560000000001 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210892+0000", 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071904200000000003 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210976+0000", 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4105999999999997e-05 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.211039+0000", 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2535999999999999e-05 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.117251912, 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003393713, 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 802 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360435+0000", 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.08e-06 2024-05-10T09:55:43.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360446+0000", 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1457000000000001e-05 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360476+0000", 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0153000000000001e-05 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360491+0000", 2024-05-10T09:55:43.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5024e-05 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360652+0000", 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361013+0000", 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036118400000000002 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:43.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361578+0000", 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056503900000000004 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.362848+0000", 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001270094 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363541+0000", 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069264200000000004 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363699+0000", 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158672 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363826+0000", 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012694599999999999 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.112652640999997, 2024-05-10T09:55:43.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003036015, 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 804 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365034+0000", 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.03e-06 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365045+0000", 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.114e-05 2024-05-10T09:55:43.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365079+0000", 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3726000000000002e-05 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365094+0000", 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5384e-05 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365225+0000", 2024-05-10T09:55:43.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013112900000000001 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365460+0000", 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000234754 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365938+0000", 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047798399999999998 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367189+0000", 2024-05-10T09:55:43.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012510209999999999 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367802+0000", 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000612935 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367964+0000", 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016159900000000001 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.368068+0000", 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104313 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.060174340000003, 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030128820000000001, 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.548 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 826 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417513+0000", 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3130000000000001e-06 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417525+0000", 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2574e-05 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417556+0000", 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0790000000000002e-05 2024-05-10T09:55:43.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417571+0000", 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4976e-05 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417704+0000", 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013354299999999999 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417944+0000", 2024-05-10T09:55:43.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023976800000000001 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.418281+0000", 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033648800000000002 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.419414+0000", 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011336580000000001 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420370+0000", 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095544 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420455+0000", 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5675999999999998e-05 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420523+0000", 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7656000000000004e-05 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.553 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 51.957609480999999, 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032627770000000001, 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.554 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 871 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520077+0000", 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9470000000000002e-06 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520091+0000", 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3586e-05 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520120+0000", 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9167e-05 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520135+0000", 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4946000000000001e-05 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520288+0000", 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015277300000000001 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520668+0000", 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038034700000000001 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.521266+0000", 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059778200000000004 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.522481+0000", 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001215591 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523188+0000", 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070687500000000004 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523273+0000", 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5169999999999999e-05 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523338+0000", 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4592999999999996e-05 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.559 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 51.922307344000004, 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003478835, 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 886 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555379+0000", 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.243e-06 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555392+0000", 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2225999999999999e-05 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555423+0000", 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0994000000000002e-05 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555438+0000", 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5143000000000001e-05 2024-05-10T09:55:43.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555594+0000", 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156009 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555974+0000", 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037971400000000002 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.556522+0000", 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054812199999999995 2024-05-10T09:55:43.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.557713+0000", 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011910060000000001 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558707+0000", 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099478600000000011 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558794+0000", 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6142000000000003e-05 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558856+0000", 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.245e-05 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:43.565 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 51.901112208000001, 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003113457, 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 895 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576574+0000", 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576585+0000", 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0924000000000001e-05 2024-05-10T09:55:43.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576615+0000", 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0066e-05 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576630+0000", 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4693e-05 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576745+0000", 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011446300000000001 2024-05-10T09:55:43.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576974+0000", 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022977100000000001 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.577315+0000", 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034073099999999999 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.578411+0000", 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001095752 2024-05-10T09:55:43.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579411+0000", 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099999000000000008 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579570+0000", 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015879499999999999 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579686+0000", 2024-05-10T09:55:43.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116259 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 51.89710685, 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029848890000000001, 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 897 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:55:43.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580579+0000", 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.313e-06 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580587+0000", 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6969999999999993e-06 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580609+0000", 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2263e-05 2024-05-10T09:55:43.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580620+0000", 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1293e-05 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580743+0000", 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122299 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580998+0000", 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025569500000000001 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.581477+0000", 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047893000000000002 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.582608+0000", 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131232 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583301+0000", 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000692839 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583453+0000", 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000151562 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583563+0000", 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010976600000000001 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 51.893985802000003, 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032632500000000001, 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 898 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.577 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583701+0000", 2024-05-10T09:55:43.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.854e-06 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583729+0000", 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8498999999999999e-05 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583761+0000", 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622999999999999e-05 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583776+0000", 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.517e-05 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583913+0000", 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137453 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584254+0000", 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034036400000000001 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:43.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584799+0000", 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054493300000000005 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586086+0000", 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012870410000000001 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586691+0000", 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060565800000000002 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586848+0000", 2024-05-10T09:55:43.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156973 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586962+0000", 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113682 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 51.889687301999999, 2024-05-10T09:55:43.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003187517, 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 900 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587999+0000", 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.663e-06 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588024+0000", 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5432999999999999e-05 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588048+0000", 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3666e-05 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588059+0000", 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1174e-05 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588178+0000", 2024-05-10T09:55:43.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118416 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588398+0000", 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220485 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588860+0000", 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046165300000000002 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590173+0000", 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013134469999999999 2024-05-10T09:55:43.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590917+0000", 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074345200000000002 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591067+0000", 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015018900000000001 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591185+0000", 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117939 2024-05-10T09:55:43.587 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 51.807344053000001, 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031097049999999999, 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:43.588 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 934 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:55:43.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670343+0000", 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670355+0000", 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1647e-05 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670384+0000", 2024-05-10T09:55:43.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670405+0000", 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0296e-05 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670553+0000", 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014783900000000001 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:43.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670880+0000", 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032728100000000001 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.671207+0000", 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032735799999999998 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.672408+0000", 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001201045 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673285+0000", 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087693700000000005 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673383+0000", 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8321999999999998e-05 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673450+0000", 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6723999999999993e-05 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.593 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.594 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:43.594 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:43.594 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:43.594 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:43.595 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:43.596 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:43.596 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:43.596 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:43.597 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:43.597 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:43.597 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:43.598 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:43.599 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:43.592+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:43.698 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:43.691+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:43.733 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:43.734 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:43.734 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:43.734 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:43.747 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:43.799 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:43.796+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:43.863 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:43.863 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:43.864 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:43.864 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:43.864 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:43.877 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:43.922 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:43.920+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:44.001 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:43.996+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:44.049 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:44.049 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:44.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:44.049 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:44.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.375895352000001, 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086530440000000004, 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "reached pg", 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.050 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670663+0000", 2024-05-10T09:55:44.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1870000000000001e-06 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670697+0000", 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4013000000000001e-05 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670734+0000", 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6449999999999998e-05 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670760+0000", 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6196000000000001e-05 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670897+0000", 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013763499999999999 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670912+0000", 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.417e-05 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.678965+0000", 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080535780000000005 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.679313+0000", 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034781500000000002 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:44.054 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.339581443999997, 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049225980000000003, 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706975+0000", 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.083e-06 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706996+0000", 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1463000000000001e-05 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707016+0000", 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9639999999999998e-05 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707036+0000", 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9949000000000002e-05 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707643+0000", 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060738299999999997 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707688+0000", 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5201999999999999e-05 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711782+0000", 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040939649999999998 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711896+0000", 2024-05-10T09:55:44.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011391300000000001 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:47 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'2, mlcod=0'0)", 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.330592574000001, 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039603599999999996, 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715965+0000", 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.04e-06 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715981+0000", 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716014+0000", 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3543000000000001e-05 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716035+0000", 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0849999999999999e-05 2024-05-10T09:55:44.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716179+0000", 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014356199999999999 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716226+0000", 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7512000000000002e-05 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719825+0000", 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035986569999999999 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719923+0000", 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8060000000000006e-05 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:44.063 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.287336777999997, 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010358320000000001, 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 211 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:44.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759222+0000", 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759238+0000", 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5889999999999999e-05 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759276+0000", 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8226000000000003e-05 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759293+0000", 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7453999999999999e-05 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759495+0000", 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000201974 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759509+0000", 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.362e-05 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.765967+0000", 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006457717 2024-05-10T09:55:44.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766268+0000", 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000301124 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766936+0000", 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00066803499999999998 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.768435+0000", 2024-05-10T09:55:44.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014995150000000001 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769328+0000", 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089229700000000001 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769474+0000", 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014578200000000001 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769577+0000", 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103199 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.202368360000001, 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034011599999999999, 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.070 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 232 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:44.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844190+0000", 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844202+0000", 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844234+0000", 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1822999999999997e-05 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844250+0000", 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6713000000000001e-05 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844385+0000", 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013458900000000001 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844620+0000", 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023536799999999999 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.845031+0000", 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041049700000000001 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.846532+0000", 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015012820000000001 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847430+0000", 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089785600000000004 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847520+0000", 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0303000000000006e-05 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847588+0000", 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7745999999999998e-05 2024-05-10T09:55:44.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:272 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.176931830000001, 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036051189999999999, 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.076 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 272 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869626+0000", 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869636+0000", 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0013000000000001e-05 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869663+0000", 2024-05-10T09:55:44.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7630000000000001e-05 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869682+0000", 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8403999999999999e-05 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869807+0000", 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012508199999999999 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870001+0000", 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019480499999999999 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870357+0000", 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035530099999999998 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871669+0000", 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001311776 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.872980+0000", 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013111760000000001 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873124+0000", 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000144086 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873229+0000", 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104666 2024-05-10T09:55:44.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:279 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.175781602000001, 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030980360000000002, 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.082 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 279 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870776+0000", 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1569999999999998e-06 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870789+0000", 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2756e-05 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870814+0000", 2024-05-10T09:55:44.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5726999999999999e-05 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870833+0000", 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870974+0000", 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014081200000000001 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871320+0000", 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034598000000000002 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871968+0000", 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064825199999999999 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873503+0000", 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534671 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873681+0000", 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178066 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873790+0000", 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109106 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873872+0000", 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1848999999999995e-05 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.087 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:314 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.169854758, 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051436470000000003, 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.088 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 314 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876703+0000", 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876716+0000", 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.29e-05 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876746+0000", 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0289000000000001e-05 2024-05-10T09:55:44.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876766+0000", 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9936999999999999e-05 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876915+0000", 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148632 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877123+0000", 2024-05-10T09:55:44.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000208622 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877524+0000", 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040038299999999998 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881305+0000", 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037810109999999999 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881676+0000", 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000370854 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881761+0000", 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4997e-05 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881844+0000", 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3474999999999996e-05 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.144062210999998, 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029358380000000001, 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 406 2024-05-10T09:55:44.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902496+0000", 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6690000000000002e-06 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902511+0000", 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5123000000000001e-05 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902543+0000", 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.26e-05 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902564+0000", 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0835999999999998e-05 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902712+0000", 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148131 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902984+0000", 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027137500000000002 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.903362+0000", 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037871299999999998 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.904567+0000", 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012045890000000001 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905281+0000", 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071434299999999999 2024-05-10T09:55:44.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905367+0000", 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5833000000000003e-05 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905429+0000", 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1625999999999996e-05 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:493 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.092158206999997, 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050291299999999997, 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 493 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.100 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954398+0000", 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3400000000000001e-06 2024-05-10T09:55:44.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954405+0000", 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8329999999999996e-06 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954424+0000", 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954435+0000", 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954516+0000", 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1138999999999997e-05 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954721+0000", 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020454800000000001 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955012+0000", 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000290888 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956172+0000", 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011604510000000001 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959287+0000", 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031147750000000002 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959352+0000", 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4622000000000006e-05 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959426+0000", 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4413999999999996e-05 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.105 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:494 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.092043775, 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044303820000000001, 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 494 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954513+0000", 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2500000000000001e-06 2024-05-10T09:55:44.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954521+0000", 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1729999999999995e-06 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954535+0000", 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4394e-05 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954545+0000", 2024-05-10T09:55:44.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-06 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954661+0000", 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011643500000000001 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954872+0000", 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000210805 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:44.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955341+0000", 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046933700000000001 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956602+0000", 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001260323 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958742+0000", 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021402560000000001 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958878+0000", 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013547099999999999 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958942+0000", 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4307999999999995e-05 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:503 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.111 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.086042081000002, 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003841995, 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 503 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960515+0000", 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2000000000000001e-06 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960528+0000", 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2476e-05 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960561+0000", 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3460000000000002e-05 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960581+0000", 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9763e-05 2024-05-10T09:55:44.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960707+0000", 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012605799999999999 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960841+0000", 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134122 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.961113+0000", 2024-05-10T09:55:44.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027215799999999999 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964004+0000", 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002890849 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964166+0000", 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016143 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964261+0000", 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5128000000000001e-05 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964355+0000", 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4351000000000005e-05 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:44.117 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.981723963, 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029080270000000001, 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 633 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064834+0000", 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9330000000000001e-06 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064849+0000", 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5003e-05 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064881+0000", 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2162999999999997e-05 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064897+0000", 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5444e-05 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065013+0000", 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116662 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065239+0000", 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022532800000000001 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065553+0000", 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031410800000000001 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.066681+0000", 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001128038 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067537+0000", 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00085565999999999995 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067632+0000", 2024-05-10T09:55:44.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5149000000000007e-05 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067739+0000", 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107539 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:44.123 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.750446828000001, 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031802750000000002, 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 775 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:44.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296111+0000", 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5440000000000001e-06 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296126+0000", 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5243e-05 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296158+0000", 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1359000000000002e-05 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296173+0000", 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296308+0000", 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135592 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296654+0000", 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034609799999999998 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.297217+0000", 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056229200000000004 2024-05-10T09:55:44.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.298808+0000", 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015914010000000001 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299121+0000", 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031244399999999999 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299209+0000", 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8159999999999996e-05 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299289+0000", 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9981999999999994e-05 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:44.129 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.671182023999997, 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003080607, 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 808 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:44.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375392+0000", 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8366999999999999e-05 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375406+0000", 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4506e-05 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375438+0000", 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1869999999999998e-05 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375453+0000", 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5204e-05 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375580+0000", 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012671500000000001 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375856+0000", 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027567200000000003 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.376172+0000", 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031694999999999998 2024-05-10T09:55:44.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.377362+0000", 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011898880000000001 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378247+0000", 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088473399999999998 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378337+0000", 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0094999999999997e-05 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378454+0000", 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116606 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.657103692, 2024-05-10T09:55:44.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032206259999999999, 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 814 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389454+0000", 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1629999999999999e-06 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389467+0000", 2024-05-10T09:55:44.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3414000000000001e-05 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389498+0000", 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0783e-05 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389513+0000", 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.485e-05 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389669+0000", 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015608899999999999 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390051+0000", 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038213400000000001 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390607+0000", 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055646199999999997 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392039+0000", 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014314519999999999 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392507+0000", 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046770999999999998 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392593+0000", 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6159e-05 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392672+0000", 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.941e-05 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.505120175000002, 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029667840000000001, 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.141 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 880 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541439+0000", 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541451+0000", 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2583e-05 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541484+0000", 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3176999999999998e-05 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541501+0000", 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6249999999999999e-05 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541623+0000", 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012215199999999999 2024-05-10T09:55:44.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541853+0000", 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023054799999999999 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.542204+0000", 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035071100000000002 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.543359+0000", 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011545609999999999 2024-05-10T09:55:44.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544248+0000", 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088955700000000002 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544335+0000", 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544402+0000", 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6408999999999994e-05 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.500928567000003, 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029184770000000001, 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.147 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 882 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:44.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545629+0000", 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1299999999999999e-06 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545640+0000", 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1663e-05 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545672+0000", 2024-05-10T09:55:44.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1922999999999999e-05 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545691+0000", 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8583000000000001e-05 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545821+0000", 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012955599999999999 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545967+0000", 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014623199999999999 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.546238+0000", 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027076800000000001 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.547400+0000", 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011622080000000001 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548341+0000", 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00094160900000000004 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548428+0000", 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6502999999999995e-05 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548545+0000", 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117302 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.152 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.497732558999999, 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002968301, 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.153 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 883 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548824+0000", 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7540000000000001e-06 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548835+0000", 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0243e-05 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548859+0000", 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4253e-05 2024-05-10T09:55:44.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548873+0000", 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4056999999999999e-05 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548984+0000", 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011150900000000001 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549223+0000", 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023871100000000001 2024-05-10T09:55:44.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549550+0000", 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000327301 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.550681+0000", 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011309849999999999 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551571+0000", 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088975600000000001 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551662+0000", 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0956000000000001e-05 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551791+0000", 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012877599999999999 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 52.397547381999999, 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003259788, 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 925 2024-05-10T09:55:44.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649010+0000", 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1239999999999999e-06 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649021+0000", 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0766e-05 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649051+0000", 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0533000000000001e-05 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649067+0000", 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5446000000000001e-05 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649189+0000", 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122576 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649413+0000", 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022339199999999999 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649726+0000", 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031377100000000002 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.650954+0000", 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012274300000000001 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.651996+0000", 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001041922 2024-05-10T09:55:44.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652156+0000", 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015990500000000001 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652268+0000", 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011192300000000001 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.164 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.165 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:44.166 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:44.166 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:44.159+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:44.267 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:44.264+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:44.341 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:44.341 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:44.341 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:44.341 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:44.356 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:44.367 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:44.363+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:44.468 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:44.463+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:44.492 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:55:44.519 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:44.519 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:44.520 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:44.520 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:44.533 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:44.582 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:44.580+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:44.657 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:44.657 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:44.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:44.657 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:44.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.657 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:44.657 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.934315406000003, 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003342228, 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 41 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720248+0000", 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.17e-06 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720259+0000", 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1362999999999999e-05 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720290+0000", 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1245999999999999e-05 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720326+0000", 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5769999999999998e-05 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720467+0000", 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014139299999999999 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720848+0000", 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038087700000000001 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.721316+0000", 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000468159 2024-05-10T09:55:44.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.722880+0000", 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001563839 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723331+0000", 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000450603 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723447+0000", 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115742 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723588+0000", 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014106599999999999 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:44.663 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.858895373999999, 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036007420000000001, 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 39 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795667+0000", 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.883e-06 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795677+0000", 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5359999999999998e-06 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795702+0000", 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4927e-05 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795716+0000", 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3828999999999999e-05 2024-05-10T09:55:44.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795878+0000", 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162373 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.796006+0000", 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012822199999999999 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.799266+0000", 2024-05-10T09:55:44.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032599719999999999 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.939689381999997, 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056055200000000001, 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.668 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714875+0000", 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.303e-06 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714893+0000", 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8668000000000002e-05 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714927+0000", 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3519999999999998e-05 2024-05-10T09:55:44.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714948+0000", 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0911e-05 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715113+0000", 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016473599999999999 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715512+0000", 2024-05-10T09:55:44.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039976900000000001 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715816+0000", 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000303417 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719016+0000", 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032006589999999998 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720317+0000", 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013003859999999999 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720396+0000", 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9043999999999997e-05 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720477+0000", 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1106999999999994e-05 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.673 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491083450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.933713187000002, 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050150489999999997, 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:44.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720849+0000", 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5740000000000001e-06 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720857+0000", 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2339999999999994e-06 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720878+0000", 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0939000000000001e-05 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720890+0000", 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1863e-05 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720993+0000", 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102446 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721163+0000", 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017038700000000001 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721496+0000", 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00033285399999999999 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.723818+0000", 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002322246 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725574+0000", 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001755288 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725705+0000", 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131345 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725863+0000", 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157873 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:44.679 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.930702242999999, 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033784850000000001, 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 205 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723863+0000", 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9369999999999997e-06 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723879+0000", 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.662e-05 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723917+0000", 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7462999999999997e-05 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723936+0000", 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9049999999999999e-05 2024-05-10T09:55:44.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724071+0000", 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013534500000000001 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724296+0000", 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000224766 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724714+0000", 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041791000000000002 2024-05-10T09:55:44.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.726248+0000", 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534168 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727037+0000", 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00078889400000000005 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727121+0000", 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4109000000000004e-05 2024-05-10T09:55:44.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727237+0000", 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116223 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.854723972000002, 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034944860000000002, 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.685 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 220 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799840+0000", 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.88e-06 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799852+0000", 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2597e-05 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799878+0000", 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.563e-05 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799892+0000", 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800078+0000", 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018622800000000001 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800286+0000", 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020734900000000001 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800679+0000", 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039302599999999999 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.802102+0000", 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014227090000000001 2024-05-10T09:55:44.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803181+0000", 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001079602 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803265+0000", 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4085999999999994e-05 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803331+0000", 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6175999999999998e-05 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.843999175, 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033216510000000001, 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.691 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 223 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810564+0000", 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0099999999999998e-06 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810576+0000", 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1919999999999999e-05 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810604+0000", 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8293000000000002e-05 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810618+0000", 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.453e-05 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810739+0000", 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120559 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810974+0000", 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023486500000000001 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.811410+0000", 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043620699999999998 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.812739+0000", 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013293929999999999 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813736+0000", 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00099665600000000006 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813819+0000", 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3024999999999999e-05 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813883+0000", 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4193e-05 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.696 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.836633665000001, 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034076969999999999, 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.697 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 225 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817929+0000", 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9800000000000001e-06 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817940+0000", 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1263e-05 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817966+0000", 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5517e-05 2024-05-10T09:55:44.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817981+0000", 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.508e-05 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818160+0000", 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017946800000000001 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818375+0000", 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021470500000000001 2024-05-10T09:55:44.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818799+0000", 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042364600000000002 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.820054+0000", 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012555439999999999 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821175+0000", 2024-05-10T09:55:44.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011206720000000001 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821267+0000", 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2164999999999996e-05 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821335+0000", 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7657000000000006e-05 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.702 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.832846771, 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031354019999999998, 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.703 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 226 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821716+0000", 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0329999999999998e-06 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821726+0000", 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821758+0000", 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1109000000000003e-05 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821795+0000", 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7262999999999999e-05 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821923+0000", 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127906 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822156+0000", 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233231 2024-05-10T09:55:44.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822572+0000", 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041563400000000001 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.823868+0000", 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00129623 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824698+0000", 2024-05-10T09:55:44.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083007700000000003 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824784+0000", 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5636000000000005e-05 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824849+0000", 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5986000000000001e-05 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.802968432, 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031471559999999999, 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 234 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851595+0000", 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:55:44.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851606+0000", 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1039999999999999e-05 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851637+0000", 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1572999999999997e-05 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851653+0000", 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851833+0000", 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017961100000000001 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852052+0000", 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000219905 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852491+0000", 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043847999999999999 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.853823+0000", 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013323670000000001 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854589+0000", 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076523699999999999 2024-05-10T09:55:44.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854679+0000", 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0660000000000003e-05 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854740+0000", 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0396000000000002e-05 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:431 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.740684062, 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031636749999999999, 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 431 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913878+0000", 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4699999999999999e-06 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913885+0000", 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7830000000000001e-06 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913899+0000", 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3550000000000001e-05 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913910+0000", 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1116e-05 2024-05-10T09:55:44.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914037+0000", 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012750899999999999 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914363+0000", 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032586799999999999 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914907+0000", 2024-05-10T09:55:44.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054394199999999995 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916597+0000", 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016898 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916905+0000", 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030769499999999997 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916982+0000", 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7809e-05 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.917040+0000", 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8133000000000001e-05 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:442 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:44.720 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.735597448999997, 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031368049999999999, 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 442 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:44.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918965+0000", 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.654e-06 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918973+0000", 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0730000000000005e-06 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918999+0000", 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5437000000000001e-05 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919011+0000", 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140000000000001e-05 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919129+0000", 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118539 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919440+0000", 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031087500000000001 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919767+0000", 2024-05-10T09:55:44.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032684599999999999 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921033+0000", 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001266348 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921785+0000", 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075156400000000003 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921937+0000", 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015235800000000001 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.922100+0000", 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016297100000000001 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:493 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:44.726 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.699369853999997, 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038321729999999999, 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955193+0000", 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.514e-06 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955205+0000", 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2395000000000001e-05 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955230+0000", 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4939e-05 2024-05-10T09:55:44.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955242+0000", 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1989e-05 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955399+0000", 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015761700000000001 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955455+0000", 2024-05-10T09:55:44.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5946999999999998e-05 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958922+0000", 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034661230000000002 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959023+0000", 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101649 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:531 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.675642402999998, 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033419700000000001, 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978920+0000", 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.646e-06 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978932+0000", 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1746000000000001e-05 2024-05-10T09:55:44.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978957+0000", 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5425000000000001e-05 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978970+0000", 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3186e-05 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979090+0000", 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119621 2024-05-10T09:55:44.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979128+0000", 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7765999999999997e-05 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982128+0000", 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030005269999999998 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982260+0000", 2024-05-10T09:55:44.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132053 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:532 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.673697705999999, 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040928650000000002, 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980865+0000", 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.531e-06 2024-05-10T09:55:44.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980875+0000", 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0749e-05 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980899+0000", 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4031000000000001e-05 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980911+0000", 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1897e-05 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981024+0000", 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112574 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981067+0000", 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3556000000000001e-05 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984876+0000", 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003808624 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984956+0000", 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9902999999999997e-05 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.429064013999998, 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035004300000000001, 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 745 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225500+0000", 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3100000000000001e-06 2024-05-10T09:55:44.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225513+0000", 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.278e-05 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225544+0000", 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0573e-05 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225559+0000", 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.522e-05 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225710+0000", 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015115899999999999 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226066+0000", 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035624300000000001 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226622+0000", 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055600300000000001 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.227855+0000", 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012332510000000001 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228722+0000", 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00086697599999999999 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228885+0000", 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162969 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228997+0000", 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111946 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:747 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.745 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.424342506999999, 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032519850000000002, 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 747 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230220+0000", 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6559999999999999e-06 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230228+0000", 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.824e-06 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230248+0000", 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230259+0000", 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1406999999999999e-05 2024-05-10T09:55:44.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230372+0000", 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112829 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230596+0000", 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022375499999999999 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.231055+0000", 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045978700000000002 2024-05-10T09:55:44.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.232387+0000", 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013311589999999999 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233206+0000", 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081972000000000002 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233359+0000", 2024-05-10T09:55:44.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152683 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233470+0000", 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111419 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.386371509999996, 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031982120000000002, 2024-05-10T09:55:44.751 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 763 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268191+0000", 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0360000000000001e-06 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268202+0000", 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.043e-05 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268234+0000", 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1847000000000002e-05 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268255+0000", 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1590000000000002e-05 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268443+0000", 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018751799999999999 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268670+0000", 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022725499999999999 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268993+0000", 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032307800000000003 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.270123+0000", 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011297709999999999 2024-05-10T09:55:44.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271173+0000", 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010499019999999999 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271257+0000", 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3901999999999997e-05 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271388+0000", 2024-05-10T09:55:44.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013088299999999999 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.240433236999998, 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034247800000000001, 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.757 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 825 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414129+0000", 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.657e-06 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414140+0000", 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414159+0000", 2024-05-10T09:55:44.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8805999999999999e-05 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414170+0000", 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1007e-05 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414280+0000", 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110115 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414524+0000", 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244405 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.415025+0000", 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00050059300000000002 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.416518+0000", 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014937889999999999 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417272+0000", 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075359400000000001 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417420+0000", 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148009 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417552+0000", 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013230499999999999 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.762 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 53.013285343, 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003571369, 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 922 2024-05-10T09:55:44.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:44.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641278+0000", 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.097e-06 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641289+0000", 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1163e-05 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641320+0000", 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1600000000000002e-05 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:44.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641342+0000", 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2089000000000001e-05 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641594+0000", 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025150200000000002 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642155+0000", 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056140900000000002 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642609+0000", 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045330000000000001 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.643594+0000", 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098517900000000009 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644692+0000", 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010985039999999999 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644782+0000", 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9837000000000001e-05 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644847+0000", 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4689000000000004e-05 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:44.768 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:44.770 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:44.770 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:44.768+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:44.871 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:44.867+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:44.941 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:44.941 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:44.941 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:44.941 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:44.955 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:45.002 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:45.000+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:45.073 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:45.073 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:45.073 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:45.073 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:45.073 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:45.073 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:45.068+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:45.087 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:45.174 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:45.172+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:45.255 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:45.255 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:45.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:45.255 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:45.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.546496435999998, 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:55:45.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:55:45.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:45.261 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.536347087999999, 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.566478471000003, 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:45.267 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:55:45.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:55:45.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.538421774, 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:55:45.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:45.278 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.524050664000001, 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:55:45.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.521364484999999, 2024-05-10T09:55:45.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.426457292000002, 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:45.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:55:45.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:55:45.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:55:45.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.506887077000002, 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:55:45.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.463156994000002, 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.298 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:55:45.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:55:45.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:45.302 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.448543847000003, 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.306 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.373814287000002, 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:55:45.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:55:45.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.355667924000002, 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.320913404000002, 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.315 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:55:45.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:45.319 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.319839192000003, 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.323 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.319347080999997, 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:45.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.317297490999998, 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.328 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:55:45.332 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.311052971999999, 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:45.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.307838547000003, 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.338 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.342 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.306665109000001, 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.346 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 54.255314732000002, 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:55:45.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:55:45.351 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.351 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.351 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.351 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.351 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.351 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:45.352 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:45.353 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:45.347+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:45.453 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:45.447+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:45.466 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:55:45.522 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:45.523 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:45.523 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:45.523 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:45.537 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:45.582 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:45.580+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:45.620 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:45.654 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:45.655 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:45.667 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:45.663+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:45.670 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:45.755 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:45.751+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:45.782 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:45.782 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:45.798 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:45.798 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:45.818 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:45.818 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.297348021999994, 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.837 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:55:45.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:55:45.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.843 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.484246481, 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:55:45.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:55:45.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:55:45.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.484117604999994, 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:55:45.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:55:45.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.855 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.483968265000001, 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:55:45.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:55:45.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:55:45.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:45.861 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.374897805000003, 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:55:45.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.374255345999998, 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.867 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:55:45.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:55:45.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.374135237000004, 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.873 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:45.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.878 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.373866276000001, 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.879 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:55:45.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.884 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.373803623000001, 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.885 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:55:45.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:55:45.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.890 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.373747316999996, 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.891 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:55:45.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:55:45.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.896 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.373554475000006, 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:55:45.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.373514305, 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:55:45.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:55:45.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.373429079000005, 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.908 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:55:45.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:55:45.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:55:45.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.373236824000003, 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.914 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:55:45.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:55:45.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.918 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.373200510999993, 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:55:45.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:55:45.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:45.925 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.120762948000007, 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:45.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:55:45.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.120647900999998, 2024-05-10T09:55:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:55:45.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.120607036999999, 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.937 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:55:45.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.120567972000003, 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.943 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:55:45.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:55:45.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:55:45.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 77.120441748999994, 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:45.949 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:55:45.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:45.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:55:45.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:55:45.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.955 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:45.955 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:45.955 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:45.956 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:45.956 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:45.957 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:45.957 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:45.958 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:45.958 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:45.958 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:45.959 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:45.959 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:45.959 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:45.960 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:45.960 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:45.951+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:46.057 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:46.051+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:46.130 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:46.130 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:46.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:46.158 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:46.156+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:46.259 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:46.255+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:46.309 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:46.309 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:46.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:46.361 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:46.356+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:46.461 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:46.455+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:46.476 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:46.476 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:46.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:46.562 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:46.560+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:46.662 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:46.662 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:46.663 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:46.655+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:46.676 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:46.763 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:46.759+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:46.849 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:46.849 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:46.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:46.864 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:46.864+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:46.965 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:46.959+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:47.026 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:47.027 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:47.040 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:47.066 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:47.064+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:47.167 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:47.167+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:47.206 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:47.206 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:47.219 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:47.267 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:47.263+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:47.339 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:47.339 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:47.352 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:47.399 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:47.395+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:47.469 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:47.463+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:47.490 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:55:47.519 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:47.520 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:47.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:47.575 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:47.571+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:47.670 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:47.667+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:47.693 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:47.693 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:47.706 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:47.791 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:47.787+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:47.863 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:47.863 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:47.872 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:47.867+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:47.878 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:47.961 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:47.974 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:47.971+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:48.054 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:48.054 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:48.068 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:48.074 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:48.067+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:48.110 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:48.110 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:48.129 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:48.129 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:48.146 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:48.146 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:48.163 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:48.163 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:48.175 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:48.171+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:48.183 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:48.183 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:48.203 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:48.203 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:48.203 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:48.203 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:48.204 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:48.204 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:48.217 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:48.224 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:48.224 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:48.244 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:48.244 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:48.303 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:48.299+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:48.378 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:48.375+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:48.384 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:48.384 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:48.384 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:48.385 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:48.385 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:48.399 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:48.486 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:48.483+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:48.497 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.898450613000001, 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086530440000000004, 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.572 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "reached pg", 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670663+0000", 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1870000000000001e-06 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670697+0000", 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4013000000000001e-05 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670734+0000", 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6449999999999998e-05 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670760+0000", 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6196000000000001e-05 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670897+0000", 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013763499999999999 2024-05-10T09:55:48.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670912+0000", 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.417e-05 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.678965+0000", 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080535780000000005 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.679313+0000", 2024-05-10T09:55:48.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034781500000000002 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.862136704999998, 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049225980000000003, 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706975+0000", 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.083e-06 2024-05-10T09:55:48.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706996+0000", 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1463000000000001e-05 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707016+0000", 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9639999999999998e-05 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707036+0000", 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9949000000000002e-05 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707643+0000", 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060738299999999997 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707688+0000", 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5201999999999999e-05 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711782+0000", 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040939649999999998 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711896+0000", 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011391300000000001 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:47 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'2, mlcod=0'0)", 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:48.581 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 60.853147835000001, 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039603599999999996, 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:48.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715965+0000", 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.04e-06 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715981+0000", 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716014+0000", 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3543000000000001e-05 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716035+0000", 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0849999999999999e-05 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716179+0000", 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014356199999999999 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716226+0000", 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7512000000000002e-05 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719825+0000", 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035986569999999999 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719923+0000", 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8060000000000006e-05 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.585 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.809892038999998, 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010358320000000001, 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.586 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 211 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759222+0000", 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759238+0000", 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5889999999999999e-05 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759276+0000", 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8226000000000003e-05 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759293+0000", 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7453999999999999e-05 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759495+0000", 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000201974 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2024-05-10T09:55:48.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759509+0000", 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.362e-05 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.765967+0000", 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006457717 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766268+0000", 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000301124 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766936+0000", 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00066803499999999998 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.768435+0000", 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014995150000000001 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769328+0000", 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089229700000000001 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769474+0000", 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014578200000000001 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769577+0000", 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103199 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.592 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.724923621000002, 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034011599999999999, 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 232 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844190+0000", 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:55:48.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844202+0000", 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844234+0000", 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1822999999999997e-05 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844250+0000", 2024-05-10T09:55:48.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6713000000000001e-05 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844385+0000", 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013458900000000001 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844620+0000", 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023536799999999999 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:48.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.845031+0000", 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041049700000000001 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.846532+0000", 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015012820000000001 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847430+0000", 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089785600000000004 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847520+0000", 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0303000000000006e-05 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847588+0000", 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7745999999999998e-05 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:272 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:48.598 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.699487091000002, 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036051189999999999, 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 272 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869626+0000", 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869636+0000", 2024-05-10T09:55:48.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0013000000000001e-05 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869663+0000", 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7630000000000001e-05 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869682+0000", 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8403999999999999e-05 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869807+0000", 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012508199999999999 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870001+0000", 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019480499999999999 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870357+0000", 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035530099999999998 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871669+0000", 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001311776 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.872980+0000", 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013111760000000001 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873124+0000", 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000144086 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873229+0000", 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104666 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:279 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.698336863000002, 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030980360000000002, 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.604 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 279 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870776+0000", 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1569999999999998e-06 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870789+0000", 2024-05-10T09:55:48.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2756e-05 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870814+0000", 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5726999999999999e-05 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870833+0000", 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870974+0000", 2024-05-10T09:55:48.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014081200000000001 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871320+0000", 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034598000000000002 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871968+0000", 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064825199999999999 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873503+0000", 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534671 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873681+0000", 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178066 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873790+0000", 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109106 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873872+0000", 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1848999999999995e-05 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:314 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.692410019, 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051436470000000003, 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.610 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 314 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:48.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876703+0000", 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876716+0000", 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.29e-05 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876746+0000", 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0289000000000001e-05 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876766+0000", 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9936999999999999e-05 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876915+0000", 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148632 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877123+0000", 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000208622 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877524+0000", 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040038299999999998 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881305+0000", 2024-05-10T09:55:48.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037810109999999999 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881676+0000", 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000370854 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881761+0000", 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4997e-05 2024-05-10T09:55:48.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881844+0000", 2024-05-10T09:55:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3474999999999996e-05 2024-05-10T09:55:48.617 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.666617471999999, 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029358380000000001, 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.618 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 406 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902496+0000", 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6690000000000002e-06 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902511+0000", 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5123000000000001e-05 2024-05-10T09:55:48.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902543+0000", 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.26e-05 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902564+0000", 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0835999999999998e-05 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902712+0000", 2024-05-10T09:55:48.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148131 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902984+0000", 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027137500000000002 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.903362+0000", 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037871299999999998 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.904567+0000", 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012045890000000001 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905281+0000", 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071434299999999999 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905367+0000", 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5833000000000003e-05 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905429+0000", 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1625999999999996e-05 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:493 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.614713467999998, 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050291299999999997, 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.624 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 493 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:48.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954398+0000", 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3400000000000001e-06 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954405+0000", 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8329999999999996e-06 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954424+0000", 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954435+0000", 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954516+0000", 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1138999999999997e-05 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954721+0000", 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020454800000000001 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955012+0000", 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000290888 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956172+0000", 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011604510000000001 2024-05-10T09:55:48.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959287+0000", 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031147750000000002 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959352+0000", 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4622000000000006e-05 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959426+0000", 2024-05-10T09:55:48.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4413999999999996e-05 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:494 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.614599036000001, 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044303820000000001, 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.630 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 494 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954513+0000", 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2500000000000001e-06 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954521+0000", 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1729999999999995e-06 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954535+0000", 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4394e-05 2024-05-10T09:55:48.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954545+0000", 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-06 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954661+0000", 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011643500000000001 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954872+0000", 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000210805 2024-05-10T09:55:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955341+0000", 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046933700000000001 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956602+0000", 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001260323 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958742+0000", 2024-05-10T09:55:48.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021402560000000001 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958878+0000", 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013547099999999999 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958942+0000", 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4307999999999995e-05 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:503 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.608597342000003, 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003841995, 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 503 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960515+0000", 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2000000000000001e-06 2024-05-10T09:55:48.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960528+0000", 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2476e-05 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960561+0000", 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3460000000000002e-05 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960581+0000", 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9763e-05 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960707+0000", 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012605799999999999 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960841+0000", 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134122 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.961113+0000", 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027215799999999999 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964004+0000", 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002890849 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964166+0000", 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016143 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964261+0000", 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5128000000000001e-05 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964355+0000", 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4351000000000005e-05 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.641 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.504279224000001, 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029080270000000001, 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 633 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064834+0000", 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9330000000000001e-06 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064849+0000", 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5003e-05 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064881+0000", 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2162999999999997e-05 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064897+0000", 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5444e-05 2024-05-10T09:55:48.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065013+0000", 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116662 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065239+0000", 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022532800000000001 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065553+0000", 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031410800000000001 2024-05-10T09:55:48.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.066681+0000", 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001128038 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067537+0000", 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00085565999999999995 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067632+0000", 2024-05-10T09:55:48.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5149000000000007e-05 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067739+0000", 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107539 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.273002089000002, 2024-05-10T09:55:48.647 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031802750000000002, 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 775 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.648 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296111+0000", 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5440000000000001e-06 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296126+0000", 2024-05-10T09:55:48.649 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5243e-05 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296158+0000", 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1359000000000002e-05 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296173+0000", 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296308+0000", 2024-05-10T09:55:48.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135592 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296654+0000", 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034609799999999998 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.297217+0000", 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056229200000000004 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.298808+0000", 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015914010000000001 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299121+0000", 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031244399999999999 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299209+0000", 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8159999999999996e-05 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299289+0000", 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9981999999999994e-05 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.193737284999997, 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003080607, 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.653 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 808 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:48.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375392+0000", 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8366999999999999e-05 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375406+0000", 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4506e-05 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375438+0000", 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1869999999999998e-05 2024-05-10T09:55:48.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375453+0000", 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5204e-05 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375580+0000", 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012671500000000001 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375856+0000", 2024-05-10T09:55:48.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027567200000000003 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.376172+0000", 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031694999999999998 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.377362+0000", 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011898880000000001 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378247+0000", 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088473399999999998 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378337+0000", 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0094999999999997e-05 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378454+0000", 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116606 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.658 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.179658953000001, 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032206259999999999, 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 814 2024-05-10T09:55:48.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389454+0000", 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1629999999999999e-06 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389467+0000", 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3414000000000001e-05 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389498+0000", 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0783e-05 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389513+0000", 2024-05-10T09:55:48.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.485e-05 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389669+0000", 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015608899999999999 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390051+0000", 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038213400000000001 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:48.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390607+0000", 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055646199999999997 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392039+0000", 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014314519999999999 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392507+0000", 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046770999999999998 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392593+0000", 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6159e-05 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392672+0000", 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.941e-05 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.027675436000003, 2024-05-10T09:55:48.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029667840000000001, 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 880 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541439+0000", 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541451+0000", 2024-05-10T09:55:48.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2583e-05 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541484+0000", 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3176999999999998e-05 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541501+0000", 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6249999999999999e-05 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541623+0000", 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012215199999999999 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541853+0000", 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023054799999999999 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.542204+0000", 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035071100000000002 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.543359+0000", 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011545609999999999 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544248+0000", 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088955700000000002 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544335+0000", 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544402+0000", 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6408999999999994e-05 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.023483828000003, 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029184770000000001, 2024-05-10T09:55:48.670 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 882 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545629+0000", 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1299999999999999e-06 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545640+0000", 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1663e-05 2024-05-10T09:55:48.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545672+0000", 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1922999999999999e-05 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545691+0000", 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8583000000000001e-05 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545821+0000", 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012955599999999999 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545967+0000", 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014623199999999999 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.546238+0000", 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027076800000000001 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.547400+0000", 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011622080000000001 2024-05-10T09:55:48.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548341+0000", 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00094160900000000004 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548428+0000", 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6502999999999995e-05 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548545+0000", 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117302 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.675 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.02028782, 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002968301, 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.676 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 883 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548824+0000", 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7540000000000001e-06 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548835+0000", 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0243e-05 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548859+0000", 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4253e-05 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548873+0000", 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4056999999999999e-05 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548984+0000", 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011150900000000001 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549223+0000", 2024-05-10T09:55:48.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023871100000000001 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549550+0000", 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000327301 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.550681+0000", 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011309849999999999 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551571+0000", 2024-05-10T09:55:48.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088975600000000001 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551662+0000", 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0956000000000001e-05 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551791+0000", 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012877599999999999 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 56.920102643, 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003259788, 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 925 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:48.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649010+0000", 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1239999999999999e-06 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649021+0000", 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0766e-05 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649051+0000", 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0533000000000001e-05 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649067+0000", 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5446000000000001e-05 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649189+0000", 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122576 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649413+0000", 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022339199999999999 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649726+0000", 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031377100000000002 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.650954+0000", 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012274300000000001 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.651996+0000", 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001041922 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652156+0000", 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015990500000000001 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:48.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652268+0000", 2024-05-10T09:55:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011192300000000001 2024-05-10T09:55:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:48.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:48.687 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:48.688 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:48.689 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:48.683+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:48.789 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:48.787+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:48.852 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:48.852 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:48.852 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:48.852 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:48.866 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:48.910 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:48.907+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:48.992 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:48.987+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:49.033 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:49.033 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:49.033 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:49.033 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:49.033 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:49.047 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:49.094 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:49.091+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:49.169 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:49.169 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:49.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:49.169 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:49.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.169 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:49.169 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:49.169 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.446172666999999, 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003342228, 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 41 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720248+0000", 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.17e-06 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720259+0000", 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1362999999999999e-05 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720290+0000", 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1245999999999999e-05 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720326+0000", 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5769999999999998e-05 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720467+0000", 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014139299999999999 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720848+0000", 2024-05-10T09:55:49.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038087700000000001 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.721316+0000", 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000468159 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.722880+0000", 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001563839 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723331+0000", 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000450603 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723447+0000", 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115742 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723588+0000", 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014106599999999999 2024-05-10T09:55:49.175 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.370752635000002, 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036007420000000001, 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.176 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 39 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795667+0000", 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.883e-06 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795677+0000", 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5359999999999998e-06 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795702+0000", 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4927e-05 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795716+0000", 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3828999999999999e-05 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795878+0000", 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162373 2024-05-10T09:55:49.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.796006+0000", 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012822199999999999 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.799266+0000", 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032599719999999999 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.451546643, 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056055200000000001, 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:49.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714875+0000", 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.303e-06 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714893+0000", 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8668000000000002e-05 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714927+0000", 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3519999999999998e-05 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714948+0000", 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0911e-05 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715113+0000", 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016473599999999999 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715512+0000", 2024-05-10T09:55:49.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039976900000000001 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715816+0000", 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000303417 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719016+0000", 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032006589999999998 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720317+0000", 2024-05-10T09:55:49.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013003859999999999 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720396+0000", 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9043999999999997e-05 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720477+0000", 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1106999999999994e-05 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491083450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.445570447999998, 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050150489999999997, 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.187 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720849+0000", 2024-05-10T09:55:49.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5740000000000001e-06 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720857+0000", 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2339999999999994e-06 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720878+0000", 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0939000000000001e-05 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720890+0000", 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1863e-05 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720993+0000", 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102446 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721163+0000", 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017038700000000001 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721496+0000", 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00033285399999999999 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.723818+0000", 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002322246 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725574+0000", 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001755288 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725705+0000", 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131345 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725863+0000", 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157873 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:49.192 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.442559504000002, 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033784850000000001, 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 205 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723863+0000", 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9369999999999997e-06 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723879+0000", 2024-05-10T09:55:49.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.662e-05 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723917+0000", 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7462999999999997e-05 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723936+0000", 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9049999999999999e-05 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724071+0000", 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013534500000000001 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724296+0000", 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000224766 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724714+0000", 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041791000000000002 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.726248+0000", 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534168 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727037+0000", 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00078889400000000005 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727121+0000", 2024-05-10T09:55:49.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4109000000000004e-05 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727237+0000", 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116223 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.366581232999998, 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034944860000000002, 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 220 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.199 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799840+0000", 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.88e-06 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799852+0000", 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2597e-05 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799878+0000", 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.563e-05 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799892+0000", 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800078+0000", 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018622800000000001 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800286+0000", 2024-05-10T09:55:49.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020734900000000001 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800679+0000", 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039302599999999999 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.802102+0000", 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014227090000000001 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803181+0000", 2024-05-10T09:55:49.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001079602 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803265+0000", 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4085999999999994e-05 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803331+0000", 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6175999999999998e-05 2024-05-10T09:55:49.204 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.355856436000003, 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033216510000000001, 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.205 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 223 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810564+0000", 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0099999999999998e-06 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810576+0000", 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1919999999999999e-05 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810604+0000", 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8293000000000002e-05 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810618+0000", 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.453e-05 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810739+0000", 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120559 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810974+0000", 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023486500000000001 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.811410+0000", 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043620699999999998 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.812739+0000", 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013293929999999999 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813736+0000", 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00099665600000000006 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813819+0000", 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3024999999999999e-05 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813883+0000", 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4193e-05 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.348490925999997, 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034076969999999999, 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 225 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.211 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817929+0000", 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9800000000000001e-06 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817940+0000", 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1263e-05 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817966+0000", 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5517e-05 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817981+0000", 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.508e-05 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818160+0000", 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017946800000000001 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818375+0000", 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021470500000000001 2024-05-10T09:55:49.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818799+0000", 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042364600000000002 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.820054+0000", 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012555439999999999 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821175+0000", 2024-05-10T09:55:49.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011206720000000001 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821267+0000", 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2164999999999996e-05 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821335+0000", 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7657000000000006e-05 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.216 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.344704032000003, 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031354019999999998, 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 226 2024-05-10T09:55:49.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821716+0000", 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0329999999999998e-06 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821726+0000", 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821758+0000", 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1109000000000003e-05 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821795+0000", 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7262999999999999e-05 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821923+0000", 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127906 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822156+0000", 2024-05-10T09:55:49.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233231 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822572+0000", 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041563400000000001 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.823868+0000", 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00129623 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824698+0000", 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083007700000000003 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824784+0000", 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5636000000000005e-05 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824849+0000", 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5986000000000001e-05 2024-05-10T09:55:49.222 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.314825693000003, 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031471559999999999, 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.223 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 234 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851595+0000", 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851606+0000", 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1039999999999999e-05 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851637+0000", 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1572999999999997e-05 2024-05-10T09:55:49.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851653+0000", 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851833+0000", 2024-05-10T09:55:49.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017961100000000001 2024-05-10T09:55:49.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852052+0000", 2024-05-10T09:55:49.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000219905 2024-05-10T09:55:49.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:49.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852491+0000", 2024-05-10T09:55:49.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043847999999999999 2024-05-10T09:55:49.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.853823+0000", 2024-05-10T09:55:49.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013323670000000001 2024-05-10T09:55:49.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854589+0000", 2024-05-10T09:55:49.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076523699999999999 2024-05-10T09:55:49.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854679+0000", 2024-05-10T09:55:49.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0660000000000003e-05 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854740+0000", 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0396000000000002e-05 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:431 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.232 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.252541323000003, 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031636749999999999, 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 431 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913878+0000", 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4699999999999999e-06 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913885+0000", 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7830000000000001e-06 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913899+0000", 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3550000000000001e-05 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913910+0000", 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1116e-05 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914037+0000", 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012750899999999999 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914363+0000", 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032586799999999999 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914907+0000", 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054394199999999995 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916597+0000", 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016898 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916905+0000", 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030769499999999997 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916982+0000", 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7809e-05 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.917040+0000", 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8133000000000001e-05 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:442 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.24745471, 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031368049999999999, 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 442 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918965+0000", 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.654e-06 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918973+0000", 2024-05-10T09:55:49.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0730000000000005e-06 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918999+0000", 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5437000000000001e-05 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919011+0000", 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140000000000001e-05 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919129+0000", 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118539 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919440+0000", 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031087500000000001 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919767+0000", 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032684599999999999 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921033+0000", 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001266348 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921785+0000", 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075156400000000003 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921937+0000", 2024-05-10T09:55:49.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015235800000000001 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.922100+0000", 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016297100000000001 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:493 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:49.245 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.211227115, 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038321729999999999, 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:49.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955193+0000", 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.514e-06 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955205+0000", 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2395000000000001e-05 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955230+0000", 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4939e-05 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955242+0000", 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1989e-05 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955399+0000", 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015761700000000001 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955455+0000", 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5946999999999998e-05 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958922+0000", 2024-05-10T09:55:49.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034661230000000002 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959023+0000", 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101649 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:531 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:49.250 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.187499664000001, 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033419700000000001, 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978920+0000", 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.646e-06 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978932+0000", 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1746000000000001e-05 2024-05-10T09:55:49.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978957+0000", 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5425000000000001e-05 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978970+0000", 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3186e-05 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979090+0000", 2024-05-10T09:55:49.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119621 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979128+0000", 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7765999999999997e-05 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982128+0000", 2024-05-10T09:55:49.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030005269999999998 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982260+0000", 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132053 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:532 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:49.255 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.185554967000002, 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040928650000000002, 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980865+0000", 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.531e-06 2024-05-10T09:55:49.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980875+0000", 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0749e-05 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980899+0000", 2024-05-10T09:55:49.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4031000000000001e-05 2024-05-10T09:55:49.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980911+0000", 2024-05-10T09:55:49.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1897e-05 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981024+0000", 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112574 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981067+0000", 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3556000000000001e-05 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984876+0000", 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003808624 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984956+0000", 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9902999999999997e-05 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.940921275000001, 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035004300000000001, 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 745 2024-05-10T09:55:49.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225500+0000", 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3100000000000001e-06 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225513+0000", 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.278e-05 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225544+0000", 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0573e-05 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225559+0000", 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.522e-05 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225710+0000", 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015115899999999999 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226066+0000", 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035624300000000001 2024-05-10T09:55:49.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226622+0000", 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055600300000000001 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.227855+0000", 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012332510000000001 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228722+0000", 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00086697599999999999 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228885+0000", 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162969 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228997+0000", 2024-05-10T09:55:49.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111946 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:747 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.936199768000002, 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032519850000000002, 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.268 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 747 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:49.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230220+0000", 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6559999999999999e-06 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230228+0000", 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.824e-06 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230248+0000", 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230259+0000", 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1406999999999999e-05 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230372+0000", 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112829 2024-05-10T09:55:49.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230596+0000", 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022375499999999999 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.231055+0000", 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045978700000000002 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.232387+0000", 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013311589999999999 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233206+0000", 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081972000000000002 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233359+0000", 2024-05-10T09:55:49.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152683 2024-05-10T09:55:49.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233470+0000", 2024-05-10T09:55:49.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111419 2024-05-10T09:55:49.275 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.275 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.275 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.275 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.276 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:49.276 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.898228770999999, 2024-05-10T09:55:49.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031982120000000002, 2024-05-10T09:55:49.276 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.276 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.276 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.276 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 763 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268191+0000", 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0360000000000001e-06 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268202+0000", 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.043e-05 2024-05-10T09:55:49.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268234+0000", 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1847000000000002e-05 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268255+0000", 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1590000000000002e-05 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268443+0000", 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018751799999999999 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268670+0000", 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022725499999999999 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268993+0000", 2024-05-10T09:55:49.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032307800000000003 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.270123+0000", 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011297709999999999 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271173+0000", 2024-05-10T09:55:49.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010499019999999999 2024-05-10T09:55:49.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271257+0000", 2024-05-10T09:55:49.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3901999999999997e-05 2024-05-10T09:55:49.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271388+0000", 2024-05-10T09:55:49.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013088299999999999 2024-05-10T09:55:49.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.752290498000001, 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034247800000000001, 2024-05-10T09:55:49.284 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 825 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:49.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414129+0000", 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.657e-06 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414140+0000", 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414159+0000", 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8805999999999999e-05 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414170+0000", 2024-05-10T09:55:49.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1007e-05 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414280+0000", 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110115 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414524+0000", 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244405 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:49.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.415025+0000", 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00050059300000000002 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.416518+0000", 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014937889999999999 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417272+0000", 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075359400000000001 2024-05-10T09:55:49.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417420+0000", 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148009 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417552+0000", 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013230499999999999 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 57.525142604000003, 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003571369, 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 922 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641278+0000", 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.097e-06 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641289+0000", 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1163e-05 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641320+0000", 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1600000000000002e-05 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641342+0000", 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2089000000000001e-05 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641594+0000", 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025150200000000002 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642155+0000", 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056140900000000002 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642609+0000", 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045330000000000001 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.643594+0000", 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098517900000000009 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644692+0000", 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010985039999999999 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644782+0000", 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9837000000000001e-05 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644847+0000", 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4689000000000004e-05 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.296 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.297 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.297 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:49.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:49.299 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:49.295+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:49.399 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:49.399+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:49.474 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:49.474 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:49.474 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:49.475 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:49.488 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:49.534 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:49.531+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:49.600 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:49.595+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:49.610 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:49.610 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:49.610 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:49.610 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:49.610 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:49.624 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:49.714 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:49.711+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.086002776000001, 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:55:49.793 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:55:49.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:55:49.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.075853428000002, 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:55:49.799 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:55:49.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.105984810999999, 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.805 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:49.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:55:49.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:49.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.077928114000002, 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.812 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:55:49.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:55:49.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.063557004000003, 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.818 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:55:49.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:55:49.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.060870825000002, 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:49.824 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:55:49.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.829 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.965963631999998, 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:55:49.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.046393416999997, 2024-05-10T09:55:49.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:49.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:55:49.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.838 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 59.002663333999998, 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.988050186999999, 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.843 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.847 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.913320626999997, 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:55:49.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:55:49.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.895174263999998, 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:55:49.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:49.856 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.860419743999998, 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:55:49.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.859345531999999, 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.861 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.865 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.858853420999999, 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:55:49.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:55:49.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:55:49.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.856803831000001, 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.870 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:55:49.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:55:49.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.850559312000001, 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:55:49.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.847344886999998, 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:55:49.879 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:55:49.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.846171449000003, 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:49.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:55:49.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 58.794821071999998, 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:49.888 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:55:49.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:55:49.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:49.892 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:49.894 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:49.894 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:49.891+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:49.995 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:49.991+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:50.064 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:50.064 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:50.064 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:50.064 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:50.078 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:50.095 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:50.091+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:50.196 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:50.191+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:50.246 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:50.246 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:50.246 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:50.246 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:50.246 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:50.260 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:50.261 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:50.302 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:50.299+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:50.398 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:50.395+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:50.410 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:50.410 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:50.423 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:50.423 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:50.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:50.423 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:50.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.884199511999995, 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:55:50.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:55:50.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.071097971, 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:55:50.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:55:50.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.436 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.070969094999995, 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.437 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:55:50.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:55:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 82.070819755000002, 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:55:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:55:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:55:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.961749295000004, 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:55:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:55:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:55:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.961106835999999, 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:55:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960986727000005, 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:55:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960717766000002, 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:55:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960655113000001, 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:55:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:55:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960598806999997, 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:55:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960405965000007, 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:55:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:55:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960365795000001, 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:55:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:55:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960280569000005, 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:55:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:55:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960088314000004, 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:55:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.960052000999994, 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.707614437999993, 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:55:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.707499390999999, 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:55:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.707458527, 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:55:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:55:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.707419462000004, 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:55:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:55:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.707293238999995, 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:55:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:50.547 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:50.548 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:55:50.549 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:50.550 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:50.550 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:50.543+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:50.551 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:50.551 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:50.551 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:50.552 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:50.552 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:50.552 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:50.553 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:50.553 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:50.553 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:50.553 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:50.650 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:50.647+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:50.667 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:50.668 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:50.684 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:50.751 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:50.747+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:50.839 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:50.839 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:50.852 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:50.852 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:50.851+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:50.953 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:50.947+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:50.970 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:50.970 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:50.984 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:51.054 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:51.051+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:51.103 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:51.103 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:51.117 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:51.155 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:51.155+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:51.248 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:51.248 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:51.255 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:51.255+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:51.264 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:51.356 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:51.351+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:51.434 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:51.434 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:51.449 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:51.495 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:51.495+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:51.503 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:55:51.571 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:51.571+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:51.590 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:51.590 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:51.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:51.657 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:51.651+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:51.758 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:51.755+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:51.769 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:51.769 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:51.783 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:51.859 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:51.859+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:51.899 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:51.900 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:51.912 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:51.999 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:51.999+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:52.061 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:52.059+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:52.068 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:52.069 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:52.082 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:52.163 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:52.159+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:52.243 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:52.243 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:52.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:52.303 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:52.303+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:52.364 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:52.363+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:52.376 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:52.377 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:52.390 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:52.465 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:52.463+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:52.525 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:52.525 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:52.540 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:52.562 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:52.607 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:52.607+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:52.665 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:52.665 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:52.667 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:52.663+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:52.679 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:52.719 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:52.720 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:52.736 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:52.736 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:52.754 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:52.754 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:52.770 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:52.767+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:52.770 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:52.770 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:52.789 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:52.789 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:52.807 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:52.807 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:52.827 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:52.827 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:52.848 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:52.848 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:52.852 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:52.852 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:52.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:52.852 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.180889585000003, 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086530440000000004, 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "reached pg", 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670660+0000", 2024-05-10T09:55:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670663+0000", 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1870000000000001e-06 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670697+0000", 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4013000000000001e-05 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670734+0000", 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6449999999999998e-05 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670760+0000", 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6196000000000001e-05 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670897+0000", 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013763499999999999 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.670912+0000", 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.417e-05 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.678965+0000", 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0080535780000000005 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:45.679313+0000", 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034781500000000002 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.857 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.858 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:52.858 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:52.858 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.144575677000006, 2024-05-10T09:55:52.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049225980000000003, 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706974+0000", 2024-05-10T09:55:52.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706975+0000", 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.083e-06 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.706996+0000", 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1463000000000001e-05 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707016+0000", 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9639999999999998e-05 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707036+0000", 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9949000000000002e-05 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707643+0000", 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00060738299999999997 2024-05-10T09:55:52.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.707688+0000", 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5201999999999999e-05 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711782+0000", 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040939649999999998 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.711896+0000", 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011391300000000001 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:47 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'2, mlcod=0'0)", 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.135586806999996, 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039603599999999996, 2024-05-10T09:55:52.863 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715963+0000", 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715965+0000", 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.04e-06 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715981+0000", 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716014+0000", 2024-05-10T09:55:52.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3543000000000001e-05 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716035+0000", 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0849999999999999e-05 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716179+0000", 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014356199999999999 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.716226+0000", 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7512000000000002e-05 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719825+0000", 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035986569999999999 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719923+0000", 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8060000000000006e-05 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.867 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.092331010999999, 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010358320000000001, 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.868 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 211 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759218+0000", 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759222+0000", 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759238+0000", 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5889999999999999e-05 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759276+0000", 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8226000000000003e-05 2024-05-10T09:55:52.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759293+0000", 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7453999999999999e-05 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759495+0000", 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000201974 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op must wait for map", 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.759509+0000", 2024-05-10T09:55:52.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.362e-05 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.765967+0000", 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006457717 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766268+0000", 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000301124 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:52.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.766936+0000", 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00066803499999999998 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.768435+0000", 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014995150000000001 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769328+0000", 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089229700000000001 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769474+0000", 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014578200000000001 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.769577+0000", 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103199 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.874 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.007362593000003, 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034011599999999999, 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 232 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844187+0000", 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844190+0000", 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:55:52.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844202+0000", 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844234+0000", 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1822999999999997e-05 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844250+0000", 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6713000000000001e-05 2024-05-10T09:55:52.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844385+0000", 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013458900000000001 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.844620+0000", 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023536799999999999 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:52.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.845031+0000", 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041049700000000001 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.846532+0000", 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015012820000000001 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847430+0000", 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089785600000000004 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847520+0000", 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0303000000000006e-05 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.847588+0000", 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7745999999999998e-05 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.880 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:272 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.981926063000003, 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036051189999999999, 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 272 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869623+0000", 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869626+0000", 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:55:52.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869636+0000", 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0013000000000001e-05 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869663+0000", 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7630000000000001e-05 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869682+0000", 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8403999999999999e-05 2024-05-10T09:55:52.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.869807+0000", 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012508199999999999 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870001+0000", 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019480499999999999 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870357+0000", 2024-05-10T09:55:52.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035530099999999998 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871669+0000", 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001311776 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.872980+0000", 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013111760000000001 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873124+0000", 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000144086 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873229+0000", 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104666 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:279 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.886 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.980775835000003, 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030980360000000002, 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 279 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870774+0000", 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870776+0000", 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1569999999999998e-06 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870789+0000", 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2756e-05 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870814+0000", 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5726999999999999e-05 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870833+0000", 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.870974+0000", 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014081200000000001 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871320+0000", 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034598000000000002 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.871968+0000", 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00064825199999999999 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873503+0000", 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534671 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873681+0000", 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178066 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873790+0000", 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109106 2024-05-10T09:55:52.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.873872+0000", 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1848999999999995e-05 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:314 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:52.892 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.974848991000002, 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051436470000000003, 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 314 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:52.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876700+0000", 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876703+0000", 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876716+0000", 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.29e-05 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876746+0000", 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0289000000000001e-05 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876766+0000", 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9936999999999999e-05 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.876915+0000", 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148632 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877123+0000", 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000208622 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.877524+0000", 2024-05-10T09:55:52.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040038299999999998 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881305+0000", 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037810109999999999 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881676+0000", 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000370854 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881761+0000", 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4997e-05 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881844+0000", 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3474999999999996e-05 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:406 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.949056444, 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029358380000000001, 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 406 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.899 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902493+0000", 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902496+0000", 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6690000000000002e-06 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902511+0000", 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5123000000000001e-05 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902543+0000", 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.26e-05 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902564+0000", 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0835999999999998e-05 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902712+0000", 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148131 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.902984+0000", 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027137500000000002 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.903362+0000", 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037871299999999998 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.904567+0000", 2024-05-10T09:55:52.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012045890000000001 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905281+0000", 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071434299999999999 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905367+0000", 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5833000000000003e-05 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.905429+0000", 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1625999999999996e-05 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:493 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.897152439999999, 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050291299999999997, 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.905 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 493 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954397+0000", 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954398+0000", 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3400000000000001e-06 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954405+0000", 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8329999999999996e-06 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954424+0000", 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954435+0000", 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0876999999999999e-05 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954516+0000", 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1138999999999997e-05 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954721+0000", 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020454800000000001 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955012+0000", 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000290888 2024-05-10T09:55:52.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956172+0000", 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011604510000000001 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959287+0000", 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031147750000000002 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959352+0000", 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4622000000000006e-05 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959426+0000", 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4413999999999996e-05 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:494 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.897038008000003, 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044303820000000001, 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 494 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.912 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954511+0000", 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954513+0000", 2024-05-10T09:55:52.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2500000000000001e-06 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954521+0000", 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1729999999999995e-06 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954535+0000", 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4394e-05 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954545+0000", 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-06 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954661+0000", 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011643500000000001 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.954872+0000", 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000210805 2024-05-10T09:55:52.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955341+0000", 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046933700000000001 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.956602+0000", 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001260323 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958742+0000", 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021402560000000001 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958878+0000", 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013547099999999999 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958942+0000", 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4307999999999995e-05 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:503 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.891036313999997, 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003841995, 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.918 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 503 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960513+0000", 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960515+0000", 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2000000000000001e-06 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960528+0000", 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2476e-05 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960561+0000", 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3460000000000002e-05 2024-05-10T09:55:52.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960581+0000", 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9763e-05 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960707+0000", 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012605799999999999 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.960841+0000", 2024-05-10T09:55:52.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134122 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.961113+0000", 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027215799999999999 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964004+0000", 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002890849 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964166+0000", 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016143 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964261+0000", 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5128000000000001e-05 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.964355+0000", 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4351000000000005e-05 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.923 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.786718196000002, 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029080270000000001, 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.924 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 633 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064831+0000", 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064834+0000", 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9330000000000001e-06 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064849+0000", 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5003e-05 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064881+0000", 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2162999999999997e-05 2024-05-10T09:55:52.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.064897+0000", 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5444e-05 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065013+0000", 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116662 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065239+0000", 2024-05-10T09:55:52.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022532800000000001 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.065553+0000", 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031410800000000001 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.066681+0000", 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001128038 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067537+0000", 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00085565999999999995 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067632+0000", 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5149000000000007e-05 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.067739+0000", 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107539 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.555441061000003, 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031802750000000002, 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 775 2024-05-10T09:55:52.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296108+0000", 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296111+0000", 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5440000000000001e-06 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296126+0000", 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5243e-05 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296158+0000", 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1359000000000002e-05 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296173+0000", 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296308+0000", 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135592 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.296654+0000", 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034609799999999998 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.297217+0000", 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056229200000000004 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.298808+0000", 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0015914010000000001 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299121+0000", 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031244399999999999 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299209+0000", 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8159999999999996e-05 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.299289+0000", 2024-05-10T09:55:52.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9981999999999994e-05 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.476176256999999, 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003080607, 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.936 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 808 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375373+0000", 2024-05-10T09:55:52.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375392+0000", 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8366999999999999e-05 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375406+0000", 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4506e-05 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375438+0000", 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1869999999999998e-05 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375453+0000", 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5204e-05 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375580+0000", 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012671500000000001 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.375856+0000", 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027567200000000003 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.376172+0000", 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031694999999999998 2024-05-10T09:55:52.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.377362+0000", 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011898880000000001 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378247+0000", 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088473399999999998 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378337+0000", 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0094999999999997e-05 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.378454+0000", 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116606 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.942 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.462097925000002, 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032206259999999999, 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 814 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389452+0000", 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389454+0000", 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1629999999999999e-06 2024-05-10T09:55:52.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389467+0000", 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3414000000000001e-05 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389498+0000", 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0783e-05 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389513+0000", 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.485e-05 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.389669+0000", 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015608899999999999 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390051+0000", 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038213400000000001 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.390607+0000", 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055646199999999997 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392039+0000", 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014314519999999999 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392507+0000", 2024-05-10T09:55:52.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046770999999999998 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392593+0000", 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6159e-05 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.392672+0000", 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.941e-05 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.310114407999997, 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029667840000000001, 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 880 2024-05-10T09:55:52.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541435+0000", 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541439+0000", 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4869999999999998e-06 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541451+0000", 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2583e-05 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541484+0000", 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3176999999999998e-05 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541501+0000", 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6249999999999999e-05 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541623+0000", 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012215199999999999 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.541853+0000", 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023054799999999999 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.542204+0000", 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035071100000000002 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.543359+0000", 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011545609999999999 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544248+0000", 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088955700000000002 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544335+0000", 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.544402+0000", 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6408999999999994e-05 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.305922799999998, 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029184770000000001, 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.955 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 882 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545627+0000", 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545629+0000", 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1299999999999999e-06 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545640+0000", 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1663e-05 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545672+0000", 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1922999999999999e-05 2024-05-10T09:55:52.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545691+0000", 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8583000000000001e-05 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545821+0000", 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012955599999999999 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.545967+0000", 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014623199999999999 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.546238+0000", 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027076800000000001 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.547400+0000", 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011622080000000001 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548341+0000", 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00094160900000000004 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548428+0000", 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6502999999999995e-05 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548545+0000", 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117302 2024-05-10T09:55:52.960 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.302726792000001, 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002968301, 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.961 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 883 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548823+0000", 2024-05-10T09:55:52.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548824+0000", 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7540000000000001e-06 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548835+0000", 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0243e-05 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548859+0000", 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4253e-05 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548873+0000", 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4056999999999999e-05 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.548984+0000", 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011150900000000001 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549223+0000", 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023871100000000001 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.549550+0000", 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000327301 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.550681+0000", 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011309849999999999 2024-05-10T09:55:52.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551571+0000", 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088975600000000001 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551662+0000", 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0956000000000001e-05 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.551791+0000", 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012877599999999999 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.202541615000001, 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003259788, 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 925 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:52.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649008+0000", 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649010+0000", 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1239999999999999e-06 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649021+0000", 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0766e-05 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649051+0000", 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0533000000000001e-05 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649067+0000", 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5446000000000001e-05 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649189+0000", 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122576 2024-05-10T09:55:52.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649413+0000", 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022339199999999999 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.649726+0000", 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031377100000000002 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.650954+0000", 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012274300000000001 2024-05-10T09:55:52.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.651996+0000", 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001041922 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652156+0000", 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015990500000000001 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.652268+0000", 2024-05-10T09:55:52.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011192300000000001 2024-05-10T09:55:52.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:52.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:52.973 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:52.975 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:52.971+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:52.975 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:53.074 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:53.075+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:53.146 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:53.146 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:53.147 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:53.147 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:53.160 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:53.175 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:53.175+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:53.276 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:53.271+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:53.283 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:53.283 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:53.283 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:53.283 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:53.284 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:53.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:53.386 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:53.383+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:53.472 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.749881005000006, 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003342228, 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.473 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 41 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720248+0000", 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.17e-06 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720259+0000", 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1362999999999999e-05 2024-05-10T09:55:53.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720290+0000", 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1245999999999999e-05 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720326+0000", 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5769999999999998e-05 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720467+0000", 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014139299999999999 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720848+0000", 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038087700000000001 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.721316+0000", 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000468159 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.722880+0000", 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001563839 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723331+0000", 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000450603 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723447+0000", 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115742 2024-05-10T09:55:53.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723588+0000", 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014106599999999999 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.674460972999995, 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036007420000000001, 2024-05-10T09:55:53.479 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 39 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795667+0000", 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.883e-06 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795677+0000", 2024-05-10T09:55:53.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5359999999999998e-06 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795702+0000", 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4927e-05 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795716+0000", 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3828999999999999e-05 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795878+0000", 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162373 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.796006+0000", 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012822199999999999 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.799266+0000", 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032599719999999999 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.483 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.755254980999993, 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056055200000000001, 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:53.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714875+0000", 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.303e-06 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714893+0000", 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8668000000000002e-05 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714927+0000", 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3519999999999998e-05 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714948+0000", 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0911e-05 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715113+0000", 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016473599999999999 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715512+0000", 2024-05-10T09:55:53.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039976900000000001 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715816+0000", 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000303417 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719016+0000", 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032006589999999998 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720317+0000", 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013003859999999999 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720396+0000", 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9043999999999997e-05 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720477+0000", 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1106999999999994e-05 2024-05-10T09:55:53.489 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491083450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 65.749278786000005, 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050150489999999997, 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.490 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720849+0000", 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5740000000000001e-06 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720857+0000", 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2339999999999994e-06 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720878+0000", 2024-05-10T09:55:53.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0939000000000001e-05 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720890+0000", 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1863e-05 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720993+0000", 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102446 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721163+0000", 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017038700000000001 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721496+0000", 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00033285399999999999 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.723818+0000", 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002322246 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725574+0000", 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001755288 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725705+0000", 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131345 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725863+0000", 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157873 2024-05-10T09:55:53.495 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.746267842000002, 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033784850000000001, 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.496 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 205 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723863+0000", 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9369999999999997e-06 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723879+0000", 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.662e-05 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723917+0000", 2024-05-10T09:55:53.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7462999999999997e-05 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723936+0000", 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9049999999999999e-05 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724071+0000", 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013534500000000001 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724296+0000", 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000224766 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724714+0000", 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041791000000000002 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.726248+0000", 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534168 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727037+0000", 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00078889400000000005 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727121+0000", 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4109000000000004e-05 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727237+0000", 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116223 2024-05-10T09:55:53.501 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.670289570999998, 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034944860000000002, 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.502 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 220 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799840+0000", 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.88e-06 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799852+0000", 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2597e-05 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799878+0000", 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.563e-05 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799892+0000", 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800078+0000", 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018622800000000001 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800286+0000", 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020734900000000001 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800679+0000", 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039302599999999999 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.802102+0000", 2024-05-10T09:55:53.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014227090000000001 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803181+0000", 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001079602 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803265+0000", 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4085999999999994e-05 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803331+0000", 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6175999999999998e-05 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.659564774000003, 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033216510000000001, 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.508 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 223 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:53.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810564+0000", 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0099999999999998e-06 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810576+0000", 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1919999999999999e-05 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810604+0000", 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8293000000000002e-05 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810618+0000", 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.453e-05 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810739+0000", 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120559 2024-05-10T09:55:53.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810974+0000", 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023486500000000001 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.811410+0000", 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043620699999999998 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.812739+0000", 2024-05-10T09:55:53.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013293929999999999 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813736+0000", 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00099665600000000006 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813819+0000", 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3024999999999999e-05 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813883+0000", 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4193e-05 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.652199263999997, 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034076969999999999, 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 225 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817929+0000", 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9800000000000001e-06 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817940+0000", 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1263e-05 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817966+0000", 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5517e-05 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817981+0000", 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.508e-05 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818160+0000", 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017946800000000001 2024-05-10T09:55:53.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818375+0000", 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021470500000000001 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818799+0000", 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042364600000000002 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.820054+0000", 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012555439999999999 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821175+0000", 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011206720000000001 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821267+0000", 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2164999999999996e-05 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.519 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821335+0000", 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7657000000000006e-05 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.648412370000003, 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031354019999999998, 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.520 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 226 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821716+0000", 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0329999999999998e-06 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821726+0000", 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:53.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821758+0000", 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1109000000000003e-05 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821795+0000", 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7262999999999999e-05 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821923+0000", 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127906 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822156+0000", 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233231 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822572+0000", 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041563400000000001 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.823868+0000", 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00129623 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824698+0000", 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083007700000000003 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824784+0000", 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5636000000000005e-05 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824849+0000", 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5986000000000001e-05 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.618534031000003, 2024-05-10T09:55:53.526 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031471559999999999, 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 234 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851595+0000", 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851606+0000", 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1039999999999999e-05 2024-05-10T09:55:53.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851637+0000", 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1572999999999997e-05 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851653+0000", 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851833+0000", 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017961100000000001 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852052+0000", 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000219905 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852491+0000", 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043847999999999999 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.853823+0000", 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013323670000000001 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854589+0000", 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076523699999999999 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854679+0000", 2024-05-10T09:55:53.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0660000000000003e-05 2024-05-10T09:55:53.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854740+0000", 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0396000000000002e-05 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:431 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.556249661000003, 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031636749999999999, 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.534 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 431 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913878+0000", 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4699999999999999e-06 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913885+0000", 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7830000000000001e-06 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913899+0000", 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3550000000000001e-05 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913910+0000", 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1116e-05 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914037+0000", 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012750899999999999 2024-05-10T09:55:53.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914363+0000", 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032586799999999999 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914907+0000", 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054394199999999995 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916597+0000", 2024-05-10T09:55:53.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016898 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916905+0000", 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030769499999999997 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916982+0000", 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7809e-05 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.917040+0000", 2024-05-10T09:55:53.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8133000000000001e-05 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:442 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.551163047999999, 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031368049999999999, 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.540 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 442 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918965+0000", 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.654e-06 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918973+0000", 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0730000000000005e-06 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918999+0000", 2024-05-10T09:55:53.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5437000000000001e-05 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919011+0000", 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140000000000001e-05 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919129+0000", 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118539 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919440+0000", 2024-05-10T09:55:53.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031087500000000001 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919767+0000", 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032684599999999999 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921033+0000", 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001266348 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921785+0000", 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075156400000000003 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921937+0000", 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015235800000000001 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.922100+0000", 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016297100000000001 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.545 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:493 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.514935453, 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038321729999999999, 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955193+0000", 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.514e-06 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955205+0000", 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2395000000000001e-05 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955230+0000", 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4939e-05 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955242+0000", 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1989e-05 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955399+0000", 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015761700000000001 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955455+0000", 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5946999999999998e-05 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958922+0000", 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034661230000000002 2024-05-10T09:55:53.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959023+0000", 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101649 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:531 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.491208002, 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033419700000000001, 2024-05-10T09:55:53.550 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978920+0000", 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.646e-06 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978932+0000", 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1746000000000001e-05 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978957+0000", 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5425000000000001e-05 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978970+0000", 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3186e-05 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979090+0000", 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119621 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979128+0000", 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7765999999999997e-05 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982128+0000", 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030005269999999998 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982260+0000", 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132053 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.554 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:532 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.489263305000001, 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040928650000000002, 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980865+0000", 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.531e-06 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980875+0000", 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0749e-05 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980899+0000", 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4031000000000001e-05 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980911+0000", 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1897e-05 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981024+0000", 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112574 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981067+0000", 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3556000000000001e-05 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984876+0000", 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003808624 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984956+0000", 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9902999999999997e-05 2024-05-10T09:55:53.558 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.244629613000001, 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035004300000000001, 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.559 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 745 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225500+0000", 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3100000000000001e-06 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225513+0000", 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.278e-05 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225544+0000", 2024-05-10T09:55:53.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0573e-05 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225559+0000", 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.522e-05 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225710+0000", 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015115899999999999 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226066+0000", 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035624300000000001 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226622+0000", 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055600300000000001 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.227855+0000", 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012332510000000001 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228722+0000", 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00086697599999999999 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228885+0000", 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162969 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228997+0000", 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111946 2024-05-10T09:55:53.564 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:747 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.239908106000001, 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032519850000000002, 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.565 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 747 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230220+0000", 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6559999999999999e-06 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230228+0000", 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.824e-06 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230248+0000", 2024-05-10T09:55:53.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230259+0000", 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1406999999999999e-05 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230372+0000", 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112829 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230596+0000", 2024-05-10T09:55:53.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022375499999999999 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.231055+0000", 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045978700000000002 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.232387+0000", 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013311589999999999 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233206+0000", 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081972000000000002 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233359+0000", 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152683 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233470+0000", 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111419 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.570 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.201937108999999, 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031982120000000002, 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 763 2024-05-10T09:55:53.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268191+0000", 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0360000000000001e-06 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268202+0000", 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.043e-05 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268234+0000", 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1847000000000002e-05 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268255+0000", 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1590000000000002e-05 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268443+0000", 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018751799999999999 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268670+0000", 2024-05-10T09:55:53.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022725499999999999 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268993+0000", 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032307800000000003 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.270123+0000", 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011297709999999999 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271173+0000", 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010499019999999999 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271257+0000", 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3901999999999997e-05 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271388+0000", 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013088299999999999 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.576 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 62.055998836000001, 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034247800000000001, 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 825 2024-05-10T09:55:53.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414129+0000", 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.657e-06 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414140+0000", 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414159+0000", 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8805999999999999e-05 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414170+0000", 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1007e-05 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414280+0000", 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110115 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414524+0000", 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244405 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.415025+0000", 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00050059300000000002 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.416518+0000", 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014937889999999999 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417272+0000", 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075359400000000001 2024-05-10T09:55:53.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417420+0000", 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148009 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417552+0000", 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013230499999999999 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 61.828850942000003, 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003571369, 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 922 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:53.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641278+0000", 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.097e-06 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641289+0000", 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1163e-05 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641320+0000", 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1600000000000002e-05 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641342+0000", 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2089000000000001e-05 2024-05-10T09:55:53.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641594+0000", 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025150200000000002 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642155+0000", 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056140900000000002 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642609+0000", 2024-05-10T09:55:53.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045330000000000001 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.643594+0000", 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098517900000000009 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644692+0000", 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010985039999999999 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:53.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644782+0000", 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9837000000000001e-05 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644847+0000", 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4689000000000004e-05 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:53.588 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:53.589 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:55:53.590 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:53.591 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:53.587+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:53.690 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:53.687+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:53.767 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:53.767 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:53.767 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:53.767 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:53.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:53.790 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:53.791+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:53.891 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:53.887+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:53.948 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:53.949 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:53.949 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:53.949 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:53.949 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:53.963 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:54.006 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:54.003+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:54.093 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:54.091+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 70.418251612000006, 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.127 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:55:54.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:55:54.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.132 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 70.408102263999993, 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.438233647000004, 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.138 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:55:54.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:55:54.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:54.144 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.410176949999993, 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:55:54.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.149 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.395805839999994, 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:55:54.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:55:54.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.393119661, 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.155 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:54.160 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.298212468000003, 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:55:54.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:55:54.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.378642253000002, 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.334912170000003, 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.172 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.320299022999997, 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:55:54.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:55:54.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.176 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.245569463000002, 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:55:54.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:55:54.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.227423100000003, 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.181 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:54.185 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.192668580000003, 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:55:54.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:55:54.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.191594367999997, 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.193 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.191102256999997, 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:54.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:55:54.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.189052666999999, 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:55:54.198 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:55:54.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.182808147999999, 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:55:54.206 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.179593723000004, 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:54.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:55:54.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:55:54.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.178420285000001, 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 63.127069908000003, 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.215 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:55:54.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:55:54.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.219 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:54.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:54.221 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:54.219+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:54.322 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:54.319+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:54.348 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:54.348 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:54.348 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:54.348 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:54.362 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:54.422 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:54.419+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:54.480 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:54.480 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:54.480 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:54.481 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:54.481 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:54.494 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:54.530 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:55:54.542 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:54.539+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:54.624 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:54.619+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:54.665 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:54.665 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:54.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:54.665 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:54.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 87.126119398, 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:55:54.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:55:54.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:55:54.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.313017857000006, 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:55:54.672 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:55:54.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:55:54.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:55:54.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:55:54.677 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.312888981, 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:55:54.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.312739640999993, 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.684 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:55:54.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:55:54.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:55:54.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.203669180999995, 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.689 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:55:54.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.203026722000004, 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.695 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:55:54.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:55:54.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.202906612999996, 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.701 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:55:54.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.202637652000007, 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:55:54.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:55:54.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:54.712 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.202574999000007, 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:54.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.202518693000002, 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:55:54.718 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:55:54.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.202325850999998, 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.724 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:55:54.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.202285681000006, 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:55:54.730 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:55:54.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:55:54.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.202200454999996, 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.736 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:54.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:55:54.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:55:54.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:55:54.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.202008199999995, 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:54.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:55:54.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:55:54.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.747 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 86.201971886999999, 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:55:54.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:55:54.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:55:54.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 85.949534323999998, 2024-05-10T09:55:54.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:55:54.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 85.949419277000004, 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:55:54.759 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:55:54.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:55:54.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.765 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 85.949378413000005, 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:55:54.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 85.949339347999995, 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:55:54.771 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:55:54.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 85.949213125, 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:54.777 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:54.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:55:54.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:54.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:54.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:55:54.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:55:54.783 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.783 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.783 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.783 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:54.783 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:54.783 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:54.784 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:54.785 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:54.783+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:54.885 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:54.883+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:54.915 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:54.915 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:54.915 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:54.915 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:54.929 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:54.975 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:55.019 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:55.019+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:55.052 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:55.052 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:55.052 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:55.052 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:55.052 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:55.067 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:55.111 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:55.111 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:55.111 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:55.111+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:55.129 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:55.130 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:55.148 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:55.149 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:55.166 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:55.166 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:55.187 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:55.188 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:55.183+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:55.188 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:55.209 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:55.209 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:55.228 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:55.228 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:55.231 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:55.241 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:55.253 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:55.253 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:55.288 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:55.283+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:55.364 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:55.364 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:55.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:55.423 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:55.423+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:55.486 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:55.487 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:55.489 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:55.483+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:55.500 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:55.590 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:55.587+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:55.653 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:55.653 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:55.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:55:55.691 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:55.687+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:55.793 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:55.791+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:55.885 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:55.886 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:55.894 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:55.891+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:55.903 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:55:55.995 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:55.991+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:56.054 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:56.054 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:56.067 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:55:56.095 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:56.091+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:56.174 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:56.174 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:56.187 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:55:56.196 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:56.191+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:56.297 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:56.295+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:56.303 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:56.303 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:56.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:55:56.407 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:56.407+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:56.481 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:56.481 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:56.498 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:55:56.499 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:56.495+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:56.551 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:55:56.600 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:56.595+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:56.701 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:56.699+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:56.705 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:56.705 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:56.723 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:55:56.802 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:56.799+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:56.853 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:56.853 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:56.867 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:55:56.914 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:56.911+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:56.989 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:56.989 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:57.004 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:55:57.004 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:56.999+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:57.105 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:57.099+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:57.170 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:57.170 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:57.184 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:55:57.226 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:57.223+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:57.272 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:55:57.307 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:57.303+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:57.350 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:57.350 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:57.364 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:55:57.410 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:57.410 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:57.411 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:57.407+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:57.425 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:57.425 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:57.443 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:57.443 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:57.459 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:57.459 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:57.483 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:57.483 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:57.503 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:57.504 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:57.511 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:57.511+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:57.536 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:57.537 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:57.537 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:55:57.538 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:57.538 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:57.538 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:57.538 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:57.538 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:57.554 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:55:57.571 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:57.571 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:55:57.635 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:57.635+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:57.677 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:57.677 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 73.953885083000003, 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003342228, 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 41 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720245+0000", 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720248+0000", 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.17e-06 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720259+0000", 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1362999999999999e-05 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720290+0000", 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1245999999999999e-05 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720326+0000", 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5769999999999998e-05 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720467+0000", 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014139299999999999 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.720848+0000", 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038087700000000001 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.721316+0000", 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000468159 2024-05-10T09:55:57.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.722880+0000", 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001563839 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723331+0000", 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000450603 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723447+0000", 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115742 2024-05-10T09:55:57.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.723588+0000", 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014106599999999999 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 73.878465051000006, 2024-05-10T09:55:57.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036007420000000001, 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 39 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795665+0000", 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795667+0000", 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.883e-06 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795677+0000", 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5359999999999998e-06 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795702+0000", 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4927e-05 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795716+0000", 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3828999999999999e-05 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.795878+0000", 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162373 2024-05-10T09:55:57.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.796006+0000", 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012822199999999999 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.799266+0000", 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032599719999999999 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.959259059000004, 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056055200000000001, 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:57.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714871+0000", 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714875+0000", 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.303e-06 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714893+0000", 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8668000000000002e-05 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714927+0000", 2024-05-10T09:55:57.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3519999999999998e-05 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714948+0000", 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0911e-05 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715113+0000", 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016473599999999999 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715512+0000", 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039976900000000001 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715816+0000", 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000303417 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.719016+0000", 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032006589999999998 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720317+0000", 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013003859999999999 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720396+0000", 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9043999999999997e-05 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720477+0000", 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1106999999999994e-05 2024-05-10T09:55:57.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491083450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 69.953282864000002, 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050150489999999997, 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720848+0000", 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720849+0000", 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5740000000000001e-06 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720857+0000", 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2339999999999994e-06 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720878+0000", 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0939000000000001e-05 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720890+0000", 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1863e-05 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720993+0000", 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102446 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721163+0000", 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017038700000000001 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.721496+0000", 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00033285399999999999 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.723818+0000", 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002322246 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725574+0000", 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001755288 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725705+0000", 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131345 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.725863+0000", 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157873 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.950271920000006, 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033784850000000001, 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 205 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723859+0000", 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723863+0000", 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9369999999999997e-06 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723879+0000", 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.662e-05 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723917+0000", 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7462999999999997e-05 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.723936+0000", 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9049999999999999e-05 2024-05-10T09:55:57.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724071+0000", 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013534500000000001 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724296+0000", 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000224766 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.724714+0000", 2024-05-10T09:55:57.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041791000000000002 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.726248+0000", 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001534168 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727037+0000", 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00078889400000000005 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727121+0000", 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4109000000000004e-05 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.727237+0000", 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116223 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.874293648999995, 2024-05-10T09:55:57.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034944860000000002, 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 220 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799837+0000", 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799840+0000", 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.88e-06 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799852+0000", 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2597e-05 2024-05-10T09:55:57.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799878+0000", 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.563e-05 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.799892+0000", 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800078+0000", 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018622800000000001 2024-05-10T09:55:57.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800286+0000", 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020734900000000001 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.800679+0000", 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039302599999999999 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.802102+0000", 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014227090000000001 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803181+0000", 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001079602 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803265+0000", 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4085999999999994e-05 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.803331+0000", 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6175999999999998e-05 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.863568852, 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033216510000000001, 2024-05-10T09:55:57.711 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 223 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810562+0000", 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810564+0000", 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0099999999999998e-06 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810576+0000", 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1919999999999999e-05 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810604+0000", 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8293000000000002e-05 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810618+0000", 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.453e-05 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810739+0000", 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120559 2024-05-10T09:55:57.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.810974+0000", 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023486500000000001 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.811410+0000", 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043620699999999998 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.812739+0000", 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013293929999999999 2024-05-10T09:55:57.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813736+0000", 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00099665600000000006 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813819+0000", 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3024999999999999e-05 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.813883+0000", 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4193e-05 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.716 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.856203342000001, 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034076969999999999, 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.717 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 225 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817927+0000", 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817929+0000", 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9800000000000001e-06 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817940+0000", 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1263e-05 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817966+0000", 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5517e-05 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.817981+0000", 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.508e-05 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818160+0000", 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017946800000000001 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818375+0000", 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021470500000000001 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.818799+0000", 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042364600000000002 2024-05-10T09:55:57.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.820054+0000", 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012555439999999999 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821175+0000", 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011206720000000001 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821267+0000", 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2164999999999996e-05 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821335+0000", 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7657000000000006e-05 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.852416448, 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031354019999999998, 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 226 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.724 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821714+0000", 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821716+0000", 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0329999999999998e-06 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821726+0000", 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821758+0000", 2024-05-10T09:55:57.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1109000000000003e-05 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821795+0000", 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7262999999999999e-05 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.821923+0000", 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127906 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822156+0000", 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233231 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.822572+0000", 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041563400000000001 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.823868+0000", 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00129623 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824698+0000", 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083007700000000003 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824784+0000", 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5636000000000005e-05 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.824849+0000", 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5986000000000001e-05 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.822538109000007, 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031471559999999999, 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 234 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.730 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851592+0000", 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851595+0000", 2024-05-10T09:55:57.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851606+0000", 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1039999999999999e-05 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851637+0000", 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1572999999999997e-05 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851653+0000", 2024-05-10T09:55:57.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.851833+0000", 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017961100000000001 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852052+0000", 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000219905 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.852491+0000", 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043847999999999999 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.853823+0000", 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013323670000000001 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854589+0000", 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076523699999999999 2024-05-10T09:55:57.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854679+0000", 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0660000000000003e-05 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.854740+0000", 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0396000000000002e-05 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:431 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.760253739000007, 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031636749999999999, 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 431 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913877+0000", 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913878+0000", 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4699999999999999e-06 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913885+0000", 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7830000000000001e-06 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913899+0000", 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3550000000000001e-05 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.913910+0000", 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1116e-05 2024-05-10T09:55:57.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914037+0000", 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012750899999999999 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914363+0000", 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032586799999999999 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.914907+0000", 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054394199999999995 2024-05-10T09:55:57.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916597+0000", 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016898 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916905+0000", 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030769499999999997 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.916982+0000", 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7809e-05 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.917040+0000", 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8133000000000001e-05 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.741 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:442 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.755167126000003, 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031368049999999999, 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 442 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.742 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918963+0000", 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918965+0000", 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.654e-06 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918973+0000", 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0730000000000005e-06 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.918999+0000", 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5437000000000001e-05 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919011+0000", 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140000000000001e-05 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919129+0000", 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118539 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919440+0000", 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00031087500000000001 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.919767+0000", 2024-05-10T09:55:57.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032684599999999999 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921033+0000", 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001266348 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921785+0000", 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075156400000000003 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.921937+0000", 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015235800000000001 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.922100+0000", 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016297100000000001 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:493 6.1a e35/29 6:5c7e8a6d:reshard::reshard.0000000015:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:57.747 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.718939531000004, 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038321729999999999, 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955191+0000", 2024-05-10T09:55:57.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955193+0000", 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.514e-06 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955205+0000", 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2395000000000001e-05 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955230+0000", 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4939e-05 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955242+0000", 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1989e-05 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955399+0000", 2024-05-10T09:55:57.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015761700000000001 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.955455+0000", 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5946999999999998e-05 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.958922+0000", 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034661230000000002 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.959023+0000", 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101649 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:531 6.1c e35/29 6:3fb1de85:::obj_delete_at_hint.0000000018:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.695212080000005, 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033419700000000001, 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.752 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978918+0000", 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978920+0000", 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.646e-06 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978932+0000", 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1746000000000001e-05 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978957+0000", 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5425000000000001e-05 2024-05-10T09:55:57.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.978970+0000", 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3186e-05 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979090+0000", 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119621 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.979128+0000", 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7765999999999997e-05 2024-05-10T09:55:57.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982128+0000", 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0030005269999999998 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.982260+0000", 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000132053 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.756 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:532 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.693267383000006, 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040928650000000002, 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:57.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980863+0000", 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980865+0000", 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.531e-06 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980875+0000", 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0749e-05 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980899+0000", 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4031000000000001e-05 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.980911+0000", 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1897e-05 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981024+0000", 2024-05-10T09:55:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112574 2024-05-10T09:55:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.981067+0000", 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3556000000000001e-05 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984876+0000", 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003808624 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.984956+0000", 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9902999999999997e-05 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.761 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.448633690999998, 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035004300000000001, 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.762 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 745 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225497+0000", 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225500+0000", 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3100000000000001e-06 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225513+0000", 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.278e-05 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225544+0000", 2024-05-10T09:55:57.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0573e-05 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225559+0000", 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.522e-05 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.225710+0000", 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015115899999999999 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226066+0000", 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035624300000000001 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.226622+0000", 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00055600300000000001 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.227855+0000", 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012332510000000001 2024-05-10T09:55:57.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228722+0000", 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00086697599999999999 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228885+0000", 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162969 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.228997+0000", 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111946 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:747 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.443912183999998, 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032519850000000002, 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.768 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 747 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230218+0000", 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230220+0000", 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6559999999999999e-06 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230228+0000", 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.824e-06 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230248+0000", 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230259+0000", 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1406999999999999e-05 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230372+0000", 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112829 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.230596+0000", 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022375499999999999 2024-05-10T09:55:57.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.231055+0000", 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045978700000000002 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.232387+0000", 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013311589999999999 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233206+0000", 2024-05-10T09:55:57.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081972000000000002 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233359+0000", 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152683 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.233470+0000", 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111419 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.774 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.405941186999996, 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031982120000000002, 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.775 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 763 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268189+0000", 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268191+0000", 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0360000000000001e-06 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268202+0000", 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.043e-05 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268234+0000", 2024-05-10T09:55:57.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1847000000000002e-05 2024-05-10T09:55:57.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268255+0000", 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1590000000000002e-05 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268443+0000", 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018751799999999999 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268670+0000", 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022725499999999999 2024-05-10T09:55:57.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.268993+0000", 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00032307800000000003 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.270123+0000", 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011297709999999999 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271173+0000", 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010499019999999999 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271257+0000", 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3901999999999997e-05 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.271388+0000", 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013088299999999999 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.781 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:825 6.a 6:547b96f2:::obj_delete_at_hint.0000000082:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.260002913999998, 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034247800000000001, 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 825 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414128+0000", 2024-05-10T09:55:57.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414129+0000", 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.657e-06 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414140+0000", 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0499999999999999e-05 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414159+0000", 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8805999999999999e-05 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414170+0000", 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1007e-05 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414280+0000", 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110115 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.414524+0000", 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244405 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.415025+0000", 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00050059300000000002 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.416518+0000", 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014937889999999999 2024-05-10T09:55:57.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417272+0000", 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00075359400000000001 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417420+0000", 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000148009 2024-05-10T09:55:57.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.417552+0000", 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013230499999999999 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.788 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 66.03285502, 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003571369, 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 922 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:57.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641276+0000", 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641278+0000", 2024-05-10T09:55:57.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.097e-06 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641289+0000", 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1163e-05 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641320+0000", 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1600000000000002e-05 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:57.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641342+0000", 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2089000000000001e-05 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.641594+0000", 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025150200000000002 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642155+0000", 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00056140900000000002 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.642609+0000", 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00045330000000000001 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.643594+0000", 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098517900000000009 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644692+0000", 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010985039999999999 2024-05-10T09:55:57.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644782+0000", 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9837000000000001e-05 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.644847+0000", 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4689000000000004e-05 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.794 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:57.795 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:57.795 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:57.796 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:55:57.797 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:57.795+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:57.897 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:57.895+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:57.924 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:57.924 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:57.924 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:57.924 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:57.938 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:55:57.998 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:55:57.995+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:55:58.058 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:58.058 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:58.059 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:58.072 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:55:58.118 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:58.115+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:58.199 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:58.199+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:58.248 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:58.248 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:58.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:58.248 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:58.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.248 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:58.248 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.539298102999993, 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:55:58.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:55:58.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.254 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.529148754999994, 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:55:58.255 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:55:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 70.559280138000005, 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:55:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 70.531223440999995, 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:55:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:55:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 70.516852330999996, 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:55:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 70.514166152000001, 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:55:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:55:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:55:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 70.419258959000004, 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:55:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:55:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.499688743999997, 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:55:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.455958660999997, 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:55:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.441345514000005, 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:55:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.366615953999997, 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:55:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:55:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.348469590999997, 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:55:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.313715071000004, 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:55:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:55:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.312640858999998, 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:55:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.312148747999998, 2024-05-10T09:55:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:55:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:55:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.310099158, 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:55:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:55:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.303854638999994, 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:55:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.300640213999998, 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:55:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:55:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.299466776000003, 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:58.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:55:58.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 67.248116398999997, 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:55:58.345 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.349 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.350 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.350 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.350 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.350 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:58.351 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:55:58.352 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:58.351+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:58.453 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:58.451+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:58.480 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:58.480 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:58.480 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:55:58.481 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:58.495 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:55:58.553 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:58.551+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:58.618 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:58.618 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:55:58.618 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:55:58.619 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:55:58.619 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:58.633 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:55:58.678 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:55:58.675+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:55:58.754 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:58.751+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:58.758 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 91.219599371000001, 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.759 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:55:58.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:55:58.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:55:58.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.406497830000006, 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:55:58.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:55:58.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.406368954000001, 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.772 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:55:58.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:55:58.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.777 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.406219613999994, 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.778 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:55:58.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:55:58.783 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.297149153999996, 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.784 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:55:58.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:55:58.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.296506695000005, 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.790 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:55:58.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.296386585999997, 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.796 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:55:58.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.296117624999994, 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:55:58.802 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:55:58.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:55:58.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.296054971999993, 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:55:58.808 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:55:58.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.295998666000003, 2024-05-10T09:55:58.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:55:58.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:55:58.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:55:58.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.295805823999999, 2024-05-10T09:55:58.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:55:58.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:55:58.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:58.826 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.295765653999993, 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:58.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:55:58.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.832 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.295680427999997, 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:55:58.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:55:58.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.295488172999995, 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.839 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:55:58.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.841 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:58.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:55:58.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:55:58.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.29545186, 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.847 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:55:58.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:55:58.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.043014296999999, 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:55:58.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.858 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.042899250000005, 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.859 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:55:58.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.864 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.042858386000006, 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:55:58.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:55:58.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:55:58.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.042819320999996, 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.871 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:55:58.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:55:58.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 90.042693098000001, 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:55:58.877 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:55:58.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:55:58.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:58.881 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.882 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:55:58.883 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:55:58.883 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:55:58.884 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:58.883+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:58.885 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:55:58.985 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:58.983+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:59.030 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:59.030 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:59.030 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:59.030 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:59.047 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:55:59.091 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:59.091+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:59.186 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:59.183+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:59.252 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:59.252 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:59.252 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:55:59.252 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:55:59.252 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:59.270 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:55:59.311 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:55:59.311+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:55:59.389 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:55:59.383+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:55:59.424 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:59.424 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:55:59.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:55:59.424 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:55:59.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.070686855999995, 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:55:59.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:55:59.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.694824640999997, 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.429 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:55:59.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.672201572000006, 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.629738297000003, 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.441 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:55:59.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:55:59.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:55:59.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:55:59.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.615101867000007, 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.447 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:55:59.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.452 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.585600955999993, 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:55:59.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:55:59.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:55:59.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:55:59.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.567321708999998, 2024-05-10T09:55:59.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:55:59.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:55:59.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.514457864999997, 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.464 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.473700843000003, 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.470 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:55:59.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:55:59.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:55:59.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.439467207000007, 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:55:59.476 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:59.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.433640123000004, 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:55:59.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:55:59.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.402682869000003, 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.488 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:55:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.386472831999995, 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:55:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.308814873000003, 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:55:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:55:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:55:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.308680944000002, 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:55:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:55:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:55:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.274373725999993, 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:55:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:55:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:55:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.270514707000004, 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:55:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:55:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 68.039551048999996, 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:55:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:55:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 67.859348917000005, 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:55:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:55:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 38.525904746999998, 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003566343, 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:55:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1020 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:55:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896175+0000", 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5429999999999998e-06 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896193+0000", 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8448999999999999e-05 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:55:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896233+0000", 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0228999999999997e-05 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896252+0000", 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9148999999999999e-05 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896422+0000", 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016917700000000001 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:55:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896661+0000", 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000239576 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.897003+0000", 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000341582 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.898376+0000", 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013735760000000001 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899568+0000", 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011918339999999999 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899659+0000", 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0895000000000003e-05 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899737+0000", 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8332999999999997e-05 2024-05-10T09:55:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:55:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:55:59.543 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:59.544 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:55:59.545 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:59.539+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:59.559 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:55:59.592 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:55:59.645 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:55:59.639+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:55:59.701 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:55:59.701 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:55:59.701 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:55:59.701 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:55:59.722 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:55:59.767 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:55:59.767+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:55:59.778 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:55:59.778 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:55:59.810 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:55:59.810 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:55:59.843 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:55:59.843 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:55:59.846 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:55:59.843+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:55:59.875 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:55:59.875 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:55:59.891 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:55:59.891 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:55:59.908 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:55:59.910 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:55:59.910 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:55:59.934 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:55:59.934 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:55:59.947 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:55:59.947+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:55:59.955 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:55:59.955 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:55:59.975 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:55:59.975 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:00.037 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:00.037 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:00.048 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:00.047+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:00.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:00.148 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:00.147+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:00.236 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:00.236 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:00.249 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:00.250 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:00.247+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:00.350 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:00.347+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:00.403 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:00.403 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:00.416 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:00.451 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:00.447+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:00.542 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:00.542 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:00.542 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:56:00.552 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:00.547+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:00.564 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:00.652 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:00.651+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:00.673 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:00.673 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:00.686 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:00.771 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:00.771+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:00.851 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:00.851 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:00.855 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:00.855+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:00.864 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:00.955 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:00.955+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:01.039 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:01.039 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:01.052 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:56:01.095 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:01.095+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:01.156 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:01.151+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:01.186 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:01.186 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:01.200 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:56:01.286 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:01.283+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:01.359 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:01.359+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:01.365 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:01.365 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:01.379 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:56:01.466 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:01.463+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:01.546 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:01.546 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:01.561 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:01.561 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:01.555+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:01.662 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:01.659+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:01.731 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:01.731 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:01.746 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:01.790 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:01.787+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:01.864 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:01.863+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:01.912 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:01.912 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:01.926 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:01.974 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:01.971+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:01.992 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:02.050 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:02.050 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:02.065 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:02.066 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:02.063+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:02.167 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:02.167+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:02.191 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:02.191 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:02.223 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:02.223 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:02.230 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:02.230 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:02.244 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:02.254 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:02.255 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:02.286 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:02.286 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:02.290 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:02.287+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:02.320 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:02.320 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:02.353 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:02.353 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:02.362 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:02.362 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:02.368 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:02.367+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:02.376 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:02.387 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:02.419 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:02.419 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:02.438 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T09:56:02.438 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T09:56:02.483 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:02.483+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:02.545 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:02.545 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:02.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:02.545 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:02.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.545 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:02.545 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.836106790000002, 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:02.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:56:02.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 78.825957442000004, 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:56:02.551 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:56:02.556 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.856088825, 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:02.557 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:56:02.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:56:02.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.828032128000004, 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.563 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:56:02.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:56:02.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:56:02.568 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.813661018000005, 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:56:02.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:56:02.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:56:02.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.810974838999996, 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:56:02.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.580 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 74.716067645999999, 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:56:02.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:56:02.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:56:02.584 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.796497431000006, 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:56:02.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.589 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.752767348000006, 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:56:02.593 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.738154201, 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.597 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.663424641000006, 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.598 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:56:02.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.602 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.645278278000006, 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:02.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:56:02.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:56:02.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.610523757999999, 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:02.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:56:02.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.609449545999993, 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.612 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:56:02.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:56:02.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.608957434999994, 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.606907844999995, 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:56:02.621 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:56:02.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:56:02.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.600663326000003, 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:02.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:56:02.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.597448901000007, 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:56:02.630 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.631 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.596275462999998, 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:56:02.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 71.544925086000006, 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:56:02.639 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:56:02.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:02.643 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:02.644 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:02.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:56:02.646 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:02.646 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:02.639+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:02.746 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:02.743+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:02.817 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:02.817 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:02.817 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:02.832 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:02.846 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:02.843+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:02.948 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:02.943+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:02.991 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:02.992 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:02.992 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:02.992 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:02.992 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:03.006 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:03.048 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:03.047+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:03.150 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:03.147+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:03.179 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:03.179 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:03.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:03.179 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 95.640485354000006, 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.180 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:56:03.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:56:03.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:56:03.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.827383812999997, 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.186 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:03.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:56:03.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:56:03.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.827254937000006, 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:56:03.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:56:03.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:56:03.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.827105596999999, 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.197 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:56:03.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:56:03.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:56:03.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.718035137000001, 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:56:03.203 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:56:03.208 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.717392677999996, 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.209 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.214 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.717272569000002, 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:56:03.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:56:03.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:56:03.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.220 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.717003607999999, 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:56:03.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:56:03.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.716940954999998, 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:56:03.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:56:03.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:56:03.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.716884648999994, 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.233 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:56:03.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.238 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.716691807000004, 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:56:03.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:56:03.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.244 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.716651636999998, 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:56:03.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:56:03.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.250 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.716566411000002, 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:56:03.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.716374156000001, 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:56:03.256 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:56:03.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:56:03.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:56:03.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:56:03.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.716337843000005, 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:03.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:56:03.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.267 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.463900280000004, 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:56:03.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.273 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.463785232999996, 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:56:03.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:56:03.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.279 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.463744368999997, 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:56:03.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.285 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.463705304000001, 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:56:03.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:56:03.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:03.291 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 94.463579081000006, 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:03.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:03.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:56:03.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:03.297 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:03.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:03.299 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:03.295+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:03.399 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:03.399+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:03.469 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:03.469 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:03.469 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:03.470 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:03.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:03.500 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:03.495+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:03.562 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:56:03.601 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:03.595+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:03.701 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:03.699+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:03.708 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:03.708 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:03.708 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:03.708 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:03.708 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:03.726 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:03.815 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:03.815+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:03.904 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:03.899+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:03.943 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 95.589604812000005, 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:56:03.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:56:03.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 73.213742597000007, 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.949 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:03.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:56:03.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:03.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.954 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:56:03.954 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:56:03.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.954 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.954 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:56:03.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:03.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.958 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 73.191119528000002, 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.959 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:56:03.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:56:03.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:56:03.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:03.965 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 73.148656252999999, 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:56:03.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:03.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 73.134019823000003, 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.972 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:56:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.976 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:56:03.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 73.104518912000003, 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.978 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:03.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:03.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.982 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.983 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 73.086239664999994, 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:03.984 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.986 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:56:03.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 73.033375821000007, 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:56:03.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:56:03.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:03.993 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:56:03.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:03.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.992618798999999, 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:03.996 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:03.998 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:03.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:56:04.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.002 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.958385163000003, 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:56:04.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:56:04.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.952558078999999, 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.009 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:04.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:56:04.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.921600824999999, 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.015 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:56:04.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:56:04.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.905390788000005, 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:56:04.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:56:04.027 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.827732828999999, 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.028 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:56:04.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.827598899999998, 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.034 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:56:04.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:56:04.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.793291682000003, 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.040 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:56:04.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:56:04.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.789432662999999, 2024-05-10T09:56:04.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:04.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:56:04.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.052 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.558469005000006, 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:04.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 72.378266873000001, 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:56:04.058 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-05-10T09:56:04.064 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 43.044822703000001, 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003566343, 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1020 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:04.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896175+0000", 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5429999999999998e-06 2024-05-10T09:56:04.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896193+0000", 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8448999999999999e-05 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896233+0000", 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0228999999999997e-05 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896252+0000", 2024-05-10T09:56:04.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9148999999999999e-05 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896422+0000", 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016917700000000001 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896661+0000", 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000239576 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:04.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.897003+0000", 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000341582 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.898376+0000", 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013735760000000001 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899568+0000", 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011918339999999999 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899659+0000", 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0895000000000003e-05 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899737+0000", 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8332999999999997e-05 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:04.070 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:04.071 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:04.072 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:04.073 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:04.067+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:04.172 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:04.167+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:04.273 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:04.271+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:04.284 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:04.285 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:04.285 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:04.285 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:04.302 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:04.374 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:04.371+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:04.442 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:04.472 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:04.472 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:04.475 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:04.471+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:04.490 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:04.576 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:04.571+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:04.644 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:04.644 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:04.676 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:04.676 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:04.677 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:04.671+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:04.705 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:04.705 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:04.708 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:04.708 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:04.724 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:04.739 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:04.739 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:04.773 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:04.773 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:04.777 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:04.771+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:04.807 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:04.807 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:04.841 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:04.841 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:04.874 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:04.874 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:04.879 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:04.875+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:04.895 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:04.895 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:04.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:04.999 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:04.999+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:05.081 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:05.075+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:05.124 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:05.124 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:05.141 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:05.183 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:05.183+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:05.282 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:05.279+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:05.352 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:05.352 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:05.370 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:05.383 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:05.379+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:05.483 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:05.483+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:05.543 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:05.543 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:05.561 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:05.585 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:05.579+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:05.594 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:56:05.686 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:05.683+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:05.776 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:05.776 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:05.787 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:05.787+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:05.797 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:05.888 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:05.883+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:05.989 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:05.983+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:06.010 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:06.010 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:06.027 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:56:06.089 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:06.087+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:06.159 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:06.159 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:06.173 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:56:06.218 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:06.215+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:06.288 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:06.289 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:06.290 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:06.287+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:06.302 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:56:06.390 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:06.387+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:06.469 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:06.469 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:06.484 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:06.491 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:06.491+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:06.581 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:56:06.593 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:06.587+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:06.611 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:06.611 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:06.625 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:06.693 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:06.691+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:06.788 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:06.789 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:06.794 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:06.791+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:06.802 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:06.894 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:06.891+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:06.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:06.922 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:06.923 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:06.936 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:06.995 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:06.995+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:07.059 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:07.059 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:07.073 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:07.093 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:07.093 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:07.118 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:07.115+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:07.124 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:07.124 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:07.155 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:07.155 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:07.186 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:07.186 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:07.192 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:07.192 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:07.196 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:07.195+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:07.206 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:07.217 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:07.218 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:07.248 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:07.249 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:07.279 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:07.279 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:07.297 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:07.295+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:07.310 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:07.310 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:07.376 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:07.376 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 83.667278742999997, 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:56:07.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 83.657129394999998, 2024-05-10T09:56:07.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:56:07.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:56:07.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:56:07.387 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 79.687260777999995, 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:07.388 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:56:07.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 79.659204080999999, 2024-05-10T09:56:07.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:56:07.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:56:07.399 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 79.644832971, 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:07.400 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:56:07.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:07.405 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 79.642146792000005, 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:56:07.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:56:07.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:56:07.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:56:07.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 79.547239598999994, 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.411 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:07.415 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.627669384000001, 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.419 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.583939301000001, 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:56:07.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.569326153999995, 2024-05-10T09:56:07.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:56:07.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:56:07.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.430 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.494596594000001, 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:56:07.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:56:07.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:56:07.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.476450231000001, 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:56:07.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:07.439 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.441695710999994, 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:56:07.443 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.440621499000002, 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.447 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.440129388000003, 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:56:07.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.451 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.438079798000004, 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:07.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.431835278999998, 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.456 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.428620854000002, 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:56:07.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.427447416000007, 2024-05-10T09:56:07.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:56:07.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.469 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 76.376097039000001, 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:56:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:56:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.474 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.474 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:07.475 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:07.476 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:07.475+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:07.576 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:07.571+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:07.593 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:07.593 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:07.593 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:07.593 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:07.607 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:07.677 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:07.675+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:07.777 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:07.775+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:07.781 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:07.781 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:07.781 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:07.781 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:07.795 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:07.879 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:07.875+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:07.924 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:07.924 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:07.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:07.924 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:07.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 100.38505801700001, 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:56:07.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:56:07.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.571956475999997, 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.932 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:56:07.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.937 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.571827600000006, 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.938 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:56:07.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:56:07.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.571678259999999, 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.944 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:56:07.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:56:07.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.462607800000001, 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.950 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:56:07.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:56:07.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.461965340999996, 2024-05-10T09:56:07.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:07.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:56:07.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.962 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.461845232000002, 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:56:07.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:56:07.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:56:07.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.461576270999998, 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.969 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:56:07.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.461513617999998, 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.975 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:56:07.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:56:07.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:56:07.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.461457311999993, 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:07.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:56:07.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.986 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.461264470000003, 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.987 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.991 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.992 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.461224299999998, 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:07.993 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:07.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:56:07.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:07.996 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:56:07.998 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.461139074000002, 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:07.999 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:08.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:08.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:56:08.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:56:08.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.460946819, 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.005 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:08.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:56:08.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.460910506000005, 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:08.011 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:08.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:56:08.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.208472943000004, 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:56:08.017 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:08.019 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:56:08.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:08.023 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.208357895999995, 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:56:08.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.208317031999997, 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.030 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:08.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:56:08.035 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.208277967000001, 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:56:08.038 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.039 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:56:08.040 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.041 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:56:08.042 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:56:08.043 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.044 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 99.208151744000006, 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:08.045 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:08.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:56:08.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:56:08.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:08.050 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:08.052 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:08.047+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:08.052 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:08.153 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:08.151+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:08.223 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:08.223 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:08.223 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:08.241 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:08.254 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:08.251+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:08.355 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:08.355+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:08.451 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:08.451 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:08.451 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:08.451 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:08.452 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:08.455 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:08.451+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:08.470 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:08.555 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:08.555+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:08.613 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.289808803, 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:56:08.644 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.913946588000002, 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.649 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:56:08.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.655 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.891323518999997, 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.656 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:56:08.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:56:08.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.662 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.848860243999994, 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:56:08.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:08.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.668 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.834223813999998, 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:56:08.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:56:08.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:56:08.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:56:08.674 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.804722902999998, 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.675 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:56:08.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:56:08.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.680 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.786443656000003, 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.681 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:56:08.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:56:08.686 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.733579812000002, 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.687 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:56:08.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.692822789999994, 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:56:08.693 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:56:08.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.699 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.658589153999998, 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:56:08.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.705 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.652762069999994, 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.706 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:56:08.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:56:08.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.711 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.621804815999994, 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:56:08.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:56:08.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:56:08.717 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.605594779, 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.718 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:08.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:56:08.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:56:08.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.527936819999994, 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.724 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:56:08.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.527802890999993, 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.730 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:56:08.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:56:08.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.493495672999998, 2024-05-10T09:56:08.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.489636653999995, 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.742 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:56:08.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:56:08.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.747 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.258672996000001, 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.748 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:56:08.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:56:08.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:08.754 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.078470863999996, 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:08.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:56:08.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:56:08.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-05-10T09:56:08.760 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 47.745026694000003, 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003566343, 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1020 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896175+0000", 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5429999999999998e-06 2024-05-10T09:56:08.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896193+0000", 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8448999999999999e-05 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896233+0000", 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0228999999999997e-05 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:08.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896252+0000", 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9148999999999999e-05 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896422+0000", 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016917700000000001 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896661+0000", 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000239576 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.897003+0000", 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000341582 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.898376+0000", 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013735760000000001 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899568+0000", 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011918339999999999 2024-05-10T09:56:08.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899659+0000", 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0895000000000003e-05 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899737+0000", 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8332999999999997e-05 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.766 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.767 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:08.767 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:08.767 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:08.768 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:08.768 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:08.767+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:08.868 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:08.867+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:08.969 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:08.963+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:08.981 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:08.981 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:08.981 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:08.981 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:08.999 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:09.070 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:09.067+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:09.171 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:09.167+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:09.212 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:09.212 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:09.212 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:09.212 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:09.212 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:09.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:09.271 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:09.271+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:09.331 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:09.372 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:09.367+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:09.445 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:09.445 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:09.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:09.445 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:09.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 85.795344448999998, 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:09.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:09.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:09.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 81.611360422999994, 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:56:09.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:56:09.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.457 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.707679992999999, 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.458 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:56:09.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:56:09.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.464 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.672964778999997, 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:56:09.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:56:09.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:56:09.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.646582799000001, 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.471 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:56:09.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:56:09.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:56:09.476 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.628552726999999, 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.477 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:56:09.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:56:09.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:09.483 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.594890456000002, 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:56:09.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:56:09.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:56:09.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.564161953999999, 2024-05-10T09:56:09.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.490 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:56:09.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:56:09.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:56:09.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.510809144000007, 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.496 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:09.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:56:09.501 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.335610524000003, 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.502 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:09.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:56:09.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.246135229000004, 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:56:09.508 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:56:09.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.201741706999996, 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:56:09.514 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:56:09.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:56:09.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.128938739999995, 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:56:09.520 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:56:09.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:56:09.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:09.526 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.097048810000004, 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:09.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.092263529999997, 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.532 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:56:09.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:56:09.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.011537752999999, 2024-05-10T09:56:09.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:56:09.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:56:09.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 78.007495968000001, 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.544 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:56:09.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:56:09.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:09.550 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.85120671, 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.556 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.846869587, 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:56:09.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:56:09.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 77.779010928000005, 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:09.563 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:09.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:56:09.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:09.568 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:09.570 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:09.570 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:09.571 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:09.571 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:09.571 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:09.572 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:09.567+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:09.596 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:56:09.598 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:09.598 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:09.634 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:09.634 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:09.669 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:09.670 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:09.670 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:09.667+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:09.703 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:09.703 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:09.737 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:09.737 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:09.750 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:09.750 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:09.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:09.770 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:09.771 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:09.771 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:09.771+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:09.874 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:09.871+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:09.941 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:09.941 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:09.959 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:09.972 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:09.967+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:10.073 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:10.067+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:10.129 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:10.129 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:10.146 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:10.191 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:10.191+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:10.274 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:10.271+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:10.316 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:10.317 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:10.335 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:10.376 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:10.371+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:10.477 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:10.471+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:10.549 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:10.549 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:10.567 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:10.578 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:10.575+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:10.678 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:10.675+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:10.739 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:10.739 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:10.757 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:56:10.802 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:10.799+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:10.881 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:10.875+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:10.888 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:10.888 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:10.902 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:56:10.994 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:10.991+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:11.068 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:11.068 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:11.083 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:56:11.083 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:11.079+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:11.183 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:11.179+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:11.246 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:11.246 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:11.261 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:11.284 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:11.283+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:11.385 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:11.383+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:11.427 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:11.427 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:11.441 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:11.485 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:11.483+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:11.563 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:11.563 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:11.579 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:11.626 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:11.623+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:11.629 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:56:11.688 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:11.687+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:11.703 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:11.703 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:11.717 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:11.788 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:11.787+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:11.795 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:11.881 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:11.881 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:11.889 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:11.887+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:11.896 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:11.990 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:11.987+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:11.999 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:11.999 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:12.030 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:12.030 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:12.056 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:12.057 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:12.061 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:12.061 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:12.072 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:12.091 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:12.091 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:12.118 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:12.115+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:12.122 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:12.122 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:12.153 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:12.153 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:12.186 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:12.186 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:12.192 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:12.187+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:12.199 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:12.199 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:12.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:12.199 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:12.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.199 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:36 5.1f 5:fbee7c44:::zone_info.18d444c7-8ee7-4acd-b619-be3783007e3d:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:12.199 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 88.490016034999996, 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031207560000000001, 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 36 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706791+0000", 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706793+0000", 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8700000000000001e-06 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706806+0000", 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2517000000000001e-05 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706838+0000", 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2696e-05 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706859+0000", 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0602999999999999e-05 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.706967+0000", 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010804 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707219+0000", 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025198400000000002 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.707561+0000", 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034196399999999999 2024-05-10T09:56:12.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709026+0000", 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014650220000000001 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709735+0000", 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00070893499999999995 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709829+0000", 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4512000000000006e-05 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.709912+0000", 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2613000000000003e-05 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4452.0:40 5.2 5:45008f9e:::zonegroup_info.7ed5aa02-6530-40ac-a0c4-a542d4dcfc40:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 88.479866686999998, 2024-05-10T09:56:12.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029898569999999998, 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4452", 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 40 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716941+0000", 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716943+0000", 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3290000000000001e-06 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716954+0000", 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1151e-05 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716982+0000", 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8102999999999998e-05 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.716996+0000", 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3925e-05 2024-05-10T09:56:12.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717103+0000", 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107341 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717319+0000", 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021598099999999999 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.717585+0000", 2024-05-10T09:56:12.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026570199999999998 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.718896+0000", 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013107329999999999 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719660+0000", 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00076403400000000002 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719812+0000", 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000151862 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:43.719930+0000", 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000118696 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:12.211 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 84.509998069999995, 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:56:12.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:56:12.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.217 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491083449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 84.481941372999998, 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056438870000000002, 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:12.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714866+0000", 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714869+0000", 2024-05-10T09:56:12.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1530000000000001e-06 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714883+0000", 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3966e-05 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714918+0000", 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.714939+0000", 2024-05-10T09:56:12.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1803000000000001e-05 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715096+0000", 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015674600000000001 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715312+0000", 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021537100000000001 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:12.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.715720+0000", 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040858700000000002 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720027+0000", 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043069450000000004 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720201+0000", 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017365300000000001 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720341+0000", 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014033900000000001 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.720510+0000", 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016870700000000001 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:12.223 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 84.467570262999999, 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024486970000000001, 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 54 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:12.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729237+0000", 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729239+0000", 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3539999999999998e-06 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729249+0000", 2024-05-10T09:56:12.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9119999999999993e-06 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729277+0000", 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7314e-05 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729292+0000", 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5767999999999999e-05 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729403+0000", 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110455 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729550+0000", 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147539 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.729683+0000", 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013315899999999999 2024-05-10T09:56:12.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.730654+0000", 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097056699999999998 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731578+0000", 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092409000000000002 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731637+0000", 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9249999999999997e-05 2024-05-10T09:56:12.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731686+0000", 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8288999999999998e-05 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491083444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 84.464884084000005, 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024788729999999999, 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.229 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 55 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731923+0000", 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731925+0000", 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.669e-06 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731933+0000", 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.14e-06 2024-05-10T09:56:12.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731962+0000", 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9488e-05 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.731980+0000", 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7445999999999999e-05 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732075+0000", 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5530000000000002e-05 2024-05-10T09:56:12.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732164+0000", 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8301999999999996e-05 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.732357+0000", 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000193184 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.733276+0000", 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091878000000000001 2024-05-10T09:56:12.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734262+0000", 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00098636800000000005 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734327+0000", 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5184000000000005e-05 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.734402+0000", 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4782000000000003e-05 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:191 6.5 e32/29 6:a2ace8b3:::data_log.0:head v 32'1, mlcod=0'0)", 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 84.369976890999993, 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001734527, 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.235 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826830+0000", 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826832+0000", 2024-05-10T09:56:12.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.747e-06 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826843+0000", 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.135e-05 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826871+0000", 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8056e-05 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.826888+0000", 2024-05-10T09:56:12.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6906999999999999e-05 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827041+0000", 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015288500000000001 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.827098+0000", 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6242999999999997e-05 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828494+0000", 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001396193 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.828565+0000", 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:209 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:12.239 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.450406676, 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027807750000000001, 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746401+0000", 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746402+0000", 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7300000000000004e-07 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746413+0000", 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.119e-05 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746486+0000", 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3237000000000004e-05 2024-05-10T09:56:12.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746508+0000", 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2186000000000001e-05 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746658+0000", 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014973499999999999 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.746708+0000", 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9772999999999999e-05 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749011+0000", 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023033720000000001 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.749181+0000", 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170309 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.243 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:217 6.15 e35/29 6:ab569f81:gc::gc.12:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.406676593, 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017069660000000001, 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.244 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790131+0000", 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790132+0000", 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7099999999999999e-06 2024-05-10T09:56:12.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790144+0000", 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1253000000000001e-05 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790173+0000", 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9036000000000001e-05 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790186+0000", 2024-05-10T09:56:12.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.327e-05 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790318+0000", 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013210500000000001 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.790352+0000", 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3906999999999999e-05 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791745+0000", 2024-05-10T09:56:12.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001392899 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.791838+0000", 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2786000000000002e-05 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:221 6.3 e35/29 6:c623b173:gc::gc.16:head v 35'3, mlcod=35'1)", 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.392063445999995, 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017273130000000001, 2024-05-10T09:56:12.248 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804744+0000", 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804746+0000", 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2500000000000001e-06 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804761+0000", 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5400000000000002e-05 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804798+0000", 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6999000000000003e-05 2024-05-10T09:56:12.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804820+0000", 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1379999999999999e-05 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.804971+0000", 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015081200000000001 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.805030+0000", 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8940000000000002e-05 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806391+0000", 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013609620000000001 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.806471+0000", 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0569999999999996e-05 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.252 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:325 6.1 e35/29 6:856b9b26:reshard::reshard.0000000002:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.317333886, 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020608940000000002, 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879473+0000", 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879474+0000", 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4300000000000001e-07 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879485+0000", 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0832999999999999e-05 2024-05-10T09:56:12.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879522+0000", 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6486999999999998e-05 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879562+0000", 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0522999999999998e-05 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879697+0000", 2024-05-10T09:56:12.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135136 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.879747+0000", 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9775999999999999e-05 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881413+0000", 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001666023 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.881534+0000", 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121173 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:391 6.c e35/29 6:3677c228:::obj_delete_at_hint.0000000006:head v 35'1, mlcod=0'0)", 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.299187523000001, 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017053070000000001, 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.257 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897620+0000", 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897621+0000", 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897634+0000", 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2252999999999999e-05 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897691+0000", 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7766999999999998e-05 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897710+0000", 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8666000000000001e-05 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897867+0000", 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156658 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.897913+0000", 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6589999999999999e-05 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899199+0000", 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012854769999999999 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.899325+0000", 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126286 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:469 6.1 e35/29 6:80b6fe23:reshard::reshard.0000000011:head v 35'4, mlcod=35'2)", 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.264433002999994, 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024638440000000002, 2024-05-10T09:56:12.261 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932374+0000", 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932376+0000", 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932387+0000", 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.132e-05 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932415+0000", 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7965000000000001e-05 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932432+0000", 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7370000000000001e-05 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932577+0000", 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014503399999999999 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.932610+0000", 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2224000000000002e-05 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934770+0000", 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021602969999999998 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934838+0000", 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8116999999999999e-05 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.265 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:470 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'6, mlcod=35'4)", 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.263358791000002, 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063518560000000003, 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933448+0000", 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933450+0000", 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8369999999999999e-06 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933462+0000", 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1326e-05 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933488+0000", 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6091000000000001e-05 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933522+0000", 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4412999999999997e-05 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933659+0000", 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013667900000000001 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933719+0000", 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0427000000000003e-05 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939709+0000", 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059900999999999999 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939800+0000", 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0983000000000006e-05 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:472 6.5 e35/29 6:a4a56432:::obj_delete_at_hint.0000000012:head v 35'5, mlcod=35'3)", 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.262866680000002, 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058753570000000003, 2024-05-10T09:56:12.270 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933941+0000", 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933942+0000", 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.35e-06 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933952+0000", 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.995e-06 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933977+0000", 2024-05-10T09:56:12.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5137999999999999e-05 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.933992+0000", 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4645e-05 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934114+0000", 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122571 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.934145+0000", 2024-05-10T09:56:12.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.044e-05 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939731+0000", 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055866359999999999 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.939816+0000", 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4581999999999998e-05 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:473 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'6, mlcod=35'3)", 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.260817090000003, 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044108289999999998, 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935990+0000", 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.935992+0000", 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.517e-06 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936003+0000", 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.184e-05 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936030+0000", 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6517e-05 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936047+0000", 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6745e-05 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936153+0000", 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000106557 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.936181+0000", 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7203e-05 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940329+0000", 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041485250000000001 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.940401+0000", 2024-05-10T09:56:12.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1925e-05 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:477 6.5 e35/29 6:a7f90313:reshard::reshard.0000000012:head v 35'7, mlcod=35'5)", 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.254572570999997, 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003325181, 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942235+0000", 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942236+0000", 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6169999999999999e-06 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942248+0000", 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1245e-05 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942269+0000", 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1639999999999999e-05 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942283+0000", 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4082e-05 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942420+0000", 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013650399999999999 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.942477+0000", 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6780000000000002e-05 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945461+0000", 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029839879999999999 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945560+0000", 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9325000000000002e-05 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:482 6.3 e35/29 6:c60da066:gc::gc.4:head v 35'8, mlcod=35'6)", 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.251358146000001, 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024020349999999998, 2024-05-10T09:56:12.283 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945449+0000", 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945451+0000", 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.007e-06 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945465+0000", 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3986e-05 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945494+0000", 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8875999999999999e-05 2024-05-10T09:56:12.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945514+0000", 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0276999999999999e-05 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945620+0000", 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105923 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.945646+0000", 2024-05-10T09:56:12.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5646000000000001e-05 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947738+0000", 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020923140000000001 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.947851+0000", 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113006 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:483 6.3 e35/29 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 35'9, mlcod=35'6)", 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.250184708000006, 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039312929999999998, 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946623+0000", 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946624+0000", 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9700000000000002e-06 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946641+0000", 2024-05-10T09:56:12.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6409000000000002e-05 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946674+0000", 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2607000000000001e-05 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946692+0000", 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8845999999999999e-05 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946860+0000", 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167796 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.946934+0000", 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3411999999999994e-05 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950471+0000", 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035375630000000001 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.950554+0000", 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2689999999999996e-05 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:548 6.15 e35/29 6:ae95b544:::obj_delete_at_hint.0000000020:head v 35'3, mlcod=35'1)", 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 81.198834331, 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002208406, 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.292 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997973+0000", 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997975+0000", 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7129999999999999e-06 2024-05-10T09:56:12.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.997988+0000", 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2937e-05 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998020+0000", 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2135999999999999e-05 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998038+0000", 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8179999999999999e-05 2024-05-10T09:56:12.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998186+0000", 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014844899999999999 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:50.998241+0000", 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.4703000000000001e-05 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000112+0000", 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018710319999999999 2024-05-10T09:56:12.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:51.000181+0000", 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9256000000000002e-05 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.296 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:12.297 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:12.298 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:12.299 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:12.295+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:12.399 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:12.395+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:12.468 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:12.469 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:12.469 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:12.469 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:12.483 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:12.499 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:12.499+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:12.600 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:12.599+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:12.650 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:12.650 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:12.650 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:12.650 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:12.650 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:12.664 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:12.710 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:12.707+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:12.792 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 105.25326675300001, 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.793 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:12.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:56:12.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:56:12.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.799 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.440165212, 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.44003633600001, 2024-05-10T09:56:12.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:56:12.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.439886996, 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:56:12.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:56:12.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:56:12.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:56:12.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.330816536, 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.817 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:56:12.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:56:12.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.330174077, 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.823 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:12.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:56:12.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:56:12.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.330053968, 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.829 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:56:12.834 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.329785007, 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.835 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:56:12.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:56:12.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.329722354, 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:56:12.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:56:12.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.846 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.32966604800001, 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:56:12.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:56:12.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.329473206, 2024-05-10T09:56:12.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:56:12.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:56:12.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:56:12.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.329433036, 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.858 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:56:12.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:56:12.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.863 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.32934781, 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:56:12.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:56:12.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.329155555, 2024-05-10T09:56:12.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:56:12.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.329119242, 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:56:12.875 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:56:12.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:56:12.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:56:12.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:56:12.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.076681679, 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.881 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:12.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.886 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.076566632, 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:56:12.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:12.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:56:12.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:56:12.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.892 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.076525768, 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.895 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.076486703, 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.898 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:12.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:56:12.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:56:12.903 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 104.07636048000001, 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:56:12.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:56:12.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:12.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:56:12.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:12.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:12.909 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:12.911 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:12.907+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:12.911 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:13.011 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:13.011+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:13.029 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:56:13.084 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:13.084 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:13.084 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:13.084 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:13.102 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:13.113 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:13.107+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:13.213 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:13.211+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:13.313 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:13.313 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:13.313 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:13.313 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:13.313 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:13.314 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:13.311+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:13.330 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:13.415 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:13.415+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:13.516 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:13.515+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:13.549 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:13.549 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.195526347, 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.819664132, 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.554 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:56:13.559 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.797041062999995, 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.560 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.754577788000006, 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.566 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:56:13.571 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.739941357999996, 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.572 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:56:13.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.710440446999996, 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.578 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.583 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.692161200000001, 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:56:13.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:56:13.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.639297356, 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:56:13.589 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:56:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.598540334000006, 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.595 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:56:13.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:56:13.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.564306697999996, 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:56:13.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.606 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.558479614000007, 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.607 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.608 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.609 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:56:13.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:56:13.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.527522360000006, 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.612 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:56:13.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:56:13.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.511312322999999, 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.618 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.620 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:56:13.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:56:13.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.623 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.433654364000006, 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.624 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:56:13.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:56:13.629 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.433520435000005, 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.630 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:56:13.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:56:13.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.634 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.399213216999996, 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.395354198000007, 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.641 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:56:13.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.164390539999999, 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.647 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:13.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:56:13.652 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 81.984188407999994, 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:13.658 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 52.650744238000001, 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003566343, 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1020 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896175+0000", 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5429999999999998e-06 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896193+0000", 2024-05-10T09:56:13.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8448999999999999e-05 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896233+0000", 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0228999999999997e-05 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896252+0000", 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9148999999999999e-05 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:13.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896422+0000", 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016917700000000001 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896661+0000", 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000239576 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.897003+0000", 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000341582 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.898376+0000", 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013735760000000001 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899568+0000", 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011918339999999999 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899659+0000", 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0895000000000003e-05 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:13.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:13.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899737+0000", 2024-05-10T09:56:13.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8332999999999997e-05 2024-05-10T09:56:13.664 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.664 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.664 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.664 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:13.664 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:13.664 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:13.665 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:13.666 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:13.659+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:13.767 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:13.767+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:13.867 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:13.863+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:13.878 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:13.878 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:13.878 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:13.878 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:13.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:13.969 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:13.963+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:14.067 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:14.067 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:14.067 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:14.067 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:14.068 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:14.070 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:14.067+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:14.086 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:14.170 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:14.167+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 90.610903268000001, 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:14.261 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:14.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:14.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:14.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.266 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 86.426919241999997, 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.267 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:56:14.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:56:14.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.272 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.523238812000002, 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:56:14.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:56:14.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:56:14.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.488523598, 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.279 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:56:14.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:56:14.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:56:14.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.284 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.462141618000004, 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:56:14.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.290 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.444111546000002, 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:14.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:56:14.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.410449275000005, 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:56:14.296 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:56:14.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:56:14.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.379720773000003, 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.302 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:14.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:56:14.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:56:14.307 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.326367962999996, 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.308 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:14.313 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.151169343000007, 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:56:14.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.061694048000007, 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:56:14.319 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:56:14.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:56:14.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:56:14.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 83.017300526, 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.325 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:56:14.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.944497558999998, 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.331 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:56:14.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:56:14.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.336 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.912607629000007, 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.907822349, 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:56:14.342 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:56:14.347 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.827096572000002, 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:56:14.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:56:14.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.823054787000004, 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:56:14.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:56:14.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:14.359 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.666765529000003, 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:14.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.662428406000004, 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.365 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.370 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 82.594569746999994, 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:14.371 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:56:14.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:14.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.376 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.377 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:14.377 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:14.377 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:14.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:14.379 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:14.379 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:14.375+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:14.479 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:14.479+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:14.580 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:14.579+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:14.591 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:14.591 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:14.591 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:14.591 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:14.607 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:14.611 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:14.612 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:14.643 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:14.643 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:14.674 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:14.674 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:14.680 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:14.675+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:14.705 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:14.705 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:14.722 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:14.722 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:14.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:14.738 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:14.738 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:14.771 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:14.772 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:14.781 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:14.779+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:14.805 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:14.805 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:14.839 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:14.839 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:14.850 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:14.850 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:14.866 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:14.882 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:14.879+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:14.982 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:14.979+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:15.016 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:15.016 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:15.033 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:15.057 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:56:15.083 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:15.079+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:15.184 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:15.183+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:15.185 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:15.185 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:15.200 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:15.285 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:15.283+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:15.314 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:15.314 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:15.329 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:56:15.385 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:15.383+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:15.460 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:15.460 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:15.474 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:56:15.518 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:15.515+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:15.587 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:15.583+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:15.593 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:15.593 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:15.608 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:56:15.688 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:15.687+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:15.776 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:15.776 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:15.789 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:15.783+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:15.790 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:15.890 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:15.887+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:15.960 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:15.960 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:15.974 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:16.018 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:16.015+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:16.039 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:56:16.107 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:16.107+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:16.139 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:16.139 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:16.153 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:16.198 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:16.195+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:16.278 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:16.278 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:16.292 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:16.338 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:16.335+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:16.440 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:16.435+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:16.459 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:16.460 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:16.474 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:16.562 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:16.559+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:16.635 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:16.636 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:16.641 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:16.635+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:16.649 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:16.742 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:16.739+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:16.814 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:16.815 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:16.828 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:16.864 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:16.874 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:16.871+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:16.944 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:16.939+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:16.951 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:16.951 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:16.965 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:17.058 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:17.055+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:17.064 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:17.064 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:17.095 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:17.096 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:17.126 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:17.126 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:17.135 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:17.135 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:17.145 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:17.139+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:17.149 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:17.156 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:17.157 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:17.187 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:17.187 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:17.217 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:17.217 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:17.246 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:17.243+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:17.249 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:17.249 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:17.282 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:17.282 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:17.312 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:17.312 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:17.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:17.312 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:17.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.312 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.312 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 109.77294946000001, 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:56:17.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:56:17.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:56:17.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:23 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 196608~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.959847919, 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010061593000000001, 2024-05-10T09:56:17.320 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 23 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349556+0000", 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349557+0000", 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6000000000000002e-07 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349653+0000", 2024-05-10T09:56:17.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6581000000000002e-05 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349664+0000", 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0366e-05 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349672+0000", 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.712e-06 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.353916+0000", 2024-05-10T09:56:17.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042445579999999998 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354161+0000", 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000244412 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.354573+0000", 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041292999999999999 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359368+0000", 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0047943730000000002 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359411+0000", 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3572000000000002e-05 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359497+0000", 2024-05-10T09:56:17.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5363000000000002e-05 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359618+0000", 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120866 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.326 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.95971904300001, 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010344290000000001, 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 24 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349685+0000", 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349686+0000", 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7300000000000005e-07 2024-05-10T09:56:17.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349801+0000", 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011548900000000001 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349812+0000", 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1092e-05 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349820+0000", 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6799999999999993e-06 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356614+0000", 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067937300000000004 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.356845+0000", 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023163099999999999 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.357196+0000", 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035105100000000001 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359648+0000", 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024521009999999999 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359758+0000", 2024-05-10T09:56:17.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000109712 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.359912+0000", 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015372199999999999 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360029+0000", 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117309 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.332 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.959569703, 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010977687999999999, 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.333 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 25 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349834+0000", 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349835+0000", 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7199999999999997e-07 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349840+0000", 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0989999999999998e-06 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349848+0000", 2024-05-10T09:56:17.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7980000000000006e-06 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.349855+0000", 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.357e-06 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358137+0000", 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082816720000000003 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358363+0000", 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022592900000000001 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.358734+0000", 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000371154 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360085+0000", 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013507910000000001 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360548+0000", 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046292099999999998 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360701+0000", 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015353900000000001 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.360812+0000", 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110556 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.339 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.850499243, 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01003219, 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 42 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458905+0000", 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458906+0000", 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5000000000000001e-07 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458912+0000", 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4899999999999997e-06 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458925+0000", 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.332e-05 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.458934+0000", 2024-05-10T09:56:17.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2800000000000003e-06 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.463795+0000", 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048616060000000001 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464050+0000", 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025459400000000002 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.464420+0000", 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00036974799999999998 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468725+0000", 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043050440000000001 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468745+0000", 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0299999999999999e-05 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468832+0000", 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6649000000000003e-05 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.468937+0000", 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105209 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.345 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.849856784, 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010747059999999999, 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.346 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 43 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459547+0000", 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459549+0000", 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459562+0000", 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2386e-05 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459594+0000", 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2296999999999999e-05 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459609+0000", 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4949999999999999e-05 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465619+0000", 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060096100000000003 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.465753+0000", 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000134382 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.466099+0000", 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00034550100000000001 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469032+0000", 2024-05-10T09:56:17.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029330570000000002 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470108+0000", 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001076252 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470182+0000", 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4596000000000002e-05 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470294+0000", 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011171900000000001 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.849736675, 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012048374000000001, 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.352 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 44 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459667+0000", 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459668+0000", 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1060000000000001e-06 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459785+0000", 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011616300000000001 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459807+0000", 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2325999999999999e-05 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459818+0000", 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0844e-05 2024-05-10T09:56:17.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467474+0000", 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076558679999999997 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467639+0000", 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165055 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.467845+0000", 2024-05-10T09:56:17.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206345 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471493+0000", 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036484120000000002 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471514+0000", 2024-05-10T09:56:17.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.022e-05 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471586+0000", 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2708999999999998e-05 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471716+0000", 2024-05-10T09:56:17.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000129326 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.849467714, 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013477853, 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.359 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 45 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459936+0000", 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459938+0000", 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4300000000000001e-06 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459946+0000", 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3969999999999994e-06 2024-05-10T09:56:17.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459969+0000", 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3166000000000001e-05 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459980+0000", 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0913999999999999e-05 2024-05-10T09:56:17.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469114+0000", 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091337190000000002 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469259+0000", 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014469299999999999 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.469482+0000", 2024-05-10T09:56:17.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000223778 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471845+0000", 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023631009999999998 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473232+0000", 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0013861699999999999 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473348+0000", 2024-05-10T09:56:17.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115969 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473414+0000", 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6515999999999998e-05 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:17.365 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.849405061, 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014717426, 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.459999+0000", 2024-05-10T09:56:17.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460000+0000", 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1399999999999996e-07 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460007+0000", 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9229999999999996e-06 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460032+0000", 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4902999999999999e-05 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460042+0000", 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0806e-05 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470393+0000", 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010351157999999999 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470544+0000", 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000150765 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.470814+0000", 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269521 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474549+0000", 2024-05-10T09:56:17.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003734958 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474581+0000", 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1983000000000002e-05 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474657+0000", 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6002999999999997e-05 2024-05-10T09:56:17.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474716+0000", 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9592000000000001e-05 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.84934875499999, 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.373 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:56:17.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:56:17.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:56:17.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:56:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:56:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:56:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.849155913, 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.379 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.381 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.849115743, 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.385 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:17.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:56:17.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:56:17.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.391 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.849030517, 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.392 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:56:17.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:56:17.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.848838262, 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.398 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:56:17.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:56:17.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.84880194900001, 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.404 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:56:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:56:17.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:56:17.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.596364386, 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010255382, 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.411 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 72 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713040+0000", 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8800000000000001e-07 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713115+0000", 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4381000000000005e-05 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713128+0000", 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3468e-05 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713136+0000", 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1280000000000008e-06 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719637+0000", 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065002530000000001 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719704+0000", 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7415000000000004e-05 2024-05-10T09:56:17.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.719808+0000", 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010389400000000001 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722206+0000", 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002398028 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723231+0000", 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001025081 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723267+0000", 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6229000000000002e-05 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723295+0000", 2024-05-10T09:56:17.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7617e-05 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.596249339, 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010371061000000001, 2024-05-10T09:56:17.418 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 73 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713155+0000", 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2399999999999997e-07 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713161+0000", 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6289999999999998e-06 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713172+0000", 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0747000000000001e-05 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713180+0000", 2024-05-10T09:56:17.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4579999999999993e-06 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720559+0000", 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073786700000000004 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720682+0000", 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122979 2024-05-10T09:56:17.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.720864+0000", 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000182313 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723306+0000", 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024414409999999999 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723387+0000", 2024-05-10T09:56:17.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1509999999999997e-05 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723468+0000", 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0338000000000002e-05 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723526+0000", 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8152000000000002e-05 2024-05-10T09:56:17.424 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.596208475, 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011073820999999999, 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.425 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 74 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713195+0000", 2024-05-10T09:56:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713196+0000", 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9400000000000004e-07 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713202+0000", 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.976e-06 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713214+0000", 2024-05-10T09:56:17.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1357e-05 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713222+0000", 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4549999999999995e-06 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721660+0000", 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0084377900000000006 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721721+0000", 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0856999999999997e-05 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.721826+0000", 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010485299999999999 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724059+0000", 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022333890000000001 2024-05-10T09:56:17.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724121+0000", 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1700999999999998e-05 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724212+0000", 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0865000000000005e-05 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724269+0000", 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7683999999999999e-05 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:17.434 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.59616941, 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011358666999999999, 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 75 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713235+0000", 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8299999999999996e-07 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713303+0000", 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7356999999999999e-05 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713315+0000", 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2234e-05 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713343+0000", 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8634000000000001e-05 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722262+0000", 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089188679999999999 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722341+0000", 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9011000000000006e-05 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.722506+0000", 2024-05-10T09:56:17.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016437099999999999 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724285+0000", 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017798040000000001 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724528+0000", 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024244499999999999 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724564+0000", 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5738000000000002e-05 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724593+0000", 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9522e-05 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.441 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 108.59604318700001, 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011755287999999999, 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:17.442 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 76 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713361+0000", 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713362+0000", 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1650000000000001e-06 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:17.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713368+0000", 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4439999999999996e-06 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713402+0000", 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4010000000000001e-05 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.713420+0000", 2024-05-10T09:56:17.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7972e-05 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723583+0000", 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010162585999999999 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723682+0000", 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9531999999999995e-05 2024-05-10T09:56:17.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.723788+0000", 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105795 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.724602+0000", 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00081403699999999999 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725044+0000", 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044194500000000001 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725085+0000", 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.725116+0000", 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1344999999999999e-05 2024-05-10T09:56:17.448 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:17.449 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:17.449 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:17.451 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:17.451+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:17.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:17.552 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:17.551+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:17.622 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:17.622 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:17.622 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:17.623 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:17.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:17.687 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:17.687+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:17.754 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:17.751+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:17.814 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:17.814 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:17.814 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:17.814 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:17.815 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:17.833 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:17.875 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:17.875+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:17.955 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:17.955+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:18.047 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 109.693608195, 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.048 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:56:18.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.052 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.317745979999998, 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.295122910999993, 2024-05-10T09:56:18.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:56:18.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:56:18.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.252659636000004, 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.065 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:56:18.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.238023205999994, 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.071 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:18.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:56:18.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.208522294999995, 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.077 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:56:18.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:56:18.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:56:18.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.190243047999999, 2024-05-10T09:56:18.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:56:18.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:56:18.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.089 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.137379203999998, 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:56:18.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:56:18.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.096622182000004, 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:56:18.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:56:18.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.062388545999994, 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:56:18.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:56:18.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.107 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.056561462000005, 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:56:18.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:56:18.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.113 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.025604208000004, 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.114 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:56:18.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.009394170999997, 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.120 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:56:18.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:56:18.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 86.931736212000004, 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:56:18.126 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:56:18.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:56:18.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 86.931602283000004, 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:56:18.132 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:56:18.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 86.897295064999994, 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:56:18.138 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:56:18.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:56:18.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 86.893436046000005, 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.144 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:18.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:56:18.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:56:18.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 86.662472387999998, 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.150 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:56:18.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 86.482270256000007, 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.156 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:56:18.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 57.148826086, 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003566343, 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.162 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1020 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896175+0000", 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5429999999999998e-06 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896193+0000", 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8448999999999999e-05 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896233+0000", 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0228999999999997e-05 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896252+0000", 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9148999999999999e-05 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896422+0000", 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016917700000000001 2024-05-10T09:56:18.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896661+0000", 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000239576 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.897003+0000", 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000341582 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.898376+0000", 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013735760000000001 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899568+0000", 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011918339999999999 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899659+0000", 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0895000000000003e-05 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899737+0000", 2024-05-10T09:56:18.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8332999999999997e-05 2024-05-10T09:56:18.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.168 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.168 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.168 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:18.169 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:56:18.170 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:18.170 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:18.167+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:18.270 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:18.267+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:18.371 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:18.367+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:18.384 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:18.384 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:18.384 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:18.384 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:18.405 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:18.472 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:18.467+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:18.572 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:18.567+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:18.619 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:18.619 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:18.619 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:18.619 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:18.619 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:18.638 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:18.683 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:18.683+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:18.773 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:18.771+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:18.813 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:18.813 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:18.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:18.813 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 95.163533337999993, 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:18.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:18.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:18.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.819 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 90.979549312000003, 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.820 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:56:18.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.825 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 88.075868881999995, 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:56:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:56:18.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:56:18.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 88.041153668000007, 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.832 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.833 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:18.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.834 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:56:18.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:56:18.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:56:18.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.839 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 88.014771687999996, 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.840 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:56:18.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:18.845 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.996741615999994, 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.963079344999997, 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.852 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:56:18.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:56:18.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.858 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.859 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:56:18.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:56:18.859 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.859 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.932350842999995, 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.860 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:56:18.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:56:18.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.866 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.878998033000002, 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.867 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:18.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:56:18.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.703799412999999, 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.874 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.614324117999999, 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:56:18.881 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:18.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:56:18.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.569930596000006, 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:56:18.888 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.889 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:56:18.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:56:18.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:56:18.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:56:18.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.497127629000005, 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.895 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:56:18.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:56:18.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:56:18.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:56:18.901 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.465237698999999, 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.902 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:56:18.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:56:18.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:56:18.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.460452419000006, 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:56:18.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.913 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:56:18.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.915 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.379726641999994, 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.916 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:56:18.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:56:18.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.375684856999996, 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.923 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:56:18.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.927 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.928 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.219395598999995, 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:56:18.929 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.930 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:56:18.931 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:56:18.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.215058475999996, 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.936 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.937 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:56:18.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:56:18.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.942 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 87.147199817000001, 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.943 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:56:18.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:56:18.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:18.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:18.949 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:56:18.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:56:18.949 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.949 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.949 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.949 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:18.949 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:18.949 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:18.951 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:18.951 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:18.947+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:19.052 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:19.047+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:19.152 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:19.151+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:19.165 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:19.166 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:19.166 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:19.166 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:19.183 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:19.253 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:19.247+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:19.267 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:56:19.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:19.391 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:19.391+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:19.399 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:19.399 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:19.399 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:19.399 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:19.399 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:19.418 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:19.454 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:19.451+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:19.544 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:19.544 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:19.554 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:19.551+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:19.575 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:19.607 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:19.607 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:19.631 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:19.631 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:19.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:19.638 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:19.650 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:19.672 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:19.672 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:19.673 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:19.671+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:19.705 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:19.706 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:19.739 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:19.739 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:19.756 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:19.755+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:19.772 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:19.772 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:19.845 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:19.858 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:19.855+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:19.864 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:19.958 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:19.955+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:20.034 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:20.034 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:20.054 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:20.096 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:20.095+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:20.160 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:20.155+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:20.261 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:20.255+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:20.264 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:20.264 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:20.281 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:56:20.361 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:20.359+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:20.413 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:20.413 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:20.428 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:56:20.470 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:20.467+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:20.563 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:20.563+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:20.592 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:20.593 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:20.607 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:56:20.664 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:20.659+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:20.725 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:20.725 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:20.740 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:20.782 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:20.779+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:20.865 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:20.863+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:20.903 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:20.903 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:20.917 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:20.966 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:20.963+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:21.039 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:21.039 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:21.053 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:21.098 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:21.095+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:21.167 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:21.167+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:21.170 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:21.171 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:21.185 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:21.268 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:21.267+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:21.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:56:21.348 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:21.348 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:21.363 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:21.369 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:21.367+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:21.474 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:21.471+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:21.485 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:21.485 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:21.499 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:21.571 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:21.571+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:21.621 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:21.621 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:21.635 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:21.682 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:21.679+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:21.754 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:21.755 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:21.769 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:21.773 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:21.771+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:21.795 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:21.873 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:21.871+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:21.935 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:21.935 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:21.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:21.994 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:21.994 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:21.991+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:21.995 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:22.025 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:22.055 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:22.056 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:22.073 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:22.073 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:22.075 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:22.075+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:22.086 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:22.087 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:22.087 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:22.118 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:22.118 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:22.150 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:22.151 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:22.176 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:22.175+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:22.183 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:22.183 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:22.216 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:22.217 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:22.261 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:22.261 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:22.261 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:22.276 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:22.275+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:22.278 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:56:22.378 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:22.375+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:22.470 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:22.471 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:22.471 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:22.471 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:22.471 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:22.478 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:22.475+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:22.490 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:22.579 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:22.575+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:22.679 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:22.679+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 114.349655574, 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.704 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:56:22.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.973793358999998, 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.709 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:56:22.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:22.715 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.951170289999993, 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:56:22.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:56:22.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:56:22.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:56:22.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:56:22.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:56:22.722 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.908707015000005, 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.723 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:56:22.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:56:22.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:56:22.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:56:22.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:56:22.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:56:22.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:56:22.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:22.730 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.894070584999994, 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:56:22.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:56:22.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:56:22.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:56:22.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:56:22.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.864569673999995, 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.738 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:22.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:56:22.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:56:22.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:22.743 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.846290427, 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.748 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.793426582999999, 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:56:22.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:56:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:56:22.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:56:22.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.754 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.752669561000005, 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.755 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:22.760 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.718435924999994, 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:56:22.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:56:22.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:56:22.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.712608841000005, 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.766 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:56:22.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.769 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:56:22.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.681651587000005, 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.772 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:56:22.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.777 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.665441549999997, 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:56:22.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:56:22.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:56:22.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:56:22.783 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.587783591000004, 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.784 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.587649662000004, 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:56:22.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:56:22.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.795 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.553342443999995, 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:56:22.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:56:22.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.549483425000005, 2024-05-10T09:56:22.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:56:22.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.318519766999998, 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.807 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.138317635000007, 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.813 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:56:22.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 61.804873465, 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003566343, 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1020 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896175+0000", 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5429999999999998e-06 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896193+0000", 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8448999999999999e-05 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896233+0000", 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0228999999999997e-05 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896252+0000", 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9148999999999999e-05 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896422+0000", 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016917700000000001 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896661+0000", 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000239576 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.897003+0000", 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000341582 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.898376+0000", 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013735760000000001 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899568+0000", 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011918339999999999 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899659+0000", 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0895000000000003e-05 2024-05-10T09:56:22.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899737+0000", 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8332999999999997e-05 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:22.824 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:22.826 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:22.826 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:22.823+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:22.926 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:22.923+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:23.027 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:23.023+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:23.037 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:23.038 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:23.038 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:23.038 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:23.056 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:23.143 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:23.143+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:23.229 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:23.227+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:23.268 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:23.269 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:23.269 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:23.269 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:23.269 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:23.286 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:23.330 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:23.327+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:23.431 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:23.427+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:23.499 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:23.499 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:23.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:23.499 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:23.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 99.849089001999999, 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.500 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:23.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.505 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 95.665104975999995, 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:56:23.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.511 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.761424546000001, 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.512 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:56:23.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:56:23.518 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.726709331999999, 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.519 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:56:23.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.700327352000002, 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:56:23.525 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:56:23.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:56:23.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.531 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.68229728, 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:56:23.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:56:23.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.648635009000003, 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.538 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:56:23.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:56:23.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:56:23.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.617906507000001, 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:56:23.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:56:23.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.548 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.564553696999994, 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:56:23.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.555 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.555 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:23.555 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.389355077000005, 2024-05-10T09:56:23.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:56:23.555 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.555 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:23.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:56:23.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.299879782000005, 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:56:23.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:56:23.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.567 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.255486259999998, 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:56:23.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:56:23.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:56:23.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.182683292999997, 2024-05-10T09:56:23.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:56:23.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:56:23.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.150793363000005, 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.579 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:56:23.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.146008082999998, 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.585 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:56:23.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.590 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.065282306, 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:23.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:56:23.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.061240521000002, 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.596 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:56:23.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:56:23.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.904951263000001, 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:56:23.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:56:23.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.608 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.900614140000002, 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:56:23.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:56:23.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 91.832755481000007, 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.615 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:23.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:23.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:23.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:56:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:56:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:23.620 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:23.620 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:23.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:23.622 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:23.619+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:23.722 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:23.719+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:23.793 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:23.794 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:23.794 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:23.811 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:23.855 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:23.855+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:23.924 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:23.923+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:23.982 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:23.982 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:23.982 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:23.982 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:23.982 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:23.999 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:24.025 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:24.023+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:24.126 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:24.123+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.493299924, 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.220 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:56:24.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:56:24.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.492830850999994, 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:56:24.226 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.227 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.228 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:56:24.229 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:56:24.230 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:56:24.231 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 93.358572683999995, 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.232 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:24.233 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.234 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.235 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.236 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.237 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 93.345145368999994, 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:56:24.238 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.239 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:56:24.240 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:56:24.241 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:56:24.242 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.998498484999999, 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.243 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:24.244 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:56:24.245 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.246 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:56:24.247 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:56:24.248 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.994559709000001, 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.249 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.250 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.251 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.252 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:56:24.253 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.955618478999995, 2024-05-10T09:56:24.254 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.255 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.256 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.257 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.259 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.820326898000005, 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:56:24.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.816567797999994, 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.265 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:56:24.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:56:24.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:56:24.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.765140270000003, 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.271 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.761545127999995, 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:56:24.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:56:24.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.751685162000001, 2024-05-10T09:56:24.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:56:24.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.704069008999994, 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.288 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:56:24.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.699971224999999, 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.294 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:56:24.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:56:24.299 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.611042729000005, 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.300 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:56:24.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.305 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.606107097000006, 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:56:24.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:56:24.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:56:24.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.512945449, 2024-05-10T09:56:24.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:56:24.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.508744930999995, 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:56:24.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:56:24.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.322 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.498887734999997, 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.323 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:56:24.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 92.494218204000006, 2024-05-10T09:56:24.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:56:24.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.333 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.334 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:24.334 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:24.334 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:24.334 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:24.335 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:56:24.336 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:24.331+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:24.337 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:24.436 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:24.431+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:24.519 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:24.520 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:24.536 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:24.535+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:24.542 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:24.542 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:24.542 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:24.543 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:24.550 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:24.550 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:24.558 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:24.581 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:24.604 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:24.604 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:24.637 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:24.637 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:24.631+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:24.637 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:24.669 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:24.669 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:24.690 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:24.690 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:24.691 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:24.692 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:24.707 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:24.712 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:24.712 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:24.738 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:24.735+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:24.825 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:24.839 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:56:24.839 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:24.835+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:24.939 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:24.935+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:24.969 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:24.969 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:24.984 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:56:25.074 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:25.071+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:25.141 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:25.135+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:25.154 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:25.154 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:25.170 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:56:25.243 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:25.239+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:25.297 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:56:25.334 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:25.334 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:25.349 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:25.367 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:25.367+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:25.444 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:25.439+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:25.465 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:25.465 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:25.480 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:25.566 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:25.563+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:25.645 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:25.645 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:25.646 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:25.643+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:25.663 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:25.758 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:25.755+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:25.836 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:25.836 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:25.847 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:25.843+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:25.850 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:25.948 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:25.943+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:26.021 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:26.021 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:26.034 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:26.049 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:26.047+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:26.150 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:26.147+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:26.200 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:26.201 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:26.215 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:26.258 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:26.255+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:26.352 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:26.351+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:26.385 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:26.386 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:26.400 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:26.452 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:26.447+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:26.518 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:26.518 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:26.533 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:26.553 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:26.550+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:26.654 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:26.650+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:26.695 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:26.695 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:26.709 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:26.732 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:26.779 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:26.778+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:26.831 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:26.831 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:26.846 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:26.855 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:26.851+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:26.872 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:26.873 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:26.889 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:26.889 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:26.906 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:26.906 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:26.922 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:26.922 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:26.943 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:26.943 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:26.957 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:26.951+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:26.962 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:26.962 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:26.962 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:26.962 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:26.963 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:26.964 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:26.976 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:26.985 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:26.985 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:27.005 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:27.006 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:27.008 INFO:tasks.workunit.client.0.smithi042.stderr:Updating files: 94% (11652/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-10T09:56:27.067 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:27.066+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:27.100 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:27.100 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:27.100 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:27.100 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:27.100 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:27.114 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:27.199 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:27.198+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:27.260 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:27.258+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 118.93256463199999, 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.287 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:56:27.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.291 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.556702416999997, 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.292 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:27.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:56:27.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.534079348000006, 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.297 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:27.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.491616073000003, 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.476979643000007, 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.309 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:27.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:56:27.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:56:27.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:56:27.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.447478731999993, 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:56:27.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:56:27.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.320 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.429199484999998, 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:27.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:56:27.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:56:27.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.376335640999997, 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.326 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.331 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.335578619000003, 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:27.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:56:27.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:56:27.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:56:27.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.336 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.301344983000007, 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:56:27.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.295517899000004, 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:56:27.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:56:27.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:56:27.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:56:27.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:56:27.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.264560645000003, 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.349 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:56:27.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:56:27.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.248350607999996, 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.355 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.357 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.357 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.357 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.357 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:56:27.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.357 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:56:27.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:56:27.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.362 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.170692649000003, 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:56:27.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:56:27.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.368 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.170558720000002, 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:56:27.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:56:27.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.136251501999993, 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.374 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:56:27.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:56:27.379 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.132392483000004, 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.380 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:56:27.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:56:27.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:56:27.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:27.385 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 95.901428824999996, 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 95.721226693000006, 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.391 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 66.387782522999998, 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003566343, 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1020 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896175+0000", 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5429999999999998e-06 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896193+0000", 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8448999999999999e-05 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896233+0000", 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0228999999999997e-05 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896252+0000", 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9148999999999999e-05 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896422+0000", 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016917700000000001 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896661+0000", 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000239576 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.897003+0000", 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000341582 2024-05-10T09:56:27.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.898376+0000", 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013735760000000001 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899568+0000", 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011918339999999999 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899659+0000", 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0895000000000003e-05 2024-05-10T09:56:27.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899737+0000", 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8332999999999997e-05 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.402 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:27.402 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:56:27.404 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr:Note: switching to '5be95034c7c2ad8a0361951b19205b782eb6be06'. 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by switching back to a branch. 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-10T09:56:27.405 INFO:tasks.workunit.client.0.smithi042.stderr: git switch -c 2024-05-10T09:56:27.406 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-10T09:56:27.406 INFO:tasks.workunit.client.0.smithi042.stderr:Or undo this operation with: 2024-05-10T09:56:27.406 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-10T09:56:27.406 INFO:tasks.workunit.client.0.smithi042.stderr: git switch - 2024-05-10T09:56:27.406 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-10T09:56:27.406 INFO:tasks.workunit.client.0.smithi042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-10T09:56:27.406 INFO:tasks.workunit.client.0.smithi042.stderr: 2024-05-10T09:56:27.406 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at 5be95034c7c rgw/cloud-transition: Use set_atomic() while updating HEAD 2024-05-10T09:56:27.407 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-10T09:56:27.407 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:27.403+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:27.455 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-10T09:56:27.457 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T09:56:27.457 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-10T09:56:27.505 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:27.503+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:27.561 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:27.561 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:27.561 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:27.561 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:27.576 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:27.623 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:27.622+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:27.707 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:27.706+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:27.735 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:27.735 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:27.735 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:27.735 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:27.735 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:27.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:27.835 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:27.834+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:27.902 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:27.902 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:27.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:27.902 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 104.252705604, 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.903 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:27.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:27.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.906 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.06872157799999, 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031192250000000002, 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.908 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 193 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831205+0000", 2024-05-10T09:56:27.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831207+0000", 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.12e-06 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831219+0000", 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.203e-05 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831254+0000", 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4279999999999997e-05 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831278+0000", 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3827000000000001e-05 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831409+0000", 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000131719 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831617+0000", 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000207868 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.831916+0000", 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029886099999999998 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.833493+0000", 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001577059 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.912 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834152+0000", 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065892499999999998 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834258+0000", 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106339 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.834325+0000", 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6197000000000003e-05 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.165041148, 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:56:27.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.918 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.919 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.130325933999998, 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.920 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:56:27.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:56:27.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.925 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.103943954000002, 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.926 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.927 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:56:27.930 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.085913882, 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.931 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:56:27.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:56:27.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.936 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.052251611000003, 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.937 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.942 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.021523109, 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.943 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:56:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:56:27.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:469 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.968170298999993, 2024-05-10T09:56:27.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030342210000000001, 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 469 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931757+0000", 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6300000000000004e-07 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931761+0000", 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7500000000000001e-06 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931772+0000", 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0525e-05 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931779+0000", 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6159999999999996e-06 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931824+0000", 2024-05-10T09:56:27.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.473e-05 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931874+0000", 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0173999999999998e-05 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.931979+0000", 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104689 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.932493+0000", 2024-05-10T09:56:27.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051429899999999996 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934738+0000", 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022450909999999998 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934769+0000", 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0331000000000001e-05 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.934791+0000", 2024-05-10T09:56:27.953 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2252999999999999e-05 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:682 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.792971679000004, 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029772869999999999, 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.954 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 682 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106955+0000", 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106957+0000", 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3650000000000001e-06 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106978+0000", 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1679999999999999e-05 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107001+0000", 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2829000000000001e-05 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107018+0000", 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6784999999999999e-05 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107167+0000", 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014892200000000001 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107418+0000", 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025074199999999998 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107818+0000", 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040006699999999999 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.108698+0000", 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087998600000000003 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109705+0000", 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00100759 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109836+0000", 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013067299999999999 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.109933+0000", 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6648e-05 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.959 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.703496384000005, 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:27.960 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:56:27.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:56:27.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:56:27.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:56:27.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.659102861999997, 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029288489999999999, 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.965 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 751 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240824+0000", 2024-05-10T09:56:27.966 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240826+0000", 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2699999999999999e-06 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240839+0000", 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2486e-05 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240869+0000", 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.01e-05 2024-05-10T09:56:27.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.240884+0000", 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4844000000000001e-05 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241004+0000", 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119862 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241234+0000", 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023073500000000001 2024-05-10T09:56:27.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.241557+0000", 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032283099999999999 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.242661+0000", 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001103885 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243529+0000", 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00086814399999999995 2024-05-10T09:56:27.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243615+0000", 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5776e-05 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.243753+0000", 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137916 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.586299894999996, 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.971 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.972 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.554409965000005, 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.976 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:56:27.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:56:27.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:56:27.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.549624684999998, 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.982 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:56:27.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:56:27.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:56:27.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:27.987 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.468898908, 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030147020000000002, 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 832 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:27.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431028+0000", 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431030+0000", 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3199999999999998e-06 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431042+0000", 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1997000000000001e-05 2024-05-10T09:56:27.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431073+0000", 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1046000000000001e-05 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431088+0000", 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5084e-05 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431217+0000", 2024-05-10T09:56:27.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012849199999999999 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431433+0000", 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021563800000000001 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.431791+0000", 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035850500000000001 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433066+0000", 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001275301 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433879+0000", 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081264 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.433977+0000", 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8048999999999996e-05 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.434043+0000", 2024-05-10T09:56:27.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5629999999999993e-05 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.464857123000002, 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029259590000000001, 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.993 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 834 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435070+0000", 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435072+0000", 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8959999999999999e-06 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435082+0000", 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.077e-05 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435109+0000", 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6597e-05 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435126+0000", 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7260000000000001e-05 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435266+0000", 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013995500000000001 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435401+0000", 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135053 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.435679+0000", 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027728799999999999 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.436856+0000", 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011776720000000001 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437837+0000", 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00098032299999999996 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437929+0000", 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1972000000000006e-05 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.437996+0000", 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7173000000000002e-05 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.998 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.308567865000001, 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:27.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:56:28.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:56:28.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:56:28.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.304230742000001, 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.004 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:56:28.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.009 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.236372083000006, 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029861520000000002, 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 931 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.010 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663555+0000", 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663557+0000", 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663569+0000", 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2013e-05 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663601+0000", 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1733000000000003e-05 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663616+0000", 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5302999999999999e-05 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.663761+0000", 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014517299999999999 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664093+0000", 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033105100000000001 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:28.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.664637+0000", 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054458900000000005 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.665769+0000", 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011314020000000001 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666388+0000", 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00061924899999999999 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666473+0000", 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5399e-05 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.666541+0000", 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7830000000000006e-05 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.015 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:28.016 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:28.017 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:28.015+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:28.118 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:28.119+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:28.194 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-10T09:56:28.194 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:28.194 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:28.194 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:28.194 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:28.209 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:28.255 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:28.254+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-10T09:56:28.319 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:28.315+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:28.323 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:56:28.328 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:28.329 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:28.329 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:28.329 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:28.329 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:28.338 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T09:56:28.339 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T09:56:28.339 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-10T09:56:28.347 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:28.383 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T09:56:28.386 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-10T09:56:28.386 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-10T09:56:28.428 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:28.426+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:28.431 INFO:tasks.workunit:Running workunits matching rgw/s3_multipart_upload.pl on client.0... 2024-05-10T09:56:28.432 INFO:tasks.workunit:Running workunit rgw/s3_multipart_upload.pl... 2024-05-10T09:56:28.433 DEBUG:teuthology.orchestra.run.smithi042:workunit test rgw/s3_multipart_upload.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5be95034c7c2ad8a0361951b19205b782eb6be06 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_multipart_upload.pl 2024-05-10T09:56:28.496 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:28.496 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:28.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:28.496 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 104.771223664, 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.497 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.770754591, 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:56:28.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:28.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.508 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.636496424000001, 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:28.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.623069108999999, 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:56:28.514 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.519 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.276422225000005, 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.520 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:56:28.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:56:28.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:56:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:56:28.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.272483449000006, 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002662481, 2024-05-10T09:56:28.525 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 744 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222312+0000", 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222314+0000", 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222326+0000", 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1803e-05 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222358+0000", 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222376+0000", 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8263000000000001e-05 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222488+0000", 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112656 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222613+0000", 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124473 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.222887+0000", 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027374399999999997 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224134+0000", 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012477149999999999 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224814+0000", 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00067972900000000001 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224908+0000", 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3974999999999994e-05 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.224975+0000", 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6379999999999998e-05 2024-05-10T09:56:28.530 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.233542219, 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.531 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:56:28.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:56:28.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.536 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.098250637999996, 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002707423, 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 817 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396545+0000", 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396548+0000", 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7300000000000001e-06 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396560+0000", 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2819e-05 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396593+0000", 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2830000000000002e-05 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396615+0000", 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1987000000000001e-05 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396753+0000", 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.396983+0000", 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000229638 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.397306+0000", 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032272399999999998 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.398398+0000", 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001092532 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399081+0000", 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068316600000000002 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399183+0000", 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101363 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.399252+0000", 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9485000000000003e-05 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.094491538, 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026548940000000001, 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.542 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 819 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400304+0000", 2024-05-10T09:56:28.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400305+0000", 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4729999999999999e-06 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400314+0000", 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5369999999999997e-06 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400338+0000", 2024-05-10T09:56:28.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3708999999999999e-05 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400358+0000", 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0129999999999999e-05 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400486+0000", 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128396 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400633+0000", 2024-05-10T09:56:28.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014704900000000001 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.400908+0000", 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274775 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402065+0000", 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001157005 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402806+0000", 2024-05-10T09:56:28.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074058800000000003 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402896+0000", 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0086000000000005e-05 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.402959+0000", 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3145999999999995e-05 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.043064009999995, 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026936479999999999, 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 841 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451731+0000", 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451734+0000", 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4729999999999999e-06 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451747+0000", 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451777+0000", 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0187000000000001e-05 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451792+0000", 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5566999999999999e-05 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.451906+0000", 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114079 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452150+0000", 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024385100000000001 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.452461+0000", 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031102499999999998 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.453476+0000", 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001014353 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454264+0000", 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078835799999999996 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454354+0000", 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0305999999999999e-05 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.454425+0000", 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0869000000000002e-05 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.039468868, 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002705921, 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.553 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 843 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455327+0000", 2024-05-10T09:56:28.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455328+0000", 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.796e-06 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455340+0000", 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1147e-05 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455363+0000", 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3816999999999999e-05 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455376+0000", 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2386e-05 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455475+0000", 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9488999999999996e-05 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455616+0000", 2024-05-10T09:56:28.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140486 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.455921+0000", 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030495799999999998 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.456984+0000", 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001063762 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457787+0000", 2024-05-10T09:56:28.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080276499999999999 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.457906+0000", 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118449 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.458033+0000", 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126866 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.558 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.029608902000007, 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.559 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:56:28.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:56:28.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:56:28.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.981992749, 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.564 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:28.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:56:28.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.977894965000004, 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.570 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:56:28.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:56:28.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:56:28.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.888966468999996, 2024-05-10T09:56:28.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.580 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.884030836999997, 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:56:28.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:56:28.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:56:28.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:56:28.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.790869189000006, 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.586 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:28.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:56:28.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:56:28.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:56:28.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.786668671000001, 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002659607, 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 951 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708127+0000", 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708129+0000", 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7400000000000001e-06 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708137+0000", 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7800000000000006e-06 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708165+0000", 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7636000000000001e-05 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708184+0000", 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8660000000000001e-05 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708312+0000", 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012866900000000001 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708452+0000", 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000139639 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.708729+0000", 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027720499999999999 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.709707+0000", 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097798299999999998 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710620+0000", 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091284999999999999 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710701+0000", 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1366000000000007e-05 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.710786+0000", 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5079000000000003e-05 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.776811475000002, 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.597 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.599 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 96.772141943999998, 2024-05-10T09:56:28.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.604 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.605 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:56:28.606 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:56:28.607 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.608 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.608 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.608 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:28.608 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:28.608 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:28.609 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:28.609 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:28.606+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:28.710 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:28.711+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:28.774 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:28.774 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:28.774 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:28.774 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:28.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:28.811 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:28.811+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:28.912 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:28.907+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:28.912 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:28.913 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:28.913 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:28.913 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:28.913 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:28.929 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:29.013 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:29.011+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:29.024 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 103.37338768799999, 2024-05-10T09:56:29.056 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086496530000000002, 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 44 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679869+0000", 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3719999999999999e-06 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679880+0000", 2024-05-10T09:56:29.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0854e-05 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679902+0000", 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2464e-05 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679932+0000", 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9726999999999998e-05 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.059 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680032+0000", 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010032299999999999 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680042+0000", 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3510000000000008e-06 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688283+0000", 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082418319999999993 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688516+0000", 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023273 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 98.322235387000006, 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035922279999999998, 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.061 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 207 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731019+0000", 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731022+0000", 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7140000000000002e-06 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731035+0000", 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3339999999999999e-05 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731069+0000", 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4102e-05 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731086+0000", 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6889999999999999e-05 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731309+0000", 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022293599999999999 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.731595+0000", 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028612400000000001 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.732083+0000", 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048802300000000003 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.733712+0000", 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001629339 2024-05-10T09:56:29.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734464+0000", 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075213400000000001 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734544+0000", 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9653000000000005e-05 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.066 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734611+0000", 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6972999999999997e-05 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 98.268452248000003, 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003743836, 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.067 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 216 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784805+0000", 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5730000000000002e-06 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784817+0000", 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.277e-05 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784854+0000", 2024-05-10T09:56:29.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6205999999999999e-05 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784873+0000", 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9749999999999999e-05 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785009+0000", 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013592300000000001 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785241+0000", 2024-05-10T09:56:29.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000232031 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785673+0000", 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043218999999999999 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.787225+0000", 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015515259999999999 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788269+0000", 2024-05-10T09:56:29.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001043906 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788425+0000", 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155742 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788546+0000", 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012121900000000001 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 98.228368809000003, 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034684479999999998, 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 227 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824885+0000", 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824888+0000", 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6960000000000001e-06 2024-05-10T09:56:29.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824901+0000", 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3144e-05 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824932+0000", 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0273e-05 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.824948+0000", 2024-05-10T09:56:29.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6402999999999999e-05 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825065+0000", 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011705300000000001 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825277+0000", 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021180099999999999 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:29.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.825698+0000", 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042071399999999998 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.827222+0000", 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015247489999999999 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828074+0000", 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085207100000000003 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828231+0000", 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015675199999999999 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.828354+0000", 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012279200000000001 2024-05-10T09:56:29.078 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.081 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.081 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.081 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.081 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:56:29.081 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 98.22027464, 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032440870000000001, 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 229 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:56:29.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832980+0000", 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832982+0000", 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6429999999999999e-06 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.832995+0000", 2024-05-10T09:56:29.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2979999999999999e-05 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833026+0000", 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0383e-05 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833041+0000", 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4922999999999999e-05 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833158+0000", 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011791299999999999 2024-05-10T09:56:29.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833366+0000", 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020795500000000001 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.833777+0000", 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000410331 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.835291+0000", 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015140329999999999 2024-05-10T09:56:29.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836021+0000", 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00073029400000000004 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836105+0000", 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3666999999999997e-05 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836224+0000", 2024-05-10T09:56:29.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118965 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 98.213065143999998, 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034732550000000002, 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.087 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 231 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840189+0000", 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840191+0000", 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.996e-06 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840203+0000", 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1523e-05 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840229+0000", 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6713e-05 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840244+0000", 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4243999999999999e-05 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840361+0000", 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011759199999999999 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.840612+0000", 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025127500000000002 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:29.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.841027+0000", 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00041445099999999998 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.842473+0000", 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001446536 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843387+0000", 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091381700000000004 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843543+0000", 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155379 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.843662+0000", 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011972900000000001 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:680 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.948718408000005, 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029268050000000002, 2024-05-10T09:56:29.092 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 680 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104536+0000", 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104538+0000", 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4399999999999999e-06 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104552+0000", 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104589+0000", 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6671000000000002e-05 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104607+0000", 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7943000000000001e-05 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104729+0000", 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012238700000000001 2024-05-10T09:56:29.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.104918+0000", 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018902200000000001 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.105255+0000", 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033649500000000002 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.106322+0000", 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001067389 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107175+0000", 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085289000000000003 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107340+0000", 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016486199999999999 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.107463+0000", 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012261999999999999 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.863301751999998, 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029077830000000002, 2024-05-10T09:56:29.098 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 730 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189953+0000", 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189955+0000", 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1600000000000001e-06 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189966+0000", 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1739999999999999e-05 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.189998+0000", 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1229999999999997e-05 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190012+0000", 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4769e-05 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190156+0000", 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014340300000000001 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190368+0000", 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000211895 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.190680+0000", 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031250499999999998 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.191743+0000", 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010630749999999999 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192700+0000", 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095679700000000001 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192785+0000", 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5205999999999997e-05 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.192860+0000", 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5003e-05 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.103 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.849695108999995, 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033316309999999998, 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 736 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.104 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203559+0000", 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203561+0000", 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3439999999999999e-06 2024-05-10T09:56:29.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203573+0000", 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1996e-05 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203611+0000", 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7577000000000003e-05 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203626+0000", 2024-05-10T09:56:29.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5217e-05 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.203813+0000", 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018622499999999999 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204026+0000", 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000213542 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.204352+0000", 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032619799999999998 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.205489+0000", 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011368649999999999 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206609+0000", 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011194919999999999 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206768+0000", 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015959200000000001 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.206891+0000", 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122583 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.845412461999999, 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031971209999999998, 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 738 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.110 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207842+0000", 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207844+0000", 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7269999999999999e-06 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207853+0000", 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8630000000000003e-06 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207879+0000", 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5219999999999999e-05 2024-05-10T09:56:29.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.207891+0000", 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.258e-05 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208029+0000", 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013824599999999999 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208278+0000", 2024-05-10T09:56:29.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024847399999999999 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.208777+0000", 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049937099999999997 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210173+0000", 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013959560000000001 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210892+0000", 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071904200000000003 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.210976+0000", 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4105999999999997e-05 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.211039+0000", 2024-05-10T09:56:29.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2535999999999999e-05 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.692821601000006, 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003393713, 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.116 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 802 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360433+0000", 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360435+0000", 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.08e-06 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360446+0000", 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1457000000000001e-05 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360476+0000", 2024-05-10T09:56:29.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0153000000000001e-05 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360491+0000", 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5024e-05 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.360652+0000", 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361013+0000", 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036118400000000002 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.361578+0000", 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056503900000000004 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.362848+0000", 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001270094 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363541+0000", 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069264200000000004 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363699+0000", 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158672 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.363826+0000", 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012694599999999999 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.688222330000002, 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003036015, 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 804 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.122 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365032+0000", 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365034+0000", 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.03e-06 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365045+0000", 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.114e-05 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365079+0000", 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3726000000000002e-05 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365094+0000", 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5384e-05 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365225+0000", 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013112900000000001 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365460+0000", 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000234754 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.365938+0000", 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047798399999999998 2024-05-10T09:56:29.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367189+0000", 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012510209999999999 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367802+0000", 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000612935 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.367964+0000", 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016159900000000001 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.368068+0000", 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104313 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:56:29.127 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.635744028999994, 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030128820000000001, 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 826 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417510+0000", 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417513+0000", 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3130000000000001e-06 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417525+0000", 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2574e-05 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417556+0000", 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0790000000000002e-05 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417571+0000", 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4976e-05 2024-05-10T09:56:29.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417704+0000", 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013354299999999999 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.417944+0000", 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023976800000000001 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.418281+0000", 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033648800000000002 2024-05-10T09:56:29.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.419414+0000", 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011336580000000001 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420370+0000", 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00095544 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420455+0000", 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5675999999999998e-05 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.420523+0000", 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7656000000000004e-05 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.133 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.533179169999997, 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032627770000000001, 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 871 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520075+0000", 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520077+0000", 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9470000000000002e-06 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520091+0000", 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3586e-05 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520120+0000", 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9167e-05 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520135+0000", 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4946000000000001e-05 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520288+0000", 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015277300000000001 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.520668+0000", 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038034700000000001 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.521266+0000", 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059778200000000004 2024-05-10T09:56:29.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.522481+0000", 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001215591 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523188+0000", 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070687500000000004 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523273+0000", 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5169999999999999e-05 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.523338+0000", 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4592999999999996e-05 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:56:29.139 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.497877032999995, 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003478835, 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 886 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555377+0000", 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555379+0000", 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.243e-06 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555392+0000", 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2225999999999999e-05 2024-05-10T09:56:29.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555423+0000", 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0994000000000002e-05 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555438+0000", 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5143000000000001e-05 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555594+0000", 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156009 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.555974+0000", 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037971400000000002 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.556522+0000", 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054812199999999995 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.557713+0000", 2024-05-10T09:56:29.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011910060000000001 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558707+0000", 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099478600000000011 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558794+0000", 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6142000000000003e-05 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.558856+0000", 2024-05-10T09:56:29.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.245e-05 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.476681897000006, 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003113457, 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.145 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 895 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576572+0000", 2024-05-10T09:56:29.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576574+0000", 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576585+0000", 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0924000000000001e-05 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576615+0000", 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0066e-05 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576630+0000", 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4693e-05 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576745+0000", 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011446300000000001 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.576974+0000", 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022977100000000001 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.577315+0000", 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034073099999999999 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.578411+0000", 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001095752 2024-05-10T09:56:29.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579411+0000", 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099999000000000008 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579570+0000", 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015879499999999999 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.579686+0000", 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116259 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.472676539000005, 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029848890000000001, 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.151 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 897 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580578+0000", 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580579+0000", 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.313e-06 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580587+0000", 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6969999999999993e-06 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580609+0000", 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2263e-05 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580620+0000", 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1293e-05 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580743+0000", 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122299 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.580998+0000", 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025569500000000001 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.581477+0000", 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047893000000000002 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.582608+0000", 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131232 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583301+0000", 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000692839 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583453+0000", 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000151562 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583563+0000", 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010976600000000001 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.469555490999994, 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032632500000000001, 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.157 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 898 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583699+0000", 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583701+0000", 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.854e-06 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583729+0000", 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8498999999999999e-05 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583761+0000", 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622999999999999e-05 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583776+0000", 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.517e-05 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.583913+0000", 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000137453 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584254+0000", 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034036400000000001 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.584799+0000", 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054493300000000005 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586086+0000", 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012870410000000001 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586691+0000", 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060565800000000002 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586848+0000", 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156973 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.586962+0000", 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113682 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.162 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.465256991000004, 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003187517, 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 900 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587997+0000", 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.587999+0000", 2024-05-10T09:56:29.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.663e-06 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588024+0000", 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5432999999999999e-05 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588048+0000", 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3666e-05 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588059+0000", 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1174e-05 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588178+0000", 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000118416 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588398+0000", 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220485 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.588860+0000", 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046165300000000002 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590173+0000", 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013134469999999999 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.590917+0000", 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00074345200000000002 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591067+0000", 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015018900000000001 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591185+0000", 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117939 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:29.168 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 97.382913742, 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031097049999999999, 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 934 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:56:29.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670341+0000", 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670343+0000", 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4099999999999998e-06 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670355+0000", 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1647e-05 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670384+0000", 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670405+0000", 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0296e-05 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670553+0000", 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014783900000000001 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.670880+0000", 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032728100000000001 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.671207+0000", 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032735799999999998 2024-05-10T09:56:29.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.672408+0000", 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001201045 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673285+0000", 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00087693700000000005 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673383+0000", 2024-05-10T09:56:29.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8321999999999998e-05 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.673450+0000", 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6723999999999993e-05 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:29.174 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:29.175 INFO:tasks.workunit.client.0.smithi042.stdout:Bucket Created: buck_2024_04_10_09_56_29 2024-05-10T09:56:29.175 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 1 2024-05-10T09:56:29.176 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:56:29.177 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:29.177 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:29.177 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0701988 s, 1.5 GB/s 2024-05-10T09:56:29.177 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:29.177 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:29.178 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:29.174+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:29.189 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:29.189 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:29.206 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:29.207 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:29.223 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:29.223 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:29.240 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:29.240 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:29.257 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:29.257 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:29.277 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:29.274+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:29.277 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:29.277 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:29.297 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:29.297 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:29.309 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:29.309 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:29.323 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:56:29.378 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:29.379+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:29.449 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:29.449 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:29.465 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:56:29.510 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:29.507+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:29.580 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:29.575+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:29.644 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:29.644 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:29.664 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:29.706 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:29.703+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:29.781 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:29.779+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:29.832 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:29.832 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:29.848 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:29.886 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.1 2024-05-10T09:56:29.886 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:29.886 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 2 2024-05-10T09:56:29.890 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:29.887+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:29.966 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:29.966 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:29.966 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0772839 s, 1.4 GB/s 2024-05-10T09:56:29.983 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:29.979+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:30.007 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:30.007 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:30.020 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:30.085 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:30.082+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:30.185 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:30.185 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:30.186 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:30.183+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:30.200 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:30.286 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:30.282+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:30.349 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:56:30.377 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:30.377 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:30.392 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:30.395 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:30.394+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:30.488 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:30.486+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:30.535 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:30.535 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:30.556 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:30.602 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:30.599+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:30.602 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.2 2024-05-10T09:56:30.602 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:30.602 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 3 2024-05-10T09:56:30.676 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:30.676 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:30.678 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:30.678 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:30.679 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0745247 s, 1.4 GB/s 2024-05-10T09:56:30.690 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:30.687+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:30.691 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:30.791 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:30.790+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:30.858 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:30.858 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:30.873 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:30.918 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:30.919+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:30.994 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:30.990+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:30.995 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:30.996 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:31.016 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:31.093 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:31.090+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:31.195 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:31.190+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:31.195 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:31.195 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:31.209 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:31.296 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:31.294+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:31.313 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:31.339 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:56:31.372 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:31.372 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:31.388 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:31.417 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.3 2024-05-10T09:56:31.417 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:31.417 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 4 2024-05-10T09:56:31.417 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:31.414+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:31.477 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:31.477 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:31.490 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:31.490 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:31.491 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0719715 s, 1.5 GB/s 2024-05-10T09:56:31.495 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:31.496 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:31.497 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:31.495+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:31.512 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:31.512 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:31.529 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:31.529 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:31.550 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:56:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:56:31.551 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:31.551 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:31.551 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:31.551 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:31.551 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:31.566 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:31.571 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:31.571 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:31.593 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:31.597 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:31.599+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:31.613 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:31.613 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:31.689 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:31.689 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4198.0:21 1.0 e18/17 1:30306672:devicehealth::main.db.0000000000000000:head v 18'11, mlcod=18'8)", 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 123.336472805, 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00278195, 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351389+0000", 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351390+0000", 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.626e-06 2024-05-10T09:56:31.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351501+0000", 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110046 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351526+0000", 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5282999999999998e-05 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351539+0000", 2024-05-10T09:56:31.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.346e-05 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351662+0000", 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012221899999999999 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.351697+0000", 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5660000000000001e-05 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354079+0000", 2024-05-10T09:56:31.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023817090000000001 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:28.354171+0000", 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1947000000000006e-05 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:31.694 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.96061059, 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035020419999999999, 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 206 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:31.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727251+0000", 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727255+0000", 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727271+0000", 2024-05-10T09:56:31.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6572999999999999e-05 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727313+0000", 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2252999999999997e-05 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727340+0000", 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7046000000000002e-05 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727512+0000", 2024-05-10T09:56:31.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017128600000000001 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.727782+0000", 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000270578 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.728234+0000", 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045127999999999998 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730035+0000", 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001801504 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730597+0000", 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056201600000000003 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730681+0000", 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4072000000000004e-05 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.730753+0000", 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1923999999999998e-05 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.937987521, 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087679609999999995, 2024-05-10T09:56:31.700 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 210 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749874+0000", 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749877+0000", 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5469999999999999e-06 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749890+0000", 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2836e-05 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749923+0000", 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3213000000000002e-05 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.749942+0000", 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9522999999999999e-05 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750129+0000", 2024-05-10T09:56:31.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018699600000000001 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.750139+0000", 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.754691+0000", 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004551968 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755034+0000", 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00034274099999999998 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.755835+0000", 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00080101100000000002 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758166+0000", 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002331203 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758506+0000", 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758584+0000", 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8178999999999998e-05 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.758642+0000", 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.783e-05 2024-05-10T09:56:31.706 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.89552424599999, 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033981530000000001, 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.707 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 218 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792337+0000", 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792340+0000", 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5840000000000002e-06 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792352+0000", 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1833e-05 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792384+0000", 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2092999999999999e-05 2024-05-10T09:56:31.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792402+0000", 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8240000000000002e-05 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792555+0000", 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015258900000000001 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.792788+0000", 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023348499999999999 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.793230+0000", 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044222700000000001 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.794646+0000", 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014155999999999999 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795559+0000", 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00091327300000000004 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795644+0000", 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4179999999999997e-05 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795736+0000", 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2048999999999999e-05 2024-05-10T09:56:31.712 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.880887816, 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030713049999999999, 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.713 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 222 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806974+0000", 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806976+0000", 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.227e-06 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.806988+0000", 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430000000000001e-05 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807019+0000", 2024-05-10T09:56:31.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1919999999999999e-05 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807034+0000", 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.486e-05 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807159+0000", 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012519899999999999 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807379+0000", 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021988500000000001 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.807811+0000", 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043143000000000001 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809448+0000", 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001637335 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809899+0000", 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000450734 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.809982+0000", 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3395999999999999e-05 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.810045+0000", 2024-05-10T09:56:31.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2889e-05 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.851386905, 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034602420000000001, 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.719 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 230 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836475+0000", 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836477+0000", 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836489+0000", 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1902999999999999e-05 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836521+0000", 2024-05-10T09:56:31.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1683999999999997e-05 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836538+0000", 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7730000000000001e-05 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836659+0000", 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120479 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.836883+0000", 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022439399999999999 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.837314+0000", 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043059400000000002 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.838696+0000", 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013819730000000001 2024-05-10T09:56:31.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839785+0000", 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010888759999999999 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839871+0000", 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5742999999999995e-05 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.839935+0000", 2024-05-10T09:56:31.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4486000000000006e-05 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.833107658, 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032435770000000001, 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.725 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 235 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854754+0000", 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854756+0000", 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.193e-06 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854769+0000", 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2927e-05 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854801+0000", 2024-05-10T09:56:31.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2055999999999999e-05 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854816+0000", 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5136999999999999e-05 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.854936+0000", 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011974200000000001 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855159+0000", 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022269499999999999 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.855612+0000", 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045321400000000001 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857224+0000", 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016119750000000001 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857841+0000", 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000616915 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857934+0000", 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3356000000000005e-05 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.857998+0000", 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3367000000000005e-05 2024-05-10T09:56:31.730 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:419 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.780243814, 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029142920000000002, 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.731 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 419 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907618+0000", 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907620+0000", 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.99e-06 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907629+0000", 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6819999999999992e-06 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907648+0000", 2024-05-10T09:56:31.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9093000000000002e-05 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907661+0000", 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3314e-05 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907749+0000", 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8226000000000005e-05 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.907853+0000", 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010362299999999999 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908041+0000", 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000187775 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.908697+0000", 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00065604200000000002 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910416+0000", 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017196049999999999 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910479+0000", 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2581000000000003e-05 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.910532+0000", 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3361e-05 2024-05-10T09:56:31.736 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:485 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.73948679199999, 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074536460000000004, 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.737 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 485 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948375+0000", 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948377+0000", 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.672e-06 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948382+0000", 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.835e-06 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948398+0000", 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5645999999999999e-05 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948405+0000", 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3919999999999997e-06 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948473+0000", 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7757999999999997e-05 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948535+0000", 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1922999999999996e-05 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.948662+0000", 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012661399999999999 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.949174+0000", 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051206899999999998 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955719+0000", 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065449410000000003 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955781+0000", 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2346000000000002e-05 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.955829+0000", 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7450000000000001e-05 2024-05-10T09:56:31.742 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:533 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.705253156, 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053183730000000004, 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.743 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.745 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.745 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 533 2024-05-10T09:56:31.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.745 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982609+0000", 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982610+0000", 2024-05-10T09:56:31.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2410000000000001e-06 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982615+0000", 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4070000000000001e-06 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982629+0000", 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4202000000000001e-05 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982635+0000", 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0599999999999996e-06 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982723+0000", 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7573999999999999e-05 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982820+0000", 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6565999999999997e-05 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.982956+0000", 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136322 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.983566+0000", 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060961700000000001 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987798+0000", 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042322619999999997 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987880+0000", 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1742000000000004e-05 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.987927+0000", 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7379999999999997e-05 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:540 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.69942607199999, 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004796168, 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 540 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988436+0000", 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988437+0000", 2024-05-10T09:56:31.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1489999999999999e-06 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988443+0000", 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7790000000000001e-06 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988457+0000", 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4647999999999999e-05 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988464+0000", 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4910000000000002e-06 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988515+0000", 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0852e-05 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988603+0000", 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7984000000000003e-05 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.988801+0000", 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000198369 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.989397+0000", 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059568700000000002 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993170+0000", 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0037734869999999998 2024-05-10T09:56:31.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993204+0000", 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4097000000000002e-05 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.993232+0000", 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7625000000000001e-05 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:577 6.18 6:1902608e:::obj_delete_at_hint.0000000024:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.66846881799999, 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003134408, 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 577 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019393+0000", 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019394+0000", 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1999999999999999e-06 2024-05-10T09:56:31.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019401+0000", 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0509999999999999e-06 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019415+0000", 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4204e-05 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019425+0000", 2024-05-10T09:56:31.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2080000000000006e-06 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019511+0000", 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6865000000000003e-05 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019695+0000", 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018337799999999999 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.019839+0000", 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014406999999999999 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.020722+0000", 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00088290600000000003 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022342+0000", 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016201119999999999 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022471+0000", 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012878 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.022527+0000", 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6634e-05 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:599 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.652258781, 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027742040000000002, 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 599 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035603+0000", 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035605+0000", 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.728e-06 2024-05-10T09:56:31.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035615+0000", 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8970000000000003e-06 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035642+0000", 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7033999999999999e-05 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035655+0000", 2024-05-10T09:56:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3108999999999999e-05 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035729+0000", 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4369000000000006e-05 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035812+0000", 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3317000000000002e-05 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.035948+0000", 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013527400000000001 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.036844+0000", 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00089660300000000005 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038179+0000", 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001334542 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038271+0000", 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2301999999999998e-05 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.038377+0000", 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106029 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.768 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:690 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.57460082199999, 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002819434, 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 690 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113261+0000", 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113262+0000", 2024-05-10T09:56:31.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.091e-06 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113268+0000", 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7590000000000003e-06 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113282+0000", 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3898e-05 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113290+0000", 2024-05-10T09:56:31.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8740000000000001e-06 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113401+0000", 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110314 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113569+0000", 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016804600000000001 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113881+0000", 2024-05-10T09:56:31.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000312221 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115216+0000", 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013349849999999999 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115928+0000", 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071237000000000004 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116015+0000", 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6706000000000006e-05 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116080+0000", 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5170000000000001e-05 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.774 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:691 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.57446689299999, 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003101801, 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 691 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113395+0000", 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113396+0000", 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.012e-06 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113404+0000", 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9230000000000002e-06 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113426+0000", 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1959000000000001e-05 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.113435+0000", 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1970000000000002e-06 2024-05-10T09:56:31.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114379+0000", 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00094443100000000002 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114565+0000", 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186164 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.114923+0000", 2024-05-10T09:56:31.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035713999999999999 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.115653+0000", 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072996900000000002 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116435+0000", 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078245099999999998 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116468+0000", 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3336000000000001e-05 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.116497+0000", 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8218999999999999e-05 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.780 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.540159675, 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027414900000000001, 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 712 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147702+0000", 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147719+0000", 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6716999999999999e-05 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147732+0000", 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2914e-05 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147766+0000", 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4168000000000002e-05 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147779+0000", 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.362e-05 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.147905+0000", 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125835 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148143+0000", 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000237502 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.148459+0000", 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031644799999999999 2024-05-10T09:56:31.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.149483+0000", 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010235559999999999 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150195+0000", 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071227200000000001 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150339+0000", 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014431900000000001 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.150443+0000", 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104139 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:714 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.786 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.53630065599999, 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030451580000000001, 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 714 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:31.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151561+0000", 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151562+0000", 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151570+0000", 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7489999999999998e-06 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151592+0000", 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2181999999999999e-05 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151603+0000", 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0983e-05 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151726+0000", 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012240800000000001 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.151874+0000", 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014823899999999999 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.152156+0000", 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000281785 2024-05-10T09:56:31.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.153133+0000", 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00097725999999999998 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154319+0000", 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011862509999999999 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154495+0000", 2024-05-10T09:56:31.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017626600000000001 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.154606+0000", 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110689 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:31.792 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.305336998, 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028967659999999998, 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 811 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382525+0000", 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382527+0000", 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3269999999999999e-06 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382539+0000", 2024-05-10T09:56:31.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2266000000000001e-05 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382571+0000", 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2104000000000003e-05 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382586+0000", 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4596000000000001e-05 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382701+0000", 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011528599999999999 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.382916+0000", 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021498099999999999 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.383235+0000", 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031886799999999998 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.384568+0000", 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013326410000000001 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385260+0000", 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069192199999999998 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385357+0000", 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7112000000000001e-05 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.797 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.385421+0000", 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4663000000000001e-05 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.125134866, 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027839840000000002, 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.798 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 889 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562727+0000", 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562730+0000", 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7499999999999999e-06 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562742+0000", 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2432999999999999e-05 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562773+0000", 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0573e-05 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562788+0000", 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5497000000000001e-05 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.562944+0000", 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000156169 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563164+0000", 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021971800000000001 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.563485+0000", 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000321331 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.564594+0000", 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011088389999999999 2024-05-10T09:56:31.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565355+0000", 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076131099999999998 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565442+0000", 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6760000000000003e-05 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.565511+0000", 2024-05-10T09:56:31.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8602999999999994e-05 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 70.791690696000003, 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003566343, 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:31.804 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1020 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896171+0000", 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:31.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896175+0000", 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5429999999999998e-06 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896193+0000", 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8448999999999999e-05 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896233+0000", 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0228999999999997e-05 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896252+0000", 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9148999999999999e-05 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896422+0000", 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016917700000000001 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.896661+0000", 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000239576 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.897003+0000", 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000341582 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.898376+0000", 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013735760000000001 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899568+0000", 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011918339999999999 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899659+0000", 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0895000000000003e-05 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:55:20.899737+0000", 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8332999999999997e-05 2024-05-10T09:56:31.809 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.810 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.810 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.810 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:31.810 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:31.810 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:31.811 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:31.812 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:31.811+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:31.912 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:31.911+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:31.970 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:31.970 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:31.970 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:31.971 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:31.989 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:32.039 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:32.038+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:32.066 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.4 2024-05-10T09:56:32.066 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:32.066 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 5 2024-05-10T09:56:32.110 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:32.110 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:32.110 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:32.110 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:32.110 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:32.114 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:56:32.115+0000 7f7665367640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-05-10T09:56:32.129 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:32.137 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:32.138 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:32.138 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0703546 s, 1.5 GB/s 2024-05-10T09:56:32.215 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:32.215+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 108.60773585600001, 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.257 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.258 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:32.259 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.260 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.261 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.262 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.52007140000001, 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.263 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.264 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.265 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:56:32.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:56:32.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.485356186, 2024-05-10T09:56:32.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:32.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:56:32.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.45897420599999, 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:56:32.275 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:56:32.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:56:32.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.44094413400001, 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.281 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:56:32.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.40728186299999, 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.287 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:56:32.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:56:32.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.292 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:325 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.37655336100001, 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031682170000000001, 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 325 2024-05-10T09:56:32.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878404+0000", 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878405+0000", 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878412+0000", 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.024e-06 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878426+0000", 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4086e-05 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878432+0000", 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4640000000000003e-06 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878493+0000", 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0133000000000002e-05 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878581+0000", 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8828999999999999e-05 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.878714+0000", 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013252199999999999 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.879345+0000", 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000631238 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881487+0000", 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021422070000000001 2024-05-10T09:56:32.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881530+0000", 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3068000000000002e-05 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.881572+0000", 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1650000000000003e-05 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.058526636, 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:32.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:56:32.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:783 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.941330147, 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031752669999999998, 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 783 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.305 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313627+0000", 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313629+0000", 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313641+0000", 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1534e-05 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313674+0000", 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3068999999999998e-05 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313689+0000", 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5160000000000001e-05 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.313829+0000", 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014059599999999999 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314069+0000", 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023954799999999999 2024-05-10T09:56:32.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.314558+0000", 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048895700000000004 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.315734+0000", 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001176091 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316524+0000", 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00079033499999999997 2024-05-10T09:56:32.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316687+0000", 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163055 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.316802+0000", 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011481600000000001 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.909440217, 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:56:32.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:56:32.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:56:32.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.904654937, 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:56:32.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:56:32.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.322 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.66359811700001, 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003127838, 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 901 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591359+0000", 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591362+0000", 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5600000000000001e-06 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591374+0000", 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2130000000000001e-05 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591406+0000", 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2619000000000001e-05 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591424+0000", 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7983e-05 2024-05-10T09:56:32.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591585+0000", 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160166 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.591979+0000", 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039437400000000002 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.592563+0000", 2024-05-10T09:56:32.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058449900000000004 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.593796+0000", 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001232695 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594268+0000", 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047204700000000002 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594363+0000", 2024-05-10T09:56:32.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5303000000000006e-05 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.594487+0000", 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012346199999999999 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 100.65926099399999, 2024-05-10T09:56:32.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:56:32.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:56:32.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1274 3.8 e69/23 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.509207776, 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015717301999999999, 2024-05-10T09:56:32.334 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745751+0000", 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8789999999999999e-06 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748049+0000", 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022981820000000002 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748076+0000", 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6361999999999999e-05 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748093+0000", 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7329e-05 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748193+0000", 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9562000000000007e-05 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748228+0000", 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4962999999999997e-05 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761399+0000", 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013171173 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761467+0000", 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7852e-05 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1275 3.4 3:20482490:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.50250092199999996, 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011423600000000001, 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1275 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752458+0000", 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7039999999999999e-06 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754116+0000", 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016577129999999999 2024-05-10T09:56:32.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754147+0000", 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1782999999999997e-05 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754161+0000", 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3715e-05 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754265+0000", 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103349 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754448+0000", 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018395900000000001 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754563+0000", 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114115 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763241+0000", 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086780859999999998 2024-05-10T09:56:32.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763738+0000", 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049755700000000003 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763816+0000", 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7987999999999999e-05 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763880+0000", 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3631000000000001e-05 2024-05-10T09:56:32.343 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1280 3.32 e69/23 3:4e344d04:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_8:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.806863+0000", 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.44809433300000001, 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071342799999999998, 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.806863+0000", 2024-05-10T09:56:32.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.806863+0000", 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.806865+0000", 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9489999999999999e-06 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808805+0000", 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019400559999999999 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808838+0000", 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2877999999999999e-05 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808853+0000", 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5284000000000001e-05 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808949+0000", 2024-05-10T09:56:32.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6063999999999994e-05 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808982+0000", 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3281000000000002e-05 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.813938+0000", 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0049555620000000002 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.813997+0000", 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9206000000000002e-05 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1285 3.21 e69/42 3:85614eff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_13:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.862981+0000", 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.39197653300000002, 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010298774, 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862981+0000", 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862981+0000", 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862983+0000", 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8870000000000001e-06 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865389+0000", 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002406034 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865417+0000", 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8493e-05 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865431+0000", 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4209999999999999e-05 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865524+0000", 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2519e-05 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865558+0000", 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873194+0000", 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0076351600000000002 2024-05-10T09:56:32.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873279+0000", 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5853999999999995e-05 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1286 3.25 3:a4ea653e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.38297884500000001, 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010955397, 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.352 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1286 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:32.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871981+0000", 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7410000000000001e-06 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874251+0000", 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022695770000000001 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874271+0000", 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9870000000000001e-05 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874280+0000", 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2779999999999999e-06 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874348+0000", 2024-05-10T09:56:32.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8518999999999999e-05 2024-05-10T09:56:32.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874512+0000", 2024-05-10T09:56:32.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016358200000000001 2024-05-10T09:56:32.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874616+0000", 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103924 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.879896+0000", 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052805279999999996 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882804+0000", 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029073749999999998 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882877+0000", 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2788999999999997e-05 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882934+0000", 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7213999999999998e-05 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1288 3.1a e69/23 3:5902eff1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_16:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.35475722900000001, 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013345268, 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900205+0000", 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1390000000000003e-06 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906219+0000", 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060138969999999998 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906247+0000", 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7881999999999998e-05 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906259+0000", 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2334000000000001e-05 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906321+0000", 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2045999999999995e-05 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906353+0000", 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622000000000003e-05 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913476+0000", 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071233490000000002 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913545+0000", 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8998999999999994e-05 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.363 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1293 3.19 3:997ed118:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.947092+0000", 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.30786517699999999, 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010103699000000001, 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1293 2024-05-10T09:56:32.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.947092+0000", 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.947092+0000", 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.947094+0000", 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1449999999999998e-06 2024-05-10T09:56:32.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.948797+0000", 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001703099 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.948830+0000", 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2262999999999999e-05 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.948841+0000", 2024-05-10T09:56:32.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1297e-05 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.948925+0000", 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4033e-05 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949120+0000", 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019496199999999999 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949292+0000", 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017214800000000001 2024-05-10T09:56:32.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.956569+0000", 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072771650000000004 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.957073+0000", 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00050391900000000002 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.957144+0000", 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1206999999999998e-05 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.957196+0000", 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1461000000000001e-05 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.369 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:32.371 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:32.371 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:32.371+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:32.438 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T09:56:32.438 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T09:56:32.439 INFO:tasks.thrashosds.thrasher:Killing osd 4, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-10T09:56:32.439 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T09:56:32.439 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:56:32.482 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:32.483+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:32.505 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T09:56:32.524 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:32.524 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:32.524 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:32.545 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:32.572 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:32.571+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:32.656 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:32.656 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:32.656 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:32.656 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:32.656 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:32.670 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:32.674 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:32.670+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:32.774 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:32.775+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:32.804 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:32.804 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:32.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:32.804 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:32.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.804 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:32.804 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 109.07856203199999, 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029100440000000001, 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 42 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723572+0000", 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723573+0000", 2024-05-10T09:56:32.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4330000000000001e-06 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723583+0000", 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0027000000000001e-05 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723608+0000", 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4295e-05 2024-05-10T09:56:32.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723629+0000", 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1727000000000001e-05 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.723788+0000", 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000158419 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724062+0000", 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027393200000000001 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.724274+0000", 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000212079 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.725307+0000", 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0010337460000000001 2024-05-10T09:56:32.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726279+0000", 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000971973 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726389+0000", 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109342 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.726482+0000", 2024-05-10T09:56:32.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3071000000000004e-05 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.078092959, 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.811 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:56:32.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.943834792, 2024-05-10T09:56:32.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:56:32.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:56:32.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:56:32.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.823 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.930407477, 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.824 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:56:32.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.58376059299999, 2024-05-10T09:56:32.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029050930000000001, 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 742 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:32.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218373+0000", 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218376+0000", 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7769999999999998e-06 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218410+0000", 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4385999999999999e-05 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218443+0000", 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2767e-05 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218458+0000", 2024-05-10T09:56:32.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5119e-05 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218600+0000", 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014172300000000001 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.218833+0000", 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023334199999999999 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.833 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.219193+0000", 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035917300000000001 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.220361+0000", 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011679889999999999 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221117+0000", 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00075647500000000005 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221209+0000", 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1836000000000006e-05 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.221278+0000", 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9505999999999995e-05 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.835 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.540880587, 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028773169999999999, 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 760 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:32.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261253+0000", 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261255+0000", 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1799999999999999e-06 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261267+0000", 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1897e-05 2024-05-10T09:56:32.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261299+0000", 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2020000000000002e-05 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261314+0000", 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.487e-05 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261424+0000", 2024-05-10T09:56:32.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110155 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261643+0000", 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218972 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.261953+0000", 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030991100000000001 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263114+0000", 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160995 2024-05-10T09:56:32.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.263965+0000", 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00085032100000000002 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264063+0000", 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8366e-05 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.264131+0000", 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7630000000000001e-05 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.840 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.33694727, 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028724129999999999, 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 847 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.841 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465187+0000", 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465189+0000", 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1739999999999999e-06 2024-05-10T09:56:32.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465200+0000", 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1705999999999999e-05 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465234+0000", 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3949999999999999e-05 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465250+0000", 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5512999999999999e-05 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465365+0000", 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114689 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465584+0000", 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021890500000000001 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.465911+0000", 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032711099999999999 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467027+0000", 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011167620000000001 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467896+0000", 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000869084 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.467988+0000", 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1442999999999998e-05 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.468059+0000", 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1075999999999995e-05 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.289331117, 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028326290000000001, 2024-05-10T09:56:32.846 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 868 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512803+0000", 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512805+0000", 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2970000000000002e-06 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512818+0000", 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2943e-05 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512848+0000", 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9845999999999999e-05 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512863+0000", 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5437000000000001e-05 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.512995+0000", 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013128900000000001 2024-05-10T09:56:32.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513218+0000", 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022306800000000001 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.513538+0000", 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00032026800000000002 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.514670+0000", 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001131775 2024-05-10T09:56:32.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515350+0000", 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068006800000000004 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515513+0000", 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163053 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.515635+0000", 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012258500000000001 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.28523333299999, 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002969289, 2024-05-10T09:56:32.852 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 870 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516901+0000", 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516903+0000", 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.013e-06 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516917+0000", 2024-05-10T09:56:32.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4552999999999999e-05 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516948+0000", 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1080000000000001e-05 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.516964+0000", 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5393999999999999e-05 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517100+0000", 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000136172 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517337+0000", 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023761799999999999 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.517835+0000", 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049792300000000005 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519171+0000", 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013354770000000001 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519690+0000", 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051893600000000001 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519803+0000", 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112853 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.519870+0000", 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7269999999999998e-05 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.196304837, 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:56:32.858 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.859 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:56:32.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:56:32.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:56:32.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.191369205, 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.864 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:32.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.09820755699999, 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.870 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:56:32.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.874 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.08414984300001, 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:56:32.876 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:56:32.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:56:32.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:56:32.881 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 101.079480312, 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00281613, 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.882 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 957 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722654+0000", 2024-05-10T09:56:32.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722655+0000", 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3459999999999999e-06 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722663+0000", 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6739999999999997e-06 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.884 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722685+0000", 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2753000000000001e-05 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722697+0000", 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2143e-05 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.722834+0000", 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013683900000000001 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.885 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723092+0000", 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025752499999999998 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.723577+0000", 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048561999999999998 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.724916+0000", 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001338084 2024-05-10T09:56:32.886 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725303+0000", 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038795300000000002 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725402+0000", 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8263000000000004e-05 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.725470+0000", 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7929999999999995e-05 2024-05-10T09:56:32.887 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1273 3.2d e69/23 3:b59bb266:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_1:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.063915065, 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013030055, 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.888 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:32.889 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.35e-07 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744317+0000", 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060981630000000002 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744349+0000", 2024-05-10T09:56:32.890 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744363+0000", 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4742e-05 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744467+0000", 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103656 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.891 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744487+0000", 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9893000000000001e-05 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751184+0000", 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066971670000000004 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751249+0000", 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4789000000000006e-05 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1275 3.4 e69/23 3:20482490:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_3:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.047449692, 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088205420000000007, 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.893 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754686+0000", 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9589999999999998e-06 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.894 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756627+0000", 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001940747 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756656+0000", 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8906000000000001e-05 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756671+0000", 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5571000000000001e-05 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.895 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756746+0000", 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4738000000000002e-05 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756775+0000", 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8983e-05 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763456+0000", 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006681279 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763505+0000", 2024-05-10T09:56:32.896 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8359000000000002e-05 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1277 3.2d e69/23 3:b6aa08bb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_5:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.0220467099999999, 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010253787, 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.897 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780089+0000", 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7770000000000001e-06 2024-05-10T09:56:32.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784360+0000", 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042708809999999998 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784397+0000", 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7314999999999998e-05 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784413+0000", 2024-05-10T09:56:32.899 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6065e-05 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784553+0000", 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013986099999999999 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784614+0000", 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0718999999999999e-05 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.900 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.790273+0000", 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056590240000000003 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.790341+0000", 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8145000000000006e-05 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1284 3.36 e69/42 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:32.901 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.94752090899999997, 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010399762999999999, 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.902 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854615+0000", 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4380000000000002e-06 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858639+0000", 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040232239999999997 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858672+0000", 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3149999999999999e-05 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858689+0000", 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7342000000000001e-05 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858762+0000", 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3162000000000002e-05 2024-05-10T09:56:32.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858782+0000", 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9330999999999998e-05 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.864942+0000", 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061601889999999999 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865013+0000", 2024-05-10T09:56:32.905 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0926999999999994e-05 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1285 3.21 3:85614eff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.94255354000000002, 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014048458, 2024-05-10T09:56:32.906 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1285 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:32.907 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859583+0000", 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.932e-06 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862407+0000", 2024-05-10T09:56:32.908 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028238030000000002 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862436+0000", 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9264999999999998e-05 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862452+0000", 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6161999999999999e-05 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862553+0000", 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001002 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862721+0000", 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016805100000000001 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.910 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862850+0000", 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012889600000000001 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873327+0000", 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010477288 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873512+0000", 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018525099999999999 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873586+0000", 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3559999999999994e-05 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873629+0000", 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3050000000000003e-05 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1293 3.19 e69/42 3:997ed118:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_21:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.85272025900000004, 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074932560000000002, 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:32.913 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949416+0000", 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.357e-06 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.914 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951211+0000", 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017950209999999999 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951243+0000", 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1745999999999997e-05 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951259+0000", 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6274e-05 2024-05-10T09:56:32.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951344+0000", 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4974000000000003e-05 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951375+0000", 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0580999999999997e-05 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:32.916 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.956850+0000", 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054756789999999998 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.956907+0000", 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6623999999999999e-05 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:32.917 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:32.919 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:32.919 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:32.918+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:33.019 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:33.018+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:33.095 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:33.095 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:33.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1313 3.29 3:968e8379:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.537591+0000", 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.55775029300000001, 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.55781612800000002, 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "waiting for sub ops", 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1313 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.537591+0000", 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.537591+0000", 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.537595+0000", 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6820000000000001e-06 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.539843+0000", 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022485949999999999 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.539879+0000", 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5240999999999997e-05 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.539893+0000", 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4406999999999999e-05 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.539966+0000", 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2601999999999994e-05 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.540088+0000", 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012243200000000001 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.540228+0000", 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013983499999999999 2024-05-10T09:56:33.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.544879+0000", 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004651222 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 1 2024-05-10T09:56:33.100 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:33.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:33.155 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:33.154+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:33.221 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:33.219+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:33.284 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:33.284 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:33.284 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:33.285 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:33.285 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:33.299 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:33.347 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:33.346+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:33.379 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:56:33.427 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:33.426+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:33.433 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 107.751989143, 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086496530000000002, 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:33.434 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 44 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679867+0000", 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679869+0000", 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3719999999999999e-06 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679880+0000", 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0854e-05 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679902+0000", 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2464e-05 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.679932+0000", 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9726999999999998e-05 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680032+0000", 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010032299999999999 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.680042+0000", 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3510000000000008e-06 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688283+0000", 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082418319999999993 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:45.688516+0000", 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023273 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.438 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 102.647053703, 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003743836, 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 216 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.439 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784802+0000", 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784805+0000", 2024-05-10T09:56:33.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5730000000000002e-06 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784817+0000", 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.277e-05 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784854+0000", 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6205999999999999e-05 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.784873+0000", 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9749999999999999e-05 2024-05-10T09:56:33.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785009+0000", 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013592300000000001 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785241+0000", 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000232031 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:33.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.785673+0000", 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043218999999999999 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.787225+0000", 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015515259999999999 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788269+0000", 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001043906 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788425+0000", 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155742 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.788546+0000", 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012121900000000001 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1173 4.11 4:88c47049:::.dir.18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:29.055458+0000", 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3763978330000004, 2024-05-10T09:56:33.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0045798339999999996, 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1173 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055458+0000", 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055458+0000", 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055458+0000", 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3000000000000001e-07 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055461+0000", 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1700000000000001e-06 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055467+0000", 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8900000000000004e-06 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055471+0000", 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.641e-06 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055561+0000", 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0110000000000003e-05 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055936+0000", 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037528799999999999 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.056072+0000", 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013520599999999999 2024-05-10T09:56:33.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.057259+0000", 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011873140000000001 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.059978+0000", 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027192050000000001 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.060012+0000", 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3998000000000002e-05 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.060038+0000", 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5582e-05 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1176 4.23 4:c7f8af7a:::.dir.18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-10T09:56:33.450 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:29.055500+0000", 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3763557669999997, 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003722586, 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1176 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055500+0000", 2024-05-10T09:56:33.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055500+0000", 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055501+0000", 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7800000000000001e-07 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055506+0000", 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2730000000000002e-06 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055558+0000", 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2376999999999997e-05 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055567+0000", 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3219999999999999e-06 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055640+0000", 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2374999999999997e-05 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055799+0000", 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159001 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055972+0000", 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017346500000000001 2024-05-10T09:56:33.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.057283+0000", 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001310868 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.059112+0000", 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018285409999999999 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.059164+0000", 2024-05-10T09:56:33.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2573e-05 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.059223+0000", 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8213e-05 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1177 4.23 4:c4be7329:::.dir.18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:29.055595+0000", 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3762606010000002, 2024-05-10T09:56:33.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004533118, 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1177 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055595+0000", 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055595+0000", 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055596+0000", 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3799999999999996e-07 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055602+0000", 2024-05-10T09:56:33.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9769999999999997e-06 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055612+0000", 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.029e-05 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.055619+0000", 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3570000000000003e-06 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.056597+0000", 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0009785900000000001 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.056735+0000", 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013814900000000001 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.056913+0000", 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017790199999999999 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.058073+0000", 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001160105 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.060025+0000", 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019520869999999999 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.060087+0000", 2024-05-10T09:56:33.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1470000000000006e-05 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:29.060128+0000", 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1353000000000002e-05 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1274 3.8 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:33.462 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.68937936, 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019336196, 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1274 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742479+0000", 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8779999999999998e-06 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745161+0000", 2024-05-10T09:56:33.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002682135 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745185+0000", 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3611000000000001e-05 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745194+0000", 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2369999999999998e-06 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745266+0000", 2024-05-10T09:56:33.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2008000000000006e-05 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745445+0000", 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179259 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745624+0000", 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017874300000000001 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756109+0000", 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010485169000000001 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761680+0000", 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055706649999999998 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761755+0000", 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5171000000000002e-05 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761813+0000", 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.732e-05 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1276 3.23 e69/23 3:c6394aa1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_4:head v 69'4, mlcod=68'2)", 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.766549+0000", 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.6653064829999999, 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0097181639999999996, 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.468 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766549+0000", 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766549+0000", 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766551+0000", 2024-05-10T09:56:33.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.809e-06 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768589+0000", 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00203783 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768619+0000", 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9813000000000001e-05 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768633+0000", 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4591e-05 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768720+0000", 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6520000000000005e-05 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768749+0000", 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9034999999999999e-05 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776189+0000", 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074401909999999996 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776267+0000", 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8374999999999994e-05 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.472 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1281 3.29 3:94644cd5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.615245832, 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021096073, 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1281 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816613+0000", 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.892e-06 2024-05-10T09:56:33.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818489+0000", 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018760599999999999 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818531+0000", 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2070000000000002e-05 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818554+0000", 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2776e-05 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818664+0000", 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011037899999999999 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818882+0000", 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000217457 2024-05-10T09:56:33.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.819053+0000", 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000171187 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.824533+0000", 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054798609999999999 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837622+0000", 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013089751 2024-05-10T09:56:33.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837669+0000", 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6517000000000002e-05 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837706+0000", 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7122999999999997e-05 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.478 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1286 3.25 e69/23 3:a4ea653e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_14:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.874728+0000", 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.5571273799999998, 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078985259999999995, 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874728+0000", 2024-05-10T09:56:33.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874728+0000", 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874730+0000", 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.688e-06 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.876680+0000", 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019500870000000001 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.876704+0000", 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3756000000000001e-05 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.876716+0000", 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2259000000000001e-05 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.876803+0000", 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7120999999999995e-05 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.876833+0000", 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0230999999999999e-05 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882527+0000", 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056939290000000004 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882627+0000", 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9455000000000002e-05 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1289 3.38 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.527611944, 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022792125999999999, 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.483 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1289 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904247+0000", 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1939999999999998e-06 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906042+0000", 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017947239999999999 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906083+0000", 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0948999999999997e-05 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906101+0000", 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8442999999999999e-05 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906204+0000", 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103359 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906378+0000", 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000173435 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906536+0000", 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015819099999999999 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913717+0000", 2024-05-10T09:56:33.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071811230000000002 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926882+0000", 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013164765 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926966+0000", 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3579999999999996e-05 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.488 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927036+0000", 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0363000000000004e-05 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1292 3.38 3:1ea9eee7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.49512551, 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01900717, 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.489 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1292 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936734+0000", 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4149999999999999e-06 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938852+0000", 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021187630000000001 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938883+0000", 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0494999999999999e-05 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938901+0000", 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7988000000000001e-05 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938993+0000", 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2383e-05 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939177+0000", 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018371699999999999 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939324+0000", 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014727499999999999 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.944680+0000", 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053554379999999997 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955600+0000", 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010920487 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955670+0000", 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0202000000000003e-05 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955737+0000", 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7007000000000004e-05 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1295 3.c e69/23 3:324d36a8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_23:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.974752+0000", 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.4571039960000001, 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0094545010000000006, 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.495 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.974752+0000", 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.974752+0000", 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.974753+0000", 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.376e-06 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979402+0000", 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0046489139999999997 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979416+0000", 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4341e-05 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979427+0000", 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0871e-05 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979498+0000", 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1089999999999999e-05 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979520+0000", 2024-05-10T09:56:33.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1202000000000001e-05 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.984134+0000", 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0046148229999999997 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.984206+0000", 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1884000000000005e-05 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1296 3.2 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.4110373970000001, 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021264584, 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1296 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020821+0000", 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3259999999999998e-06 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.021993+0000", 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001172071 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022024+0000", 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1222e-05 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022035+0000", 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1449e-05 2024-05-10T09:56:33.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022149+0000", 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011391399999999999 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022369+0000", 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220079 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022596+0000", 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000226288 2024-05-10T09:56:33.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.028699+0000", 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006103163 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042000+0000", 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013301006000000001 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042047+0000", 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6990999999999998e-05 2024-05-10T09:56:33.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042083+0000", 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6075000000000003e-05 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1298 3.29 3:979982e8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.385735763, 2024-05-10T09:56:33.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018739767000000001, 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1298 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046121+0000", 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.508e-06 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047357+0000", 2024-05-10T09:56:33.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001235683 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047388+0000", 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0549000000000002e-05 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047404+0000", 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6676000000000001e-05 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047484+0000", 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9212e-05 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047618+0000", 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013448600000000001 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.048073+0000", 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045510599999999999 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.055269+0000", 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071963189999999996 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064647+0000", 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093774919999999994 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064781+0000", 2024-05-10T09:56:33.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013422999999999999 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064860+0000", 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8505999999999997e-05 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1301 3.23 e69/23 3:c760cb7d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_1:head v 69'5, mlcod=68'3)", 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.399602+0000", 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.032253957, 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010745065, 2024-05-10T09:56:33.511 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399602+0000", 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399602+0000", 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399604+0000", 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2709999999999999e-06 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404074+0000", 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0044698089999999999 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404124+0000", 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.9885000000000001e-05 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404152+0000", 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8430000000000001e-05 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404264+0000", 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112049 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404292+0000", 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8143000000000001e-05 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410248+0000", 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0059555420000000003 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410347+0000", 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8936000000000003e-05 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1304 3.28 e69/23 3:17fc7310:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_4:head v 69'4, mlcod=68'2)", 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.992401325, 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012378174, 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439456+0000", 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.37e-06 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443788+0000", 2024-05-10T09:56:33.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004332252 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443829+0000", 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0667999999999998e-05 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443846+0000", 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6932999999999999e-05 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443955+0000", 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109529 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443997+0000", 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1813000000000001e-05 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.451770+0000", 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007772752 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.451833+0000", 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2856999999999998e-05 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1306 3.15 e69/23 3:a9dc2853:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_6:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.457893+0000", 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.97396257900000005, 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.009234941, 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.520 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.457893+0000", 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.457893+0000", 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.457895+0000", 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5680000000000001e-06 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.462250+0000", 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0043549280000000001 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.462274+0000", 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.455e-05 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.462288+0000", 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3324e-05 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.462352+0000", 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4604999999999996e-05 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.462371+0000", 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8569000000000001e-05 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.467060+0000", 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0046891240000000002 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.467128+0000", 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8273000000000002e-05 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.524 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1307 3.5 e69/23 3:a2bd762b:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_7:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.470495+0000", 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.96136039699999998, 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093253840000000008, 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.470495+0000", 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.470495+0000", 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.470497+0000", 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.866e-06 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474542+0000", 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040450709999999999 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474581+0000", 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8473999999999998e-05 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474599+0000", 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8165e-05 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474693+0000", 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4580999999999995e-05 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474722+0000", 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8308000000000001e-05 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.479763+0000", 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0050412879999999997 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.479821+0000", 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7630999999999998e-05 2024-05-10T09:56:33.528 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1310 3.2 3:43af6b18:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.92846824400000005, 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016309814999999998, 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.529 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1310 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:33.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503390+0000", 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1210000000000001e-06 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505146+0000", 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017568099999999999 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505168+0000", 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1452000000000001e-05 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505178+0000", 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9629999999999993e-06 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505239+0000", 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1223000000000007e-05 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505358+0000", 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119172 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505478+0000", 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120065 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.510352+0000", 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048741039999999998 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519563+0000", 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092107189999999992 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519639+0000", 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6050999999999994e-05 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519697+0000", 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8134999999999998e-05 2024-05-10T09:56:33.534 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1311 3.8 3:109d3dab:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.514617+0000", 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.917238844, 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010599295999999999, 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:33.535 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1311 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.514617+0000", 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.514617+0000", 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.514620+0000", 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.824e-06 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.516692+0000", 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020723579999999998 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.516728+0000", 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6386e-05 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.516745+0000", 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6682999999999999e-05 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.516839+0000", 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3548999999999995e-05 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.517032+0000", 2024-05-10T09:56:33.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000192871 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.517203+0000", 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000171366 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.524739+0000", 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0075363519999999996 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.525142+0000", 2024-05-10T09:56:33.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040311200000000001 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.525184+0000", 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1205000000000003e-05 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.525216+0000", 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589999999999998e-05 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:33.540 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:33.541 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:33.542 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:33.542 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:33.543+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:33.635 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:33.643 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:33.643+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:33.672 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:33.672 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:33.672 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:33.672 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:33.686 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:33.744 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:33.742+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:33.787 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:33.788 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:33.804 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:33.804 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:33.821 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:33.821 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:33.838 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:33.838 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:33.846 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:33.847+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:33.860 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:33.860 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:33.861 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:33.861 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:33.875 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:33.879 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:33.879 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:33.899 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:33.900 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:33.904 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:33.904 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:33.962 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:33.963+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:34.042 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:34.042 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:34.047 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:34.047+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:34.056 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:34.148 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:34.147+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:34.222 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:34.223 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:34.237 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:34.282 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:34.283+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:34.351 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:34.351+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:34.367 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:56:34.421 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:34.421 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:34.438 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:34.482 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:34.483+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:34.543 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.5 2024-05-10T09:56:34.543 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:34.543 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 6 2024-05-10T09:56:34.553 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:34.550+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:34.612 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:34.612 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:34.617 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:34.617 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:34.617 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0719905 s, 1.5 GB/s 2024-05-10T09:56:34.626 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:34.653 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:34.650+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:34.748 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:34.748 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:34.754 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:34.755+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:34.763 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:34.855 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:34.855+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:34.932 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:34.933 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:34.950 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:34.994 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:34.995+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:35.056 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:35.055+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:35.134 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:35.134 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:35.148 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:35.196 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:35.194+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:35.257 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:35.254+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:35.307 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:35.307 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:35.326 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:35.358 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:35.359+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:35.383 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.6 2024-05-10T09:56:35.383 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:35.383 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 7 2024-05-10T09:56:35.459 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:35.459+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:35.460 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:35.460 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:35.460 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0753391 s, 1.4 GB/s 2024-05-10T09:56:35.501 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:35.502 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:35.516 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:35.560 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:35.558+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:35.661 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:35.658+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:35.690 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:35.690 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:35.710 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:35.764 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:35.763+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:35.863 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:35.863+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:35.905 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:35.913 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:35.914 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:35.942 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:35.983 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:35.982+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:36.041 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.7 2024-05-10T09:56:36.042 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:36.042 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 8 2024-05-10T09:56:36.065 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:36.062+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:36.070 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:36.071 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:36.088 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:36.088 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:36.106 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:36.106 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:36.111 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:36.112 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:36.112 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:36.112 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:36.112 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:36.115 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:36.115 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:36.115 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0720384 s, 1.5 GB/s 2024-05-10T09:56:36.124 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:36.124 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:36.125 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:36.127 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:36.145 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:36.145 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:36.166 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:36.166 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:36.167 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:36.167+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:36.187 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:36.187 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:36.191 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:36.191 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 112.615871992, 2024-05-10T09:56:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:36.267 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.268 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:36.269 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:36.270 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.271 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.528207536, 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092460089999999995, 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.272 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 208 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.273 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734886+0000", 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734888+0000", 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6800000000000002e-06 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734901+0000", 2024-05-10T09:56:36.274 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2473999999999999e-05 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734933+0000", 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2486e-05 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.734949+0000", 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5594e-05 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.275 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735089+0000", 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013979500000000001 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.735100+0000", 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1533e-05 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740209+0000", 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051088050000000001 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.276 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.740562+0000", 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00035320300000000001 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.741333+0000", 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00077049900000000001 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.742696+0000", 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013629099999999999 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.277 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.743975+0000", 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001278974 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744067+0000", 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2165999999999998e-05 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.744132+0000", 2024-05-10T09:56:36.278 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4889999999999997e-05 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.49349232199999, 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041739309999999996, 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.279 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 212 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769601+0000", 2024-05-10T09:56:36.280 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769604+0000", 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.554e-06 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769617+0000", 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3132999999999999e-05 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.281 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769649+0000", 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2413000000000003e-05 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769667+0000", 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8034e-05 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.769814+0000", 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014651900000000001 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.282 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770181+0000", 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00036769999999999999 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.770904+0000", 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00072282499999999996 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.772517+0000", 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001613225 2024-05-10T09:56:36.283 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773619+0000", 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001101636 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773707+0000", 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7948999999999994e-05 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.284 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.773775+0000", 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7942999999999996e-05 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.467110342, 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033135399999999998, 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.285 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 219 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795983+0000", 2024-05-10T09:56:36.286 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795985+0000", 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4700000000000001e-06 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.795998+0000", 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2673e-05 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.287 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796031+0000", 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3256999999999997e-05 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796047+0000", 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5937e-05 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796169+0000", 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121982 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.288 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796401+0000", 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000231871 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.796844+0000", 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000442461 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.798391+0000", 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015473819999999999 2024-05-10T09:56:36.289 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799101+0000", 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00070989499999999999 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799226+0000", 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125456 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.290 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.799297+0000", 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0155999999999997e-05 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.44908027, 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033653289999999998, 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.291 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 224 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814013+0000", 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814015+0000", 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3369999999999998e-06 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814028+0000", 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2279999999999999e-05 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814060+0000", 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2815999999999999e-05 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814077+0000", 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6753999999999999e-05 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814216+0000", 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013896199999999999 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814433+0000", 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021714799999999999 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.814901+0000", 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046719699999999998 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.816109+0000", 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012087479999999999 2024-05-10T09:56:36.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817218+0000", 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001108688 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817311+0000", 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.817378+0000", 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7076000000000006e-05 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.415417999, 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033933330000000001, 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.297 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 233 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847675+0000", 2024-05-10T09:56:36.298 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847678+0000", 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3929999999999998e-06 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847692+0000", 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4394e-05 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847749+0000", 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6808999999999998e-05 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847773+0000", 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4012999999999999e-05 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.847893+0000", 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119986 2024-05-10T09:56:36.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848120+0000", 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000227025 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.848550+0000", 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042966400000000001 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850033+0000", 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014838729999999999 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850853+0000", 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081979100000000005 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.850947+0000", 2024-05-10T09:56:36.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3401999999999998e-05 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.851069+0000", 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121983 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.303 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.066662772, 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032663039999999998, 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 733 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196431+0000", 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196433+0000", 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:36.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196446+0000", 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3477e-05 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196480+0000", 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3105999999999998e-05 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196496+0000", 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6104e-05 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.196655+0000", 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015885500000000001 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197026+0000", 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037118399999999999 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.197631+0000", 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00060514599999999998 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.198887+0000", 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001256201 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199548+0000", 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066088200000000001 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199631+0000", 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2902e-05 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.199697+0000", 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5987000000000004e-05 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.309 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 104.917576353, 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0034385459999999998, 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.310 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 796 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345517+0000", 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345519+0000", 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2139999999999999e-06 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345535+0000", 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5713e-05 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345567+0000", 2024-05-10T09:56:36.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1949000000000002e-05 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345582+0000", 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5184000000000001e-05 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.345729+0000", 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000147482 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.313 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346092+0000", 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000362068 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.346656+0000", 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00056458599999999995 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.347979+0000", 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013224739999999999 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348670+0000", 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069097799999999997 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348829+0000", 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015923200000000001 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.348956+0000", 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126666 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.315 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 104.91279107299999, 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032973830000000001, 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.316 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 798 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350302+0000", 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350304+0000", 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1469999999999999e-06 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350316+0000", 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2036e-05 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350351+0000", 2024-05-10T09:56:36.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4230000000000003e-05 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350366+0000", 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5803000000000001e-05 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350497+0000", 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000130579 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.319 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.350737+0000", 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023948900000000001 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.351264+0000", 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052708599999999996 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.352543+0000", 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012795339999999999 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353303+0000", 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00076033100000000005 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353478+0000", 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017501499999999999 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.353600+0000", 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012113299999999999 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.321 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 104.66739713, 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033167299999999999, 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.322 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 903 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595696+0000", 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595698+0000", 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7799999999999999e-06 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595728+0000", 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0349999999999999e-05 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595763+0000", 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4762999999999999e-05 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595777+0000", 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3492999999999999e-05 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.595917+0000", 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140032 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596168+0000", 2024-05-10T09:56:36.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00025168199999999998 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.596664+0000", 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049531 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598033+0000", 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013693729999999999 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598733+0000", 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069996200000000005 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.598892+0000", 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000159312 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.599013+0000", 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120673 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.327 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1274 3.8 e69/23 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.5173439120000003, 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015717301999999999, 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.328 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745751+0000", 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8789999999999999e-06 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748049+0000", 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022981820000000002 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748076+0000", 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6361999999999999e-05 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748093+0000", 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7329e-05 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748193+0000", 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9562000000000007e-05 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748228+0000", 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4962999999999997e-05 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761399+0000", 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013171173 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761467+0000", 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7852e-05 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1275 3.4 3:20482490:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.5106370580000004, 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011423600000000001, 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1275 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752458+0000", 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7039999999999999e-06 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754116+0000", 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016577129999999999 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754147+0000", 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1782999999999997e-05 2024-05-10T09:56:36.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754161+0000", 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3715e-05 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754265+0000", 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103349 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754448+0000", 2024-05-10T09:56:36.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018395900000000001 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754563+0000", 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114115 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763241+0000", 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086780859999999998 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763738+0000", 2024-05-10T09:56:36.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049755700000000003 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763816+0000", 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7987999999999999e-05 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763880+0000", 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3631000000000001e-05 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.338 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1280 3.32 e69/23 3:4e344d04:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_8:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.806863+0000", 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.4562304690000003, 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071342799999999998, 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.806863+0000", 2024-05-10T09:56:36.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.806863+0000", 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.806865+0000", 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9489999999999999e-06 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808805+0000", 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019400559999999999 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808838+0000", 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2877999999999999e-05 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808853+0000", 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5284000000000001e-05 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808949+0000", 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6063999999999994e-05 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.808982+0000", 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3281000000000002e-05 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.813938+0000", 2024-05-10T09:56:36.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0049555620000000002 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.813997+0000", 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9206000000000002e-05 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1285 3.21 e69/42 3:85614eff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_13:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.862981+0000", 2024-05-10T09:56:36.343 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.4001126690000003, 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010298774, 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862981+0000", 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862981+0000", 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862983+0000", 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8870000000000001e-06 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865389+0000", 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002406034 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865417+0000", 2024-05-10T09:56:36.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8493e-05 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865431+0000", 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4209999999999999e-05 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865524+0000", 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2519e-05 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865558+0000", 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4616999999999997e-05 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873194+0000", 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0076351600000000002 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873279+0000", 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5853999999999995e-05 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.347 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1286 3.25 3:a4ea653e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3911149810000003, 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010955397, 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.348 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1286 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871981+0000", 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7410000000000001e-06 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874251+0000", 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022695770000000001 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874271+0000", 2024-05-10T09:56:36.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9870000000000001e-05 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874280+0000", 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2779999999999999e-06 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874348+0000", 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8518999999999999e-05 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874512+0000", 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016358200000000001 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874616+0000", 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103924 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.879896+0000", 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052805279999999996 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882804+0000", 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029073749999999998 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882877+0000", 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2788999999999997e-05 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882934+0000", 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7213999999999998e-05 2024-05-10T09:56:36.353 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1288 3.1a e69/23 3:5902eff1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_16:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3628933649999997, 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013345268, 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900205+0000", 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1390000000000003e-06 2024-05-10T09:56:36.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906219+0000", 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060138969999999998 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906247+0000", 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7881999999999998e-05 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906259+0000", 2024-05-10T09:56:36.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2334000000000001e-05 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906321+0000", 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2045999999999995e-05 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906353+0000", 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622000000000003e-05 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913476+0000", 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071233490000000002 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913545+0000", 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8998999999999994e-05 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1293 3.19 3:997ed118:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.947092+0000", 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3160013130000001, 2024-05-10T09:56:36.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010103699000000001, 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1293 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.947092+0000", 2024-05-10T09:56:36.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.947092+0000", 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.947094+0000", 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1449999999999998e-06 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.948797+0000", 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001703099 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.948830+0000", 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2262999999999999e-05 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.948841+0000", 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1297e-05 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.948925+0000", 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4033e-05 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949120+0000", 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019496199999999999 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949292+0000", 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017214800000000001 2024-05-10T09:56:36.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.956569+0000", 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072771650000000004 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.957073+0000", 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00050391900000000002 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.957144+0000", 2024-05-10T09:56:36.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1206999999999998e-05 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.957196+0000", 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1461000000000001e-05 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1303 3.6 e69/23 3:6092e388:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_3:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.8375477999999998, 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015397114999999999, 2024-05-10T09:56:36.364 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425547+0000", 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5889999999999999e-06 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428542+0000", 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029953570000000001 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428568+0000", 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5621000000000001e-05 2024-05-10T09:56:36.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428582+0000", 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3560999999999999e-05 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428719+0000", 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013757600000000001 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428764+0000", 2024-05-10T09:56:36.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4425999999999998e-05 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.440889+0000", 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012125095000000001 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.440943+0000", 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3890000000000001e-05 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.368 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1308 3.6 e69/23 3:62f870a7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_8:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.484969+0000", 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.7781247369999997, 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092642929999999998, 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484969+0000", 2024-05-10T09:56:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484969+0000", 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484970+0000", 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7969999999999999e-06 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.370 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.486762+0000", 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001791894 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.486814+0000", 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1555999999999999e-05 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.486829+0000", 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5102999999999999e-05 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.486922+0000", 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3368999999999993e-05 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.486950+0000", 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7495e-05 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.494144+0000", 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007193891 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.494233+0000", 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9188000000000001e-05 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1311 3.8 e69/23 3:109d3dab:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_11:head v 69'4, mlcod=68'2)", 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.517964+0000", 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.7451294219999998, 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0070148550000000004, 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.373 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.517964+0000", 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.517964+0000", 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.517966+0000", 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0159999999999998e-06 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519183+0000", 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012175840000000001 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519209+0000", 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5689000000000001e-05 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519223+0000", 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3912e-05 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519311+0000", 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8319000000000006e-05 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519346+0000", 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4252999999999999e-05 2024-05-10T09:56:36.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.524910+0000", 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055639469999999996 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.524979+0000", 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9134999999999995e-05 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.377 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:36.379 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:36.379 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:36.379+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:36.416 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:56:36.480 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:36.478+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:36.580 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:36.578+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:36.594 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:36.594 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:36.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.594 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1413 3.36 e71/42 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head v 71'3, mlcod=69'1)", 2024-05-10T09:56:36.594 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:36.594 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.012931246, 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012979598, 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "started", 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580561+0000", 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6420000000000001e-06 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588455+0000", 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078937079999999993 2024-05-10T09:56:36.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588485+0000", 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0411000000000001e-05 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588499+0000", 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3370000000000001e-05 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588602+0000", 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010296 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588630+0000", 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8904999999999999e-05 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.598 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.599 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:56:36.599 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 1 2024-05-10T09:56:36.599 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:36.629 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:36.681 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:36.683+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:36.728 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.8 2024-05-10T09:56:36.729 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:36.729 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 9 2024-05-10T09:56:36.782 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:36.778+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:36.796 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:36.797 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:36.797 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:36.797 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:36.797 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:36.801 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:36.801 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:36.801 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0707745 s, 1.5 GB/s 2024-05-10T09:56:36.812 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:36.883 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:36.883+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:36.979 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:36.979 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:36.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:36.979 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:36.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.979 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 109.252097562, 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047201730000000003, 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 52 2024-05-10T09:56:36.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724041+0000", 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724044+0000", 2024-05-10T09:56:36.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.388e-06 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724058+0000", 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3949e-05 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724098+0000", 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9993999999999997e-05 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724116+0000", 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724285+0000", 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016974399999999999 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724625+0000", 2024-05-10T09:56:36.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00033982100000000002 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.724957+0000", 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000332083 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.726214+0000", 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0012567209999999999 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728493+0000", 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022787720000000001 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728638+0000", 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145599 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:47.728761+0000", 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000122679 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.985 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 106.117839395, 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031940240000000002, 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.986 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 236 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858299+0000", 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.987 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858301+0000", 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3499999999999999e-06 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858313+0000", 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1936000000000001e-05 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858344+0000", 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0870000000000001e-05 2024-05-10T09:56:36.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858367+0000", 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2606e-05 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858501+0000", 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013411299999999999 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.858723+0000", 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00022167500000000001 2024-05-10T09:56:36.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.859156+0000", 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043338699999999998 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.860688+0000", 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015322160000000001 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861328+0000", 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00063973899999999995 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861422+0000", 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3698999999999999e-05 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.861493+0000", 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1433000000000005e-05 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.991 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 106.10441208, 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0033462549999999998, 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 283 2024-05-10T09:56:36.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871726+0000", 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:36.993 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871727+0000", 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0330000000000001e-06 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871734+0000", 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0949999999999998e-06 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871748+0000", 2024-05-10T09:56:36.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3468999999999999e-05 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871756+0000", 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8210000000000002e-06 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871813+0000", 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7683000000000003e-05 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:36.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.871903+0000", 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9951999999999995e-05 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872086+0000", 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018229100000000001 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.872901+0000", 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00081514999999999995 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875001+0000", 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020996970000000002 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875034+0000", 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3488999999999997e-05 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:50.875073+0000", 2024-05-10T09:56:36.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8575000000000003e-05 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.37030944, 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0036342280000000002, 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:36.998 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 907 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:36.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605829+0000", 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605832+0000", 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.52e-06 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605844+0000", 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.261e-05 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605877+0000", 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589000000000003e-05 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.605894+0000", 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7227e-05 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606067+0000", 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017324199999999999 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.606458+0000", 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039087399999999998 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.607050+0000", 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000592243 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.608380+0000", 2024-05-10T09:56:37.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013300709999999999 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609168+0000", 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00078785699999999999 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609345+0000", 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176446 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.609463+0000", 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011854900000000001 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.365373808, 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0031459869999999998, 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 909 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610765+0000", 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610767+0000", 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9999999999999999e-06 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610776+0000", 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4259999999999992e-06 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610801+0000", 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.531e-05 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610814+0000", 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.275e-05 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.610939+0000", 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000125229 2024-05-10T09:56:37.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611184+0000", 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024509199999999998 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.611675+0000", 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049021899999999996 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613036+0000", 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013614969999999999 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613749+0000", 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000712712 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613845+0000", 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6150000000000006e-05 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.613911+0000", 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5602e-05 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.27221216, 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003279138, 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 949 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.011 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703926+0000", 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703929+0000", 2024-05-10T09:56:37.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703941+0000", 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.252e-05 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703973+0000", 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.116e-05 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.703988+0000", 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5396999999999998e-05 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704148+0000", 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000160149 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.704533+0000", 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00038502300000000002 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.705129+0000", 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00059582000000000005 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.706308+0000", 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011793249999999999 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707021+0000", 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00071263499999999998 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707109+0000", 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8206000000000002e-05 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.707205+0000", 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6323000000000006e-05 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-05-10T09:56:37.016 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 105.25815444600001, 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0035068059999999999, 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 955 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717984+0000", 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717987+0000", 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5799999999999999e-06 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.717999+0000", 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2414e-05 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718037+0000", 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7786e-05 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718053+0000", 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5817000000000001e-05 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718198+0000", 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014561199999999999 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.718544+0000", 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000345531 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:37.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.719080+0000", 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00053664299999999995 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.720577+0000", 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0014965989999999999 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721269+0000", 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00069215200000000002 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721366+0000", 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7046000000000006e-05 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:51.721491+0000", 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000124626 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.022 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1273 3.2d e69/23 3:b59bb266:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_1:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.237919668, 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013030055, 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.35e-07 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744317+0000", 2024-05-10T09:56:37.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060981630000000002 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744349+0000", 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744363+0000", 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4742e-05 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744467+0000", 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103656 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744487+0000", 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9893000000000001e-05 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751184+0000", 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066971670000000004 2024-05-10T09:56:37.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751249+0000", 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4789000000000006e-05 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1275 3.4 e69/23 3:20482490:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_3:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.221454295, 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088205420000000007, 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.027 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754686+0000", 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9589999999999998e-06 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756627+0000", 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001940747 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756656+0000", 2024-05-10T09:56:37.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8906000000000001e-05 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756671+0000", 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5571000000000001e-05 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756746+0000", 2024-05-10T09:56:37.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4738000000000002e-05 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756775+0000", 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8983e-05 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763456+0000", 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006681279 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763505+0000", 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8359000000000002e-05 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1277 3.2d e69/23 3:b6aa08bb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_5:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1960513129999999, 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010253787, 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.032 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780089+0000", 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7770000000000001e-06 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784360+0000", 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042708809999999998 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784397+0000", 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7314999999999998e-05 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784413+0000", 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6065e-05 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784553+0000", 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013986099999999999 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784614+0000", 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0718999999999999e-05 2024-05-10T09:56:37.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.790273+0000", 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056590240000000003 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.790341+0000", 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8145000000000006e-05 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.036 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1284 3.36 e69/42 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1215255119999998, 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010399762999999999, 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854615+0000", 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4380000000000002e-06 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858639+0000", 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040232239999999997 2024-05-10T09:56:37.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858672+0000", 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3149999999999999e-05 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858689+0000", 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7342000000000001e-05 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858762+0000", 2024-05-10T09:56:37.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3162000000000002e-05 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858782+0000", 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9330999999999998e-05 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.864942+0000", 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061601889999999999 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865013+0000", 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0926999999999994e-05 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1285 3.21 3:85614eff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1165581429999998, 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014048458, 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.041 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1285 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:37.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859583+0000", 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.932e-06 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862407+0000", 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028238030000000002 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862436+0000", 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9264999999999998e-05 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862452+0000", 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6161999999999999e-05 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862553+0000", 2024-05-10T09:56:37.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001002 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862721+0000", 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016805100000000001 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862850+0000", 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012889600000000001 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873327+0000", 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010477288 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873512+0000", 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018525099999999999 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873586+0000", 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3559999999999994e-05 2024-05-10T09:56:37.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873629+0000", 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3050000000000003e-05 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1293 3.19 e69/42 3:997ed118:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_21:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:37.047 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.026724862, 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074932560000000002, 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949416+0000", 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.357e-06 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951211+0000", 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017950209999999999 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951243+0000", 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1745999999999997e-05 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951259+0000", 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6274e-05 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951344+0000", 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4974000000000003e-05 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951375+0000", 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0580999999999997e-05 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.956850+0000", 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054756789999999998 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.956907+0000", 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6623999999999999e-05 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1396 3.3b e71/23 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head v 71'3, mlcod=68'1)", 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.612621835, 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020899485999999998, 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.052 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363519+0000", 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370796+0000", 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00727693 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370839+0000", 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2802000000000001e-05 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370857+0000", 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8703e-05 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371003+0000", 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145668 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371048+0000", 2024-05-10T09:56:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4512999999999999e-05 2024-05-10T09:56:37.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.057 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.057 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.057 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384144+0000", 2024-05-10T09:56:37.057 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013096607 2024-05-10T09:56:37.057 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.058 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.058 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.058 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384416+0000", 2024-05-10T09:56:37.058 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000271883 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1398 3.2e 3:74667c03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.597399456, 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019068742, 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.059 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1398 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.060 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378742+0000", 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0299999999999998e-06 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380905+0000", 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021633329999999999 2024-05-10T09:56:37.061 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380931+0000", 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5216e-05 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380945+0000", 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4579999999999999e-05 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.062 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381044+0000", 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8981000000000007e-05 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381262+0000", 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218221 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381455+0000", 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019242599999999999 2024-05-10T09:56:37.063 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.389370+0000", 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079151280000000004 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397668+0000", 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.008297759 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.064 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397742+0000", 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3872e-05 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397808+0000", 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6196000000000001e-05 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.065 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1399 3.39 3:9c26c45b:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.391358+0000", 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.58478068400000005, 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010295924, 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1399 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.066 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.391358+0000", 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.391358+0000", 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.067 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.391361+0000", 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1489999999999998e-06 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393120+0000", 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017589389999999999 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393149+0000", 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8719999999999999e-05 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.068 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393173+0000", 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4913999999999999e-05 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393253+0000", 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9419000000000007e-05 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393450+0000", 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019676599999999999 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.069 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393598+0000", 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014866099999999999 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.401049+0000", 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074503379999999999 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.401569+0000", 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052016599999999997 2024-05-10T09:56:37.070 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.401617+0000", 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7825999999999999e-05 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.401654+0000", 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7026000000000001e-05 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.071 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1402 3.2d e71/23 3:b5eccbcc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_7:head v 71'3, mlcod=69'1)", 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.54583316100000001, 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010699695, 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.072 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430307+0000", 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.288e-06 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435405+0000", 2024-05-10T09:56:37.073 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0050987070000000001 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435436+0000", 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1177000000000003e-05 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435451+0000", 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.501e-05 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.074 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435536+0000", 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4101e-05 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435564+0000", 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8818000000000001e-05 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440940+0000", 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053758870000000002 2024-05-10T09:56:37.075 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.441005+0000", 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4707000000000002e-05 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1410 3.3d e71/23 3:be56ca3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_15:head v 71'3, mlcod=71'1)", 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.535927+0000", 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.44021111200000002, 2024-05-10T09:56:37.076 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086678729999999996, 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535927+0000", 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535927+0000", 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.077 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535930+0000", 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3989999999999998e-06 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.537986+0000", 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020562010000000001 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.538015+0000", 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8629e-05 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.078 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.538030+0000", 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5111e-05 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.538134+0000", 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103897 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.538161+0000", 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7149999999999999e-05 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.079 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.544533+0000", 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0063721239999999998 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.544595+0000", 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2361999999999997e-05 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.080 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1413 3.36 e71/42 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head v 71'3, mlcod=69'1)", 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.39558397099999998, 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019195001, 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.081 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580561+0000", 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6420000000000001e-06 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.082 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588455+0000", 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078937079999999993 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588485+0000", 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0411000000000001e-05 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588499+0000", 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3370000000000001e-05 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.083 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588602+0000", 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010296 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588630+0000", 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8904999999999999e-05 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599682+0000", 2024-05-10T09:56:37.084 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011051963999999999 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599749+0000", 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7040999999999997e-05 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1417 3.2e 3:75940b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.34378009900000001, 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018750408999999999, 2024-05-10T09:56:37.085 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1417 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.086 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632361+0000", 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1030000000000002e-06 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635167+0000", 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028054070000000002 2024-05-10T09:56:37.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635203+0000", 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6476000000000001e-05 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635220+0000", 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6393999999999999e-05 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635311+0000", 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1445000000000003e-05 2024-05-10T09:56:37.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635439+0000", 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012746900000000001 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635545+0000", 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106335 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.640654+0000", 2024-05-10T09:56:37.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051087379999999998 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651021+0000", 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01036726 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651068+0000", 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7182999999999999e-05 2024-05-10T09:56:37.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651109+0000", 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0599000000000002e-05 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.091 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:37.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:37.093 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:37.090+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:37.193 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:37.190+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:37.294 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:37.295+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:37.300 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1443 3.2 3:41167866:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.0089499479999999992, 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0089731389999999998, 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "waiting for sub ops", 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1443 2024-05-10T09:56:37.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291684+0000", 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.19e-06 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293265+0000", 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015814449999999999 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293300+0000", 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4486000000000002e-05 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293314+0000", 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4535999999999999e-05 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293443+0000", 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012858999999999999 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293707+0000", 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026414400000000001 2024-05-10T09:56:37.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293885+0000", 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017773800000000001 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.300013+0000", 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061277579999999996 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:56:37.305 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 1 2024-05-10T09:56:37.306 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:37.317 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:37.368 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.9 2024-05-10T09:56:37.368 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:37.368 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 10 2024-05-10T09:56:37.379 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:56:37.395 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:37.395+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:37.449 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records in 2024-05-10T09:56:37.449 INFO:tasks.workunit.client.0.smithi042.stderr:10+0 records out 2024-05-10T09:56:37.449 INFO:tasks.workunit.client.0.smithi042.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0796163 s, 1.3 GB/s 2024-05-10T09:56:37.476 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:37.476 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:37.476 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:37.476 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:37.476 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:37.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:37.531 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:37.530+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:37.597 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:37.594+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:37.650 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:37.651 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:37.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:37.651 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:37.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.651 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1274 3.8 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.9047898219999997, 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019336196, 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1274 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.652 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.653 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742479+0000", 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8779999999999998e-06 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745161+0000", 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002682135 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745185+0000", 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3611000000000001e-05 2024-05-10T09:56:37.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745194+0000", 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2369999999999998e-06 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745266+0000", 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2008000000000006e-05 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745445+0000", 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179259 2024-05-10T09:56:37.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745624+0000", 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017874300000000001 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756109+0000", 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010485169000000001 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761680+0000", 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055706649999999998 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761755+0000", 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5171000000000002e-05 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761813+0000", 2024-05-10T09:56:37.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.732e-05 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1276 3.23 e69/23 3:c6394aa1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_4:head v 69'4, mlcod=68'2)", 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.766549+0000", 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.8807169449999996, 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0097181639999999996, 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.658 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766549+0000", 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766549+0000", 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766551+0000", 2024-05-10T09:56:37.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.809e-06 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768589+0000", 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00203783 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768619+0000", 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9813000000000001e-05 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768633+0000", 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4591e-05 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768720+0000", 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6520000000000005e-05 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.768749+0000", 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9034999999999999e-05 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776189+0000", 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074401909999999996 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776267+0000", 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8374999999999994e-05 2024-05-10T09:56:37.662 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1281 3.29 3:94644cd5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.8306562939999997, 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021096073, 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.663 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1281 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816613+0000", 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.892e-06 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818489+0000", 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018760599999999999 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818531+0000", 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2070000000000002e-05 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818554+0000", 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2776e-05 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818664+0000", 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011037899999999999 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818882+0000", 2024-05-10T09:56:37.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000217457 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.819053+0000", 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000171187 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.824533+0000", 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054798609999999999 2024-05-10T09:56:37.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837622+0000", 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013089751 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837669+0000", 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6517000000000002e-05 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837706+0000", 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7122999999999997e-05 2024-05-10T09:56:37.668 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1289 3.38 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.7430224059999997, 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022792125999999999, 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.669 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1289 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904247+0000", 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1939999999999998e-06 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906042+0000", 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017947239999999999 2024-05-10T09:56:37.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906083+0000", 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0948999999999997e-05 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906101+0000", 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8442999999999999e-05 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906204+0000", 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103359 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906378+0000", 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000173435 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906536+0000", 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015819099999999999 2024-05-10T09:56:37.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913717+0000", 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071811230000000002 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926882+0000", 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013164765 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926966+0000", 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3579999999999996e-05 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927036+0000", 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0363000000000004e-05 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.675 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1292 3.38 3:1ea9eee7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.7105359719999997, 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01900717, 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1292 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936734+0000", 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4149999999999999e-06 2024-05-10T09:56:37.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938852+0000", 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021187630000000001 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938883+0000", 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0494999999999999e-05 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938901+0000", 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7988000000000001e-05 2024-05-10T09:56:37.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938993+0000", 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2383e-05 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939177+0000", 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018371699999999999 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939324+0000", 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014727499999999999 2024-05-10T09:56:37.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.944680+0000", 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053554379999999997 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955600+0000", 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010920487 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955670+0000", 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0202000000000003e-05 2024-05-10T09:56:37.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955737+0000", 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7007000000000004e-05 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1295 3.c e69/23 3:324d36a8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_23:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.974752+0000", 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.6725144580000002, 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0094545010000000006, 2024-05-10T09:56:37.681 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.974752+0000", 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.974752+0000", 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.974753+0000", 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.376e-06 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979402+0000", 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0046489139999999997 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979416+0000", 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4341e-05 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979427+0000", 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0871e-05 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979498+0000", 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1089999999999999e-05 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.979520+0000", 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1202000000000001e-05 2024-05-10T09:56:37.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.984134+0000", 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0046148229999999997 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.984206+0000", 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1884000000000005e-05 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1296 3.2 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.6264478589999998, 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021264584, 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1296 2024-05-10T09:56:37.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020821+0000", 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3259999999999998e-06 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.021993+0000", 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001172071 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022024+0000", 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1222e-05 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022035+0000", 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1449e-05 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022149+0000", 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011391399999999999 2024-05-10T09:56:37.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022369+0000", 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220079 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022596+0000", 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000226288 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.028699+0000", 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006103163 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042000+0000", 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013301006000000001 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042047+0000", 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6990999999999998e-05 2024-05-10T09:56:37.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042083+0000", 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6075000000000003e-05 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.692 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1298 3.29 3:979982e8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.6011462249999999, 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018739767000000001, 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1298 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046121+0000", 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.508e-06 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047357+0000", 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001235683 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047388+0000", 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0549000000000002e-05 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047404+0000", 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6676000000000001e-05 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047484+0000", 2024-05-10T09:56:37.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9212e-05 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047618+0000", 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013448600000000001 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.048073+0000", 2024-05-10T09:56:37.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045510599999999999 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.055269+0000", 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071963189999999996 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064647+0000", 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093774919999999994 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064781+0000", 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013422999999999999 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064860+0000", 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8505999999999997e-05 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1301 3.23 e69/23 3:c760cb7d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_1:head v 69'5, mlcod=68'3)", 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.399602+0000", 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.2476644190000004, 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010745065, 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399602+0000", 2024-05-10T09:56:37.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399602+0000", 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399604+0000", 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2709999999999999e-06 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404074+0000", 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0044698089999999999 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404124+0000", 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.9885000000000001e-05 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404152+0000", 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8430000000000001e-05 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404264+0000", 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112049 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.404292+0000", 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8143000000000001e-05 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410248+0000", 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0059555420000000003 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410347+0000", 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8936000000000003e-05 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1304 3.28 e69/23 3:17fc7310:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_4:head v 69'4, mlcod=68'2)", 2024-05-10T09:56:37.704 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.2078117869999998, 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012378174, 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439456+0000", 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.37e-06 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443788+0000", 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004332252 2024-05-10T09:56:37.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443829+0000", 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0667999999999998e-05 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443846+0000", 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6932999999999999e-05 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443955+0000", 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109529 2024-05-10T09:56:37.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443997+0000", 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1813000000000001e-05 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.451770+0000", 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007772752 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.451833+0000", 2024-05-10T09:56:37.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2856999999999998e-05 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1307 3.5 e69/23 3:a2bd762b:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_7:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.470495+0000", 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1767708590000003, 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093253840000000008, 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.709 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.470495+0000", 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.470495+0000", 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.470497+0000", 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.866e-06 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474542+0000", 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040450709999999999 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474581+0000", 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8473999999999998e-05 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474599+0000", 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8165e-05 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474693+0000", 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4580999999999995e-05 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.474722+0000", 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8308000000000001e-05 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.479763+0000", 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0050412879999999997 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.479821+0000", 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7630999999999998e-05 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.713 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1310 3.2 3:43af6b18:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1438787059999997, 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016309814999999998, 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.714 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1310 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503390+0000", 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1210000000000001e-06 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505146+0000", 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017568099999999999 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505168+0000", 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1452000000000001e-05 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505178+0000", 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9629999999999993e-06 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505239+0000", 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1223000000000007e-05 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505358+0000", 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119172 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505478+0000", 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120065 2024-05-10T09:56:37.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.510352+0000", 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048741039999999998 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519563+0000", 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092107189999999992 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519639+0000", 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6050999999999994e-05 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519697+0000", 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8134999999999998e-05 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1311 3.8 3:109d3dab:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.514617+0000", 2024-05-10T09:56:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1326493060000002, 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010599295999999999, 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1311 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.514617+0000", 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.514617+0000", 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.514620+0000", 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.824e-06 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.516692+0000", 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020723579999999998 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.516728+0000", 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6386e-05 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.516745+0000", 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6682999999999999e-05 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.516839+0000", 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3548999999999995e-05 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.517032+0000", 2024-05-10T09:56:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000192871 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.517203+0000", 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000171366 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.524739+0000", 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0075363519999999996 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.525142+0000", 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00040311200000000001 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.525184+0000", 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1205000000000003e-05 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.525216+0000", 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2589999999999998e-05 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.726 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1400 3.22 e71/23 3:450b599e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_5:head v 71'2, mlcod=0'0)", 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.408227+0000", 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.239038815, 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01135036, 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.408227+0000", 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.408227+0000", 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.408229+0000", 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6300000000000001e-06 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.413869+0000", 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056398300000000002 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.413910+0000", 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1560999999999997e-05 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.413930+0000", 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9922e-05 2024-05-10T09:56:37.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.414047+0000", 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116815 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.414098+0000", 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1298999999999998e-05 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.419519+0000", 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054209449999999999 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.419578+0000", 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8357999999999999e-05 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.731 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1407 3.7 3:e186c9fd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.490266+0000", 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.156999871, 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014955553, 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1407 2024-05-10T09:56:37.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.490266+0000", 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.490266+0000", 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.490270+0000", 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.535e-06 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.491966+0000", 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016962850000000001 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492000+0000", 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4008999999999999e-05 2024-05-10T09:56:37.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492014+0000", 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3893000000000001e-05 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492095+0000", 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1279999999999994e-05 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492236+0000", 2024-05-10T09:56:37.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140922 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492377+0000", 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140297 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.497239+0000", 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048629169999999996 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.505085+0000", 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078454040000000003 2024-05-10T09:56:37.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.505161+0000", 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6589999999999997e-05 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.505222+0000", 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0421000000000003e-05 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.737 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1426 3.25 e71/23 3:a4c8f94a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_3:head v 71'5, mlcod=71'3)", 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.059651+0000", 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.58761511899999996, 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014845288, 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.738 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059651+0000", 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059651+0000", 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059655+0000", 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4970000000000001e-06 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065528+0000", 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058730450000000003 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065576+0000", 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8133000000000001e-05 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065599+0000", 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3706e-05 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065698+0000", 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8465e-05 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065728+0000", 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9864000000000001e-05 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074426+0000", 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086982870000000007 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074496+0000", 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0290999999999995e-05 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.742 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1434 3.33 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.49147524399999998, 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020822112, 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1434 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155794+0000", 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9100000000000001e-06 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157707+0000", 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001912757 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157746+0000", 2024-05-10T09:56:37.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9848999999999997e-05 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157763+0000", 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6059999999999999e-05 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157837+0000", 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4952999999999999e-05 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157951+0000", 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011310400000000001 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.158086+0000", 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135122 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.164123+0000", 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060373429999999997 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176486+0000", 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012362556 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176558+0000", 2024-05-10T09:56:37.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2453000000000006e-05 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176613+0000", 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5004999999999999e-05 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1438 3.1e 3:7ac7bc5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.749 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.43493401199999998, 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017363922, 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1438 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.750 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212335+0000", 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.83e-06 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214003+0000", 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016675240000000001 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214028+0000", 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5939e-05 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214046+0000", 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7655999999999998e-05 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214129+0000", 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2793000000000005e-05 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214293+0000", 2024-05-10T09:56:37.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163616 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214409+0000", 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116944 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.219268+0000", 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048583680000000001 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229606+0000", 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010338174 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229647+0000", 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1415999999999998e-05 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229696+0000", 2024-05-10T09:56:37.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8662000000000003e-05 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1441 3.2 3:4091da54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.38512724500000001, 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020721976999999999, 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.756 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1441 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262142+0000", 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9019999999999999e-06 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265147+0000", 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030048340000000001 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265183+0000", 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6233999999999999e-05 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265206+0000", 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2866000000000001e-05 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265319+0000", 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113183 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265430+0000", 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110772 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265532+0000", 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102746 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.269542+0000", 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040093459999999996 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282625+0000", 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013083252 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282761+0000", 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135446 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282861+0000", 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010039600000000001 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1443 3.2 3:41167866:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.355585553, 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016390715, 2024-05-10T09:56:37.762 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1443 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:37.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291684+0000", 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.19e-06 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:37.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293265+0000", 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015814449999999999 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293300+0000", 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4486000000000002e-05 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293314+0000", 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4535999999999999e-05 2024-05-10T09:56:37.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293443+0000", 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012858999999999999 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293707+0000", 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026414400000000001 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293885+0000", 2024-05-10T09:56:37.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017773800000000001 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.300013+0000", 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061277579999999996 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.307835+0000", 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078220289999999994 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:37.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.307971+0000", 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013645500000000001 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.308071+0000", 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000100344 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:37.768 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:37.770 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:37.771 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:37.766+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:37.871 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:37.870+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:37.901 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:37.901 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:37.901 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:37.901 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:37.919 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:37.973 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:37.970+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:38.036 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:38.036 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:38.036 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:38.036 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:38.036 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:38.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:38.073 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:38.070+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:38.174 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:38.175+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1278 3.2f 3:f571631c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.3963660979999997, 2024-05-10T09:56:38.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024049979999999999, 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1278 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:38.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786219+0000", 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790848+0000", 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046288800000000001 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790903+0000", 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5396000000000003e-05 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790931+0000", 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7852999999999999e-05 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791091+0000", 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000160085 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791356+0000", 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026496799999999997 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791614+0000", 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000258304 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.801355+0000", 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097402099999999991 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810050+0000", 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086953199999999994 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810149+0000", 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9086000000000006e-05 2024-05-10T09:56:38.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810266+0000", 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116655 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1282 3.1d 3:bb239e62:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:38.190 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.3534512760000004, 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032019191000000002, 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1282 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:38.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829134+0000", 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1700000000000001e-06 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.833983+0000", 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048496269999999996 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834016+0000", 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2459999999999998e-05 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834034+0000", 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8427000000000002e-05 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834157+0000", 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122502 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834453+0000", 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029603700000000003 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:38.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834694+0000", 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024105099999999999 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.857709+0000", 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023014703000000001 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.860974+0000", 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032658309999999999 2024-05-10T09:56:38.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861076+0000", 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010209600000000001 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861150+0000", 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3287000000000005e-05 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1283 3.37 e69/23 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.337530235, 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021592063000000002, 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845054+0000", 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7e-06 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848409+0000", 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003354938 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848451+0000", 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2259999999999999e-05 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848477+0000", 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5829e-05 2024-05-10T09:56:38.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848600+0000", 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122516 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848685+0000", 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4759000000000006e-05 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866565+0000", 2024-05-10T09:56:38.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017880391999999998 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866644+0000", 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8669000000000002e-05 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.201 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1289 3.38 e69/23 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.2743504430000003, 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019676500999999999, 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:38.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908234+0000", 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912818+0000", 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045836089999999998 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912865+0000", 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6959999999999998e-05 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912889+0000", 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4153000000000001e-05 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.913037+0000", 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014763499999999999 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.913095+0000", 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8158999999999997e-05 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.927816+0000", 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014720746 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.927908+0000", 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2158999999999996e-05 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1290 3.1d 3:ba11a2de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:38.206 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.2649465329999998, 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026748503999999999, 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1290 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917638+0000", 2024-05-10T09:56:38.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0570000000000001e-06 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922152+0000", 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045138899999999996 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922203+0000", 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0649000000000002e-05 2024-05-10T09:56:38.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922222+0000", 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9470000000000002e-05 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922397+0000", 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174575 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922662+0000", 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026555799999999999 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922907+0000", 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024483699999999997 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.937015+0000", 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014107511 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944214+0000", 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071986680000000001 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944311+0000", 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7806000000000005e-05 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944384+0000", 2024-05-10T09:56:38.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2483000000000004e-05 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1294 3.3a 3:5c4910a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.2230364949999997, 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019051561000000002, 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1294 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959549+0000", 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.207e-06 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964361+0000", 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048128509999999999 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964396+0000", 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4656000000000002e-05 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964421+0000", 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5057000000000001e-05 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964573+0000", 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015201099999999999 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964830+0000", 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025683800000000001 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.965066+0000", 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000236188 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.973334+0000", 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082677270000000008 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978324+0000", 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049900120000000003 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978481+0000", 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157522 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978597+0000", 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115492 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.219 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1295 3.c 3:324d36a8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.2133265880000002, 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016839302, 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1295 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969258+0000", 2024-05-10T09:56:38.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8930000000000001e-06 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975186+0000", 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059273879999999996 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975219+0000", 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3114999999999997e-05 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975244+0000", 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5117e-05 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975367+0000", 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012329600000000001 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975622+0000", 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025457000000000002 2024-05-10T09:56:38.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975849+0000", 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022689100000000001 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.984503+0000", 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086545649999999995 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.985938+0000", 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014345759999999999 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.986028+0000", 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9992000000000002e-05 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.986095+0000", 2024-05-10T09:56:38.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6898999999999998e-05 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1296 3.2 e69/23 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.1578587420000002, 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018465083, 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.226 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024740+0000", 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6575999999999999e-05 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033470+0000", 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0087304400000000008 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033505+0000", 2024-05-10T09:56:38.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4666000000000003e-05 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033521+0000", 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6730000000000001e-05 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033676+0000", 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000154439 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033717+0000", 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0763000000000003e-05 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.043060+0000", 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0093434929999999996 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.043188+0000", 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127976 2024-05-10T09:56:38.230 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1304 3.28 3:17fc7310:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.7486121079999997, 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019639535999999999, 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.231 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1304 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433974+0000", 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4660000000000001e-06 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439744+0000", 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057702939999999996 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439780+0000", 2024-05-10T09:56:38.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5880000000000002e-05 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439806+0000", 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5729999999999999e-05 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440017+0000", 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000211225 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440286+0000", 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026847399999999999 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440531+0000", 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024496400000000002 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.448055+0000", 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0075244780000000002 2024-05-10T09:56:38.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453518+0000", 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0054625749999999999 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453566+0000", 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7890999999999999e-05 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453609+0000", 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3559000000000001e-05 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1400 3.22 3:450b599e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.7782675139999999, 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017183650000000002, 2024-05-10T09:56:38.237 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1400 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:38.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404318+0000", 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6600000000000001e-06 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408668+0000", 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043499589999999996 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408709+0000", 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0580000000000001e-05 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408728+0000", 2024-05-10T09:56:38.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9698999999999999e-05 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408930+0000", 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020164900000000001 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.409187+0000", 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025756999999999999 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.409423+0000", 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000235565 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.419973+0000", 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010550426 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421320+0000", 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001346243 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421427+0000", 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107576 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421498+0000", 2024-05-10T09:56:38.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0722999999999994e-05 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1409 3.30 3:0da814af:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.6615598839999999, 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018836762999999999, 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.244 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1409 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521026+0000", 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5599999999999998e-06 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526195+0000", 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051697829999999998 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526237+0000", 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1640000000000001e-05 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526256+0000", 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8902999999999998e-05 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526415+0000", 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015881900000000001 2024-05-10T09:56:38.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526672+0000", 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025730399999999997 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526924+0000", 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025230400000000002 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.536038+0000", 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091132899999999996 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539684+0000", 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036459589999999998 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539785+0000", 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101549 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539859+0000", 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3652000000000006e-05 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1418 3.28 3:14cb8ba5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.538349381, 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016341517999999999, 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1418 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644237+0000", 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8670000000000002e-06 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650393+0000", 2024-05-10T09:56:38.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006155275 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650434+0000", 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1492000000000002e-05 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650453+0000", 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8830000000000001e-05 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650590+0000", 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013698900000000001 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650842+0000", 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025209100000000002 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.651080+0000", 2024-05-10T09:56:38.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023778100000000001 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.659932+0000", 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088523860000000003 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660404+0000", 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047188599999999997 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660503+0000", 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8819000000000004e-05 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660574+0000", 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1101999999999998e-05 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1425 3.3a 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:38.256 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.1360702490000001, 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.031419395000000003, 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1425 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.257 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046517+0000", 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2639999999999999e-06 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055240+0000", 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.008723158 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055281+0000", 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1344999999999998e-05 2024-05-10T09:56:38.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055301+0000", 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9317000000000002e-05 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055513+0000", 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021243799999999999 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055925+0000", 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041220299999999998 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.056338+0000", 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041247899999999999 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.071484+0000", 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015146359 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077627+0000", 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0061428050000000003 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077805+0000", 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017845400000000001 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077931+0000", 2024-05-10T09:56:38.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000125573 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1429 3.16 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.0912736620000001, 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029834811999999999, 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.263 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1429 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091311+0000", 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.914e-06 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095902+0000", 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045904589999999999 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095938+0000", 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6043e-05 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095955+0000", 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7096e-05 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096104+0000", 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149555 2024-05-10T09:56:38.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096348+0000", 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024343499999999999 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096601+0000", 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025365799999999998 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.104881+0000", 2024-05-10T09:56:38.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082796310000000008 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120963+0000", 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016081813 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121062+0000", 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9098999999999994e-05 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121143+0000", 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1108999999999999e-05 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1439 3.22 3:47e84655:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.95529188200000004, 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017195082, 2024-05-10T09:56:38.269 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1439 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227293+0000", 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232364+0000", 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050709479999999996 2024-05-10T09:56:38.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232404+0000", 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9895999999999999e-05 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232425+0000", 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0696e-05 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232599+0000", 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000173955 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232995+0000", 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039625000000000001 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.233424+0000", 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042866900000000001 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.242477+0000", 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090527170000000001 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244152+0000", 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016750140000000001 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244358+0000", 2024-05-10T09:56:38.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206825 2024-05-10T09:56:38.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244485+0000", 2024-05-10T09:56:38.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012660199999999999 2024-05-10T09:56:38.275 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.277 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.277 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1440 3.1f e71/23 3:f8aeb630:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_17:head v 71'5, mlcod=68'3)", 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.93467704200000001, 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016924982000000002, 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247907+0000", 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0870000000000001e-06 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253015+0000", 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051077270000000003 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253047+0000", 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.201e-05 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253063+0000", 2024-05-10T09:56:38.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6433e-05 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253221+0000", 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015811199999999999 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253264+0000", 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3056000000000002e-05 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.264717+0000", 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011452664 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.264830+0000", 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112893 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1441 3.2 e71/23 3:4091da54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_18:head v 71'4, mlcod=69'2)", 2024-05-10T09:56:38.282 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.91530176399999996, 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016375244000000001, 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267283+0000", 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6369999999999999e-06 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273216+0000", 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059333500000000004 2024-05-10T09:56:38.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273253+0000", 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6792999999999998e-05 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273269+0000", 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6447e-05 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273422+0000", 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152261 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273459+0000", 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6980000000000002e-05 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.283550+0000", 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010091417 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.283655+0000", 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010535900000000001 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1470 3.5 3:a27e3b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.114144575, 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019770541999999999, 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.287 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1470 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068440+0000", 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9840000000000001e-06 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073342+0000", 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049020009999999996 2024-05-10T09:56:38.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073377+0000", 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4709999999999998e-05 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073393+0000", 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073478+0000", 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4662999999999999e-05 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073598+0000", 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119858 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073708+0000", 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110263 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.081250+0000", 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0075420119999999998 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088067+0000", 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068170399999999999 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088146+0000", 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8831999999999993e-05 2024-05-10T09:56:38.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088208+0000", 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2043000000000002e-05 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1471 3.30 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.090385981000000004, 2024-05-10T09:56:38.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024868991999999999, 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1471 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092198+0000", 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.125e-06 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096157+0000", 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039586839999999996 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096182+0000", 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096192+0000", 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0208e-05 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096269+0000", 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7440000000000004e-05 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096403+0000", 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013410700000000001 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:38.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096528+0000", 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000124583 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.105347+0000", 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088185999999999994 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.116955+0000", 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011608408000000001 2024-05-10T09:56:38.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117015+0000", 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0024e-05 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117065+0000", 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9804e-05 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1473 3.2a 3:570843f4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.038783829999999998, 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019090323999999999, 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1473 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.300 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143801+0000", 2024-05-10T09:56:38.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.57e-06 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147829+0000", 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004027938 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147871+0000", 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2493000000000001e-05 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147891+0000", 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9922999999999999e-05 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147983+0000", 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2151000000000006e-05 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.148167+0000", 2024-05-10T09:56:38.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018379900000000001 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.148341+0000", 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017429000000000001 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.155685+0000", 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073433999999999999 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162584+0000", 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068995369999999999 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162758+0000", 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174024 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162888+0000", 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000130199 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.305 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.306 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.306 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:38.306 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:38.306 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:38.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:38.308 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:38.308 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:38.307+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:38.409 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:38.407+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:38.461 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:38.461 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:38.478 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:38.478 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:38.487 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:38.487 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:38.487 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:38.497 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:38.497 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:38.501 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:38.510 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:38.506+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:38.516 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:38.516 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:38.516 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:38.536 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:38.536 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:38.557 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:38.558 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:38.577 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:38.578 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:38.581 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:38.582 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:38.611 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:38.611+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:38.671 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:38.671 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:38.686 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:38.730 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:38.731+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:38.813 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:38.815+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:38.854 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:38.855 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:38.869 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:38.958 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:38.959+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:39.015 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:39.010+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:39.034 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:39.035 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:39.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:39.116 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:39.114+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:39.217 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:39.219+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:39.226 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:39.226 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:39.242 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:39.318 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:39.314+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:39.408 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:56:39.409 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:39.409 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:39.423 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:39.455 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:39.454+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:39.522 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:39.523+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:39.583 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:39.583 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:39.598 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:39.643 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:39.642+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:39.724 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:39.723+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:39.724 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:39.725 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:39.739 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:39.825 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:39.823+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:39.908 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:39.908 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:39.921 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:39.926 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:39.927+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:40.026 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:40.022+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:40.049 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:40.049 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:40.062 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:40.147 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:40.146+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:40.228 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:40.227+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:40.239 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:40.239 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:40.254 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:40.328 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:40.327+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:40.398 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:56:40.422 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:40.422 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:40.428 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:40.426+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:40.436 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:40.529 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:40.526+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:40.583 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:40.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:40.630 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:40.631+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:40.731 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:40.726+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:40.747 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:40.747 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:40.764 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:40.764 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:40.770 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:40.770 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:40.782 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:40.783 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:40.785 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:40.800 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:40.822 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:40.822 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:40.831 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:40.830+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:40.843 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:40.844 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:40.867 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:40.867 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:40.871 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:40.872 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:40.925 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:40.926 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:40.926 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:40.926 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:40.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.926 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1273 3.2d e69/23 3:b59bb266:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_1:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:40.927 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:40.927 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.1832083529999995, 2024-05-10T09:56:40.927 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013030055, 2024-05-10T09:56:40.927 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.927 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.927 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.928 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.928 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.928 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:40.928 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.929 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.929 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:40.929 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.930 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.930 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.930 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:40.930 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.35e-07 2024-05-10T09:56:40.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.931 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.931 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744317+0000", 2024-05-10T09:56:40.931 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060981630000000002 2024-05-10T09:56:40.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.932 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.932 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744349+0000", 2024-05-10T09:56:40.932 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:56:40.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.933 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.933 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744363+0000", 2024-05-10T09:56:40.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4742e-05 2024-05-10T09:56:40.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.933 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.934 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744467+0000", 2024-05-10T09:56:40.934 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103656 2024-05-10T09:56:40.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.934 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.934 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744487+0000", 2024-05-10T09:56:40.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9893000000000001e-05 2024-05-10T09:56:40.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751184+0000", 2024-05-10T09:56:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066971670000000004 2024-05-10T09:56:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.936 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751249+0000", 2024-05-10T09:56:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4789000000000006e-05 2024-05-10T09:56:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1275 3.4 e69/23 3:20482490:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_3:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.1667429800000004, 2024-05-10T09:56:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088205420000000007, 2024-05-10T09:56:40.938 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.939 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.939 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.939 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:40.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.940 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.940 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754684+0000", 2024-05-10T09:56:40.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754686+0000", 2024-05-10T09:56:40.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9589999999999998e-06 2024-05-10T09:56:40.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.942 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.942 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756627+0000", 2024-05-10T09:56:40.942 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001940747 2024-05-10T09:56:40.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.943 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.943 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756656+0000", 2024-05-10T09:56:40.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8906000000000001e-05 2024-05-10T09:56:40.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756671+0000", 2024-05-10T09:56:40.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5571000000000001e-05 2024-05-10T09:56:40.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756746+0000", 2024-05-10T09:56:40.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4738000000000002e-05 2024-05-10T09:56:40.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.946 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756775+0000", 2024-05-10T09:56:40.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8983e-05 2024-05-10T09:56:40.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.946 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763456+0000", 2024-05-10T09:56:40.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006681279 2024-05-10T09:56:40.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763505+0000", 2024-05-10T09:56:40.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8359000000000002e-05 2024-05-10T09:56:40.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.948 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.949 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1277 3.2d e69/23 3:b6aa08bb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_5:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:40.949 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:40.949 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.1413399979999994, 2024-05-10T09:56:40.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010253787, 2024-05-10T09:56:40.950 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.950 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.950 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.951 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:40.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.952 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.952 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780087+0000", 2024-05-10T09:56:40.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.953 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.953 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.780089+0000", 2024-05-10T09:56:40.953 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7770000000000001e-06 2024-05-10T09:56:40.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.954 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.954 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784360+0000", 2024-05-10T09:56:40.954 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042708809999999998 2024-05-10T09:56:40.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.954 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.954 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784397+0000", 2024-05-10T09:56:40.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7314999999999998e-05 2024-05-10T09:56:40.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784413+0000", 2024-05-10T09:56:40.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6065e-05 2024-05-10T09:56:40.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784553+0000", 2024-05-10T09:56:40.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013986099999999999 2024-05-10T09:56:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.784614+0000", 2024-05-10T09:56:40.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0718999999999999e-05 2024-05-10T09:56:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.790273+0000", 2024-05-10T09:56:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056590240000000003 2024-05-10T09:56:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.790341+0000", 2024-05-10T09:56:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8145000000000006e-05 2024-05-10T09:56:40.959 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1284 3.36 e69/42 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:40.960 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.0668141969999994, 2024-05-10T09:56:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010399762999999999, 2024-05-10T09:56:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.961 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854615+0000", 2024-05-10T09:56:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4380000000000002e-06 2024-05-10T09:56:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858639+0000", 2024-05-10T09:56:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040232239999999997 2024-05-10T09:56:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858672+0000", 2024-05-10T09:56:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3149999999999999e-05 2024-05-10T09:56:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858689+0000", 2024-05-10T09:56:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7342000000000001e-05 2024-05-10T09:56:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858762+0000", 2024-05-10T09:56:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3162000000000002e-05 2024-05-10T09:56:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858782+0000", 2024-05-10T09:56:40.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9330999999999998e-05 2024-05-10T09:56:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.864942+0000", 2024-05-10T09:56:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061601889999999999 2024-05-10T09:56:40.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.970 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865013+0000", 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0926999999999994e-05 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1285 3.21 3:85614eff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:40.971 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.0618468280000002, 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014048458, 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1285 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.972 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859583+0000", 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.932e-06 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862407+0000", 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028238030000000002 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862436+0000", 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9264999999999998e-05 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862452+0000", 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6161999999999999e-05 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862553+0000", 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001002 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862721+0000", 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016805100000000001 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862850+0000", 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012889600000000001 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873327+0000", 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010477288 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873512+0000", 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018525099999999999 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873586+0000", 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3559999999999994e-05 2024-05-10T09:56:40.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873629+0000", 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3050000000000003e-05 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1293 3.19 e69/42 3:997ed118:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_21:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.9720135469999995, 2024-05-10T09:56:40.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074932560000000002, 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949414+0000", 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.949416+0000", 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.357e-06 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951211+0000", 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017950209999999999 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951243+0000", 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1745999999999997e-05 2024-05-10T09:56:40.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951259+0000", 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6274e-05 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951344+0000", 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4974000000000003e-05 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.951375+0000", 2024-05-10T09:56:40.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0580999999999997e-05 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.956850+0000", 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054756789999999998 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.956907+0000", 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6623999999999999e-05 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1396 3.3b e71/23 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head v 71'3, mlcod=68'1)", 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.5579105200000001, 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020899485999999998, 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:40.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363519+0000", 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370796+0000", 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00727693 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370839+0000", 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2802000000000001e-05 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370857+0000", 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8703e-05 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371003+0000", 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145668 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371048+0000", 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4512999999999999e-05 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384144+0000", 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013096607 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384416+0000", 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000271883 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1398 3.2e 3:74667c03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.5426881410000002, 2024-05-10T09:56:40.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019068742, 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1398 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378742+0000", 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0299999999999998e-06 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380905+0000", 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021633329999999999 2024-05-10T09:56:40.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380931+0000", 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5216e-05 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380945+0000", 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4579999999999999e-05 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381044+0000", 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8981000000000007e-05 2024-05-10T09:56:40.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381262+0000", 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218221 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381455+0000", 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019242599999999999 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:40.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.389370+0000", 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079151280000000004 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397668+0000", 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.008297759 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397742+0000", 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3872e-05 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397808+0000", 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6196000000000001e-05 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1399 3.39 3:9c26c45b:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.391358+0000", 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.5300693689999996, 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010295924, 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:40.992 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1399 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.391358+0000", 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.391358+0000", 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.391361+0000", 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1489999999999998e-06 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393120+0000", 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017589389999999999 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393149+0000", 2024-05-10T09:56:40.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8719999999999999e-05 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393173+0000", 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4913999999999999e-05 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393253+0000", 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9419000000000007e-05 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393450+0000", 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019676599999999999 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.393598+0000", 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014866099999999999 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.401049+0000", 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074503379999999999 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.401569+0000", 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00052016599999999997 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.401617+0000", 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7825999999999999e-05 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.401654+0000", 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7026000000000001e-05 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.997 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1402 3.2d e71/23 3:b5eccbcc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_7:head v 71'3, mlcod=69'1)", 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.4911218460000004, 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010699695, 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.998 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430307+0000", 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.288e-06 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:40.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435405+0000", 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0050987070000000001 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435436+0000", 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1177000000000003e-05 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435451+0000", 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.501e-05 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435536+0000", 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4101e-05 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435564+0000", 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8818000000000001e-05 2024-05-10T09:56:41.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440940+0000", 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053758870000000002 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.441005+0000", 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4707000000000002e-05 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1410 3.3d e71/23 3:be56ca3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_15:head v 71'3, mlcod=71'1)", 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.535927+0000", 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3854997969999996, 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086678729999999996, 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535927+0000", 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535927+0000", 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535930+0000", 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3989999999999998e-06 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.537986+0000", 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020562010000000001 2024-05-10T09:56:41.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.538015+0000", 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8629e-05 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.538030+0000", 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5111e-05 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.538134+0000", 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103897 2024-05-10T09:56:41.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.538161+0000", 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7149999999999999e-05 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.544533+0000", 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0063721239999999998 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.544595+0000", 2024-05-10T09:56:41.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2361999999999997e-05 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1413 3.36 e71/42 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head v 71'3, mlcod=69'1)", 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3408726560000002, 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019195001, 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580561+0000", 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6420000000000001e-06 2024-05-10T09:56:41.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588455+0000", 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078937079999999993 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588485+0000", 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0411000000000001e-05 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588499+0000", 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3370000000000001e-05 2024-05-10T09:56:41.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588602+0000", 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010296 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588630+0000", 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8904999999999999e-05 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.010 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599682+0000", 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011051963999999999 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599749+0000", 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7040999999999997e-05 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1417 3.2e 3:75940b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.2890687840000004, 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018750408999999999, 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1417 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:41.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632361+0000", 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1030000000000002e-06 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635167+0000", 2024-05-10T09:56:41.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028054070000000002 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635203+0000", 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6476000000000001e-05 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635220+0000", 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6393999999999999e-05 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635311+0000", 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1445000000000003e-05 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635439+0000", 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012746900000000001 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635545+0000", 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106335 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.640654+0000", 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051087379999999998 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651021+0000", 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01036726 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651068+0000", 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7182999999999999e-05 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651109+0000", 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0599000000000002e-05 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1435 3.3b e71/23 3:dd2501f8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_12:head v 71'4, mlcod=71'2)", 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.743906328, 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011886904, 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.017 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177523+0000", 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.266e-06 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182873+0000", 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053496560000000004 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182914+0000", 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1134999999999998e-05 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182934+0000", 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9922e-05 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.183040+0000", 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010644799999999999 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.183073+0000", 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2756999999999998e-05 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.189310+0000", 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0062369749999999996 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.189408+0000", 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7744999999999993e-05 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1445 3.0 e71/23 3:0255dc8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_22:head v 71'2, mlcod=0'0)", 2024-05-10T09:56:41.021 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.321797+0000", 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.599629669, 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0084992379999999992, 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.321797+0000", 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.022 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.321797+0000", 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.321799+0000", 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4649999999999999e-06 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.322949+0000", 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011502719999999999 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.322977+0000", 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7759e-05 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.322990+0000", 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2721000000000001e-05 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.323096+0000", 2024-05-10T09:56:41.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106246 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.323131+0000", 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5014000000000001e-05 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330227+0000", 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0070965389999999998 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330297+0000", 2024-05-10T09:56:41.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.9221999999999996e-05 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1455 3.21 3:848162d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.18464876, 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015185799, 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.026 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1455 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:41.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736781+0000", 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.773e-06 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738650+0000", 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018684820000000001 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738682+0000", 2024-05-10T09:56:41.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2483000000000001e-05 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738697+0000", 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4831000000000001e-05 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738838+0000", 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014086599999999999 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739132+0000", 2024-05-10T09:56:41.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029422999999999998 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739328+0000", 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019572 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751391+0000", 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012062969 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751830+0000", 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043945200000000001 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751908+0000", 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7391000000000005e-05 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751964+0000", 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6601999999999998e-05 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1460 3.21 3:86cfe81c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.0868676069999998, 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015558268, 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1460 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.032 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834564+0000", 2024-05-10T09:56:41.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9940000000000002e-06 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836403+0000", 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001839898 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836447+0000", 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3228e-05 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836471+0000", 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4074e-05 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836588+0000", 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117508 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836798+0000", 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000209934 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:41.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836980+0000", 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018196299999999999 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.842755+0000", 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0057745660000000001 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850035+0000", 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072807139999999998 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850078+0000", 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.303e-05 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850118+0000", 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9359e-05 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1462 3.2e 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.037 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.040993678, 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.025347350000000001, 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1462 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880438+0000", 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.9099999999999996e-06 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882457+0000", 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020182120000000001 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882501+0000", 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4345999999999999e-05 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882526+0000", 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4890000000000001e-05 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882714+0000", 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018791500000000001 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.883115+0000", 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000401245 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.883513+0000", 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039829500000000001 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.890718+0000", 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072049560000000002 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905553+0000", 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014834340999999999 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905659+0000", 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010660800000000001 2024-05-10T09:56:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905781+0000", 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121632 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1465 3.21 3:85e7ecaf:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 2.9716541460000001, 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015113694, 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.043 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1465 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949778+0000", 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6229999999999996e-06 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952377+0000", 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002599826 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.045 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952419+0000", 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1854999999999998e-05 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952446+0000", 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6526999999999999e-05 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952608+0000", 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016185799999999999 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952884+0000", 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027616499999999998 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.953125+0000", 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000241139 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.960413+0000", 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072875539999999999 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964569+0000", 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041563540000000001 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964749+0000", 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018009800000000001 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964887+0000", 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013769499999999999 2024-05-10T09:56:41.048 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1472 3.2e 3:75ea7f72:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 2.805333681, 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015083343000000001, 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.049 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1472 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116097+0000", 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.817e-06 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119039+0000", 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029415370000000001 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119094+0000", 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5346000000000002e-05 2024-05-10T09:56:41.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119116+0000", 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2010000000000001e-05 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119251+0000", 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135096 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119529+0000", 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027775800000000002 2024-05-10T09:56:41.052 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119820+0000", 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029083499999999998 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.127004+0000", 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071846330000000002 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.130987+0000", 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0039825379999999999 2024-05-10T09:56:41.053 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.131095+0000", 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001075 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.131177+0000", 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2273000000000003e-05 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.054 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.055 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:41.056 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:41.056 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:41.054+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:41.157 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:41.154+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:41.221 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:41.222 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:41.222 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:41.222 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:41.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:41.258 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:41.259+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:41.359 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:41.354+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:41.406 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:41.407 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:41.407 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:41.407 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:41.407 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:41.423 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:41.467 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:41.466+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:41.561 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:41.558+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:41.608 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:41.608 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:41.608 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:41.608 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:41.608 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1274 3.8 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.8618742220000009, 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019336196, 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1274 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.609 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.610 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742479+0000", 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8779999999999998e-06 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745161+0000", 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002682135 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.611 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745185+0000", 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3611000000000001e-05 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745194+0000", 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2369999999999998e-06 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745266+0000", 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2008000000000006e-05 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.612 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745445+0000", 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179259 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745624+0000", 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017874300000000001 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756109+0000", 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010485169000000001 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.613 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761680+0000", 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055706649999999998 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761755+0000", 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5171000000000002e-05 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761813+0000", 2024-05-10T09:56:41.614 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.732e-05 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1281 3.29 3:94644cd5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.787740694, 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021096073, 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.615 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1281 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.616 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816613+0000", 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.892e-06 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818489+0000", 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018760599999999999 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.617 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818531+0000", 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2070000000000002e-05 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818554+0000", 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2776e-05 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818664+0000", 2024-05-10T09:56:41.618 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011037899999999999 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818882+0000", 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000217457 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.819053+0000", 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000171187 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.619 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.824533+0000", 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054798609999999999 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837622+0000", 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013089751 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837669+0000", 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6517000000000002e-05 2024-05-10T09:56:41.620 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837706+0000", 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7122999999999997e-05 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.621 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1289 3.38 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.7001068060000009, 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022792125999999999, 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1289 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.622 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.623 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904247+0000", 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1939999999999998e-06 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906042+0000", 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017947239999999999 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906083+0000", 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0948999999999997e-05 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.624 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906101+0000", 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8442999999999999e-05 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906204+0000", 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103359 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906378+0000", 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000173435 2024-05-10T09:56:41.625 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906536+0000", 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015819099999999999 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913717+0000", 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071811230000000002 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926882+0000", 2024-05-10T09:56:41.626 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013164765 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926966+0000", 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3579999999999996e-05 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927036+0000", 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0363000000000004e-05 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.627 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1292 3.38 3:1ea9eee7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.667620372, 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01900717, 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1292 2024-05-10T09:56:41.628 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.629 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936734+0000", 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4149999999999999e-06 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938852+0000", 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021187630000000001 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.630 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938883+0000", 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0494999999999999e-05 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938901+0000", 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7988000000000001e-05 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938993+0000", 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2383e-05 2024-05-10T09:56:41.631 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939177+0000", 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018371699999999999 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939324+0000", 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014727499999999999 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.944680+0000", 2024-05-10T09:56:41.632 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053554379999999997 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955600+0000", 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010920487 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955670+0000", 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0202000000000003e-05 2024-05-10T09:56:41.633 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955737+0000", 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7007000000000004e-05 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1296 3.2 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:41.634 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.5835322590000001, 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021264584, 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1296 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.635 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020821+0000", 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3259999999999998e-06 2024-05-10T09:56:41.636 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.021993+0000", 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001172071 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022024+0000", 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1222e-05 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.637 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022035+0000", 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1449e-05 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022149+0000", 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011391399999999999 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022369+0000", 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220079 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.638 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022596+0000", 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000226288 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.028699+0000", 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006103163 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042000+0000", 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013301006000000001 2024-05-10T09:56:41.639 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042047+0000", 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6990999999999998e-05 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042083+0000", 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6075000000000003e-05 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.640 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1298 3.29 3:979982e8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.5582306250000002, 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018739767000000001, 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.641 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1298 2024-05-10T09:56:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046121+0000", 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.508e-06 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.643 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047357+0000", 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001235683 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047388+0000", 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0549000000000002e-05 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047404+0000", 2024-05-10T09:56:41.644 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6676000000000001e-05 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047484+0000", 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9212e-05 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047618+0000", 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013448600000000001 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:41.645 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.048073+0000", 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045510599999999999 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.055269+0000", 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071963189999999996 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064647+0000", 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093774919999999994 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.646 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064781+0000", 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013422999999999999 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064860+0000", 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8505999999999997e-05 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.647 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1304 3.28 e69/23 3:17fc7310:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_4:head v 69'4, mlcod=68'2)", 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.1648961870000001, 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012378174, 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:41.648 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439454+0000", 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.439456+0000", 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.37e-06 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.649 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443788+0000", 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004332252 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443829+0000", 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0667999999999998e-05 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443846+0000", 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6932999999999999e-05 2024-05-10T09:56:41.650 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443955+0000", 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000109529 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.443997+0000", 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1813000000000001e-05 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.651 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.451770+0000", 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007772752 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.451833+0000", 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2856999999999998e-05 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.652 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1310 3.2 3:43af6b18:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.100963106, 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016309814999999998, 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1310 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503387+0000", 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.503390+0000", 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1210000000000001e-06 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505146+0000", 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017568099999999999 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505168+0000", 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1452000000000001e-05 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505178+0000", 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9629999999999993e-06 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505239+0000", 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1223000000000007e-05 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505358+0000", 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000119172 2024-05-10T09:56:41.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.505478+0000", 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120065 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.510352+0000", 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048741039999999998 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519563+0000", 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092107189999999992 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519639+0000", 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6050999999999994e-05 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.519697+0000", 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8134999999999998e-05 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.658 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1407 3.7 3:e186c9fd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.490266+0000", 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1140842710000003, 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014955553, 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.659 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1407 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.490266+0000", 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.490266+0000", 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.490270+0000", 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.535e-06 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.491966+0000", 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016962850000000001 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492000+0000", 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4008999999999999e-05 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492014+0000", 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3893000000000001e-05 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492095+0000", 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1279999999999994e-05 2024-05-10T09:56:41.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492236+0000", 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140922 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.492377+0000", 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000140297 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.497239+0000", 2024-05-10T09:56:41.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048629169999999996 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.505085+0000", 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078454040000000003 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.505161+0000", 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6589999999999997e-05 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.505222+0000", 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0421000000000003e-05 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1426 3.25 e71/23 3:a4c8f94a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_3:head v 71'5, mlcod=71'3)", 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.059651+0000", 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.5446995189999999, 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014845288, 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.665 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059651+0000", 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059651+0000", 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059655+0000", 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4970000000000001e-06 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065528+0000", 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058730450000000003 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065576+0000", 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8133000000000001e-05 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065599+0000", 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3706e-05 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065698+0000", 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8465e-05 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.065728+0000", 2024-05-10T09:56:41.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9864000000000001e-05 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074426+0000", 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086982870000000007 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074496+0000", 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0290999999999995e-05 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1434 3.33 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.4485596440000004, 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020822112, 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1434 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155794+0000", 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9100000000000001e-06 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157707+0000", 2024-05-10T09:56:41.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001912757 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157746+0000", 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9848999999999997e-05 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157763+0000", 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6059999999999999e-05 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157837+0000", 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4952999999999999e-05 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157951+0000", 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011310400000000001 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.158086+0000", 2024-05-10T09:56:41.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135122 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.164123+0000", 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060373429999999997 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176486+0000", 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012362556 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176558+0000", 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2453000000000006e-05 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176613+0000", 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5004999999999999e-05 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.676 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1438 3.1e 3:7ac7bc5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3920184119999996, 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017363922, 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1438 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212335+0000", 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.83e-06 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214003+0000", 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016675240000000001 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214028+0000", 2024-05-10T09:56:41.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5939e-05 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214046+0000", 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7655999999999998e-05 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214129+0000", 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2793000000000005e-05 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214293+0000", 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163616 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214409+0000", 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116944 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.219268+0000", 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048583680000000001 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229606+0000", 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010338174 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229647+0000", 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1415999999999998e-05 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229696+0000", 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8662000000000003e-05 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1441 3.2 3:4091da54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3422116449999999, 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020721976999999999, 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.683 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1441 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262142+0000", 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9019999999999999e-06 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265147+0000", 2024-05-10T09:56:41.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030048340000000001 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265183+0000", 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6233999999999999e-05 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265206+0000", 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2866000000000001e-05 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265319+0000", 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113183 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265430+0000", 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110772 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265532+0000", 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102746 2024-05-10T09:56:41.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.269542+0000", 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040093459999999996 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282625+0000", 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013083252 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282761+0000", 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135446 2024-05-10T09:56:41.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282861+0000", 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010039600000000001 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1443 3.2 3:41167866:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.3126699530000003, 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016390715, 2024-05-10T09:56:41.689 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1443 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:41.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291684+0000", 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.19e-06 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293265+0000", 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015814449999999999 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293300+0000", 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4486000000000002e-05 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293314+0000", 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4535999999999999e-05 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293443+0000", 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012858999999999999 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293707+0000", 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026414400000000001 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293885+0000", 2024-05-10T09:56:41.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017773800000000001 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.300013+0000", 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061277579999999996 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.307835+0000", 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078220289999999994 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.307971+0000", 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013645500000000001 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.308071+0000", 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000100344 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1452 3.2 3:40af27f6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:56:41.695 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.9092900340000001, 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01767817, 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1452 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:56:41.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695062+0000", 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8250000000000001e-06 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.696976+0000", 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019137959999999999 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697003+0000", 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6937e-05 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697019+0000", 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5608e-05 2024-05-10T09:56:41.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697122+0000", 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103108 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697318+0000", 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019647999999999999 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:41.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697507+0000", 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018832199999999999 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.706389+0000", 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088826519999999996 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712570+0000", 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061802460000000004 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712671+0000", 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101356 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712739+0000", 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7840000000000001e-05 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1464 3.2 3:41d9713b:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.925938+0000", 2024-05-10T09:56:41.701 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.6784127849999999, 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016116729, 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1464 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.925938+0000", 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.925938+0000", 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.925942+0000", 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6840000000000004e-06 2024-05-10T09:56:41.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.928255+0000", 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002312705 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.928301+0000", 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5352999999999998e-05 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.928323+0000", 2024-05-10T09:56:41.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.198e-05 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.928515+0000", 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019283399999999999 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.928824+0000", 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030892000000000002 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.929085+0000", 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026104299999999997 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.936553+0000", 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0074675330000000002 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.706 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.941882+0000", 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053293230000000004 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.941979+0000", 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6642000000000001e-05 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.942055+0000", 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5711999999999996e-05 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.707 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1466 3.23 e72/23 3:c6625ef2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_15:head v 72'12, mlcod=71'10)", 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.979494+0000", 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.6248562020000001, 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012789645000000001, 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.979494+0000", 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.979494+0000", 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.979496+0000", 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2640000000000001e-06 2024-05-10T09:56:41.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.983312+0000", 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003816683 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.983353+0000", 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0992999999999999e-05 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.983372+0000", 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.844e-05 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.983545+0000", 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017289700000000001 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.983613+0000", 2024-05-10T09:56:41.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8702999999999996e-05 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992188+0000", 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0085745230000000006 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992284+0000", 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6142000000000002e-05 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.712 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1469 3.8 3:108a86fb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.041382+0000", 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.5629681340000001, 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016320839, 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1469 2024-05-10T09:56:41.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.041382+0000", 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.041382+0000", 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.041386+0000", 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3330000000000001e-06 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044211+0000", 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028256100000000001 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044262+0000", 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0482000000000002e-05 2024-05-10T09:56:41.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044282+0000", 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9847000000000002e-05 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044416+0000", 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000134475 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044708+0000", 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029228000000000001 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044974+0000", 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026518700000000001 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.054928+0000", 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0099545959999999996 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057531+0000", 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026023520000000001 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057628+0000", 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7788000000000006e-05 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057703+0000", 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4888999999999994e-05 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.718 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1470 3.5 e72/23 3:a27e3b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_19:head v 72'5, mlcod=71'3)", 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.072754+0000", 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.5315966599999999, 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013501221000000001, 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.072754+0000", 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.072754+0000", 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.072757+0000", 2024-05-10T09:56:41.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.61e-06 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.078388+0000", 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056316389999999999 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.078431+0000", 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3328999999999998e-05 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.078451+0000", 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9663000000000001e-05 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.078580+0000", 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000129319 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.078629+0000", 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8896000000000001e-05 2024-05-10T09:56:41.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.086168+0000", 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0075388820000000002 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.086255+0000", 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6883000000000001e-05 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1474 3.8 3:1087178a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.4384760089999999, 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020952432999999999, 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1474 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.724 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165879+0000", 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9430000000000002e-06 2024-05-10T09:56:41.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169159+0000", 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032809369999999998 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169219+0000", 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9076000000000002e-05 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:41.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169249+0000", 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0263000000000001e-05 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169423+0000", 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017407800000000001 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169723+0000", 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029992300000000001 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:41.727 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170003+0000", 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000279833 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.177266+0000", 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072636020000000001 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186640+0000", 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093733570000000006 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186739+0000", 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9893000000000001e-05 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186827+0000", 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7528000000000006e-05 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:41.729 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:41.731 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:41.732 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:41.731+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:41.831 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:41.830+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:41.863 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:41.863 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:41.863 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:41.863 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:41.877 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:41.932 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:41.930+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:42.000 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:42.000 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:42.001 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:42.001 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:42.016 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:42.033 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:42.030+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:42.134 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:42.130+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1278 3.2f 3:f571631c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.357817982, 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024049979999999999, 2024-05-10T09:56:42.147 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1278 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786219+0000", 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790848+0000", 2024-05-10T09:56:42.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046288800000000001 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790903+0000", 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5396000000000003e-05 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790931+0000", 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7852999999999999e-05 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791091+0000", 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000160085 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791356+0000", 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026496799999999997 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791614+0000", 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000258304 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.801355+0000", 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097402099999999991 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810050+0000", 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086953199999999994 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810149+0000", 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9086000000000006e-05 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810266+0000", 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116655 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1282 3.1d 3:bb239e62:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.31490316, 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032019191000000002, 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.153 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1282 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:42.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829134+0000", 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1700000000000001e-06 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.833983+0000", 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048496269999999996 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834016+0000", 2024-05-10T09:56:42.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2459999999999998e-05 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834034+0000", 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8427000000000002e-05 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834157+0000", 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122502 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834453+0000", 2024-05-10T09:56:42.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029603700000000003 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834694+0000", 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024105099999999999 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.857709+0000", 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023014703000000001 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.860974+0000", 2024-05-10T09:56:42.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032658309999999999 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861076+0000", 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010209600000000001 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861150+0000", 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3287000000000005e-05 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1283 3.37 e69/23 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.298982119, 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021592063000000002, 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845054+0000", 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7e-06 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848409+0000", 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003354938 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848451+0000", 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2259999999999999e-05 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848477+0000", 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5829e-05 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848600+0000", 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122516 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848685+0000", 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4759000000000006e-05 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866565+0000", 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017880391999999998 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866644+0000", 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8669000000000002e-05 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.162 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1289 3.38 e69/23 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.235802327, 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019676500999999999, 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:42.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908234+0000", 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912818+0000", 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045836089999999998 2024-05-10T09:56:42.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912865+0000", 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6959999999999998e-05 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912889+0000", 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4153000000000001e-05 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.913037+0000", 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014763499999999999 2024-05-10T09:56:42.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.913095+0000", 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8158999999999997e-05 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.927816+0000", 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014720746 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.927908+0000", 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2158999999999996e-05 2024-05-10T09:56:42.166 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1290 3.1d 3:ba11a2de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.226398417, 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026748503999999999, 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1290 2024-05-10T09:56:42.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917638+0000", 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0570000000000001e-06 2024-05-10T09:56:42.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922152+0000", 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045138899999999996 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922203+0000", 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0649000000000002e-05 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922222+0000", 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9470000000000002e-05 2024-05-10T09:56:42.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922397+0000", 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174575 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922662+0000", 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026555799999999999 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922907+0000", 2024-05-10T09:56:42.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024483699999999997 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.937015+0000", 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014107511 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944214+0000", 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071986680000000001 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944311+0000", 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7806000000000005e-05 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944384+0000", 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2483000000000004e-05 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1294 3.3a 3:5c4910a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.184488378999999, 2024-05-10T09:56:42.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019051561000000002, 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1294 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959549+0000", 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.207e-06 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964361+0000", 2024-05-10T09:56:42.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048128509999999999 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964396+0000", 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4656000000000002e-05 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964421+0000", 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5057000000000001e-05 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964573+0000", 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015201099999999999 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964830+0000", 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025683800000000001 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.965066+0000", 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000236188 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.973334+0000", 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082677270000000008 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978324+0000", 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049900120000000003 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978481+0000", 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157522 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978597+0000", 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115492 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1295 3.c 3:324d36a8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.174778472, 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016839302, 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.181 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1295 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969258+0000", 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8930000000000001e-06 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975186+0000", 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059273879999999996 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975219+0000", 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3114999999999997e-05 2024-05-10T09:56:42.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975244+0000", 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5117e-05 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975367+0000", 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012329600000000001 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975622+0000", 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025457000000000002 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975849+0000", 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022689100000000001 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.984503+0000", 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086545649999999995 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.985938+0000", 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014345759999999999 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.986028+0000", 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9992000000000002e-05 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.986095+0000", 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6898999999999998e-05 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.186 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1296 3.2 e69/23 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.119310626000001, 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018465083, 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:42.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024740+0000", 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6575999999999999e-05 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033470+0000", 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0087304400000000008 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033505+0000", 2024-05-10T09:56:42.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4666000000000003e-05 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033521+0000", 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6730000000000001e-05 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033676+0000", 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000154439 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033717+0000", 2024-05-10T09:56:42.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0763000000000003e-05 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.043060+0000", 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0093434929999999996 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.043188+0000", 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127976 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1304 3.28 3:17fc7310:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.7100639920000003, 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019639535999999999, 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1304 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433974+0000", 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4660000000000001e-06 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439744+0000", 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057702939999999996 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439780+0000", 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5880000000000002e-05 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439806+0000", 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5729999999999999e-05 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.193 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440017+0000", 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000211225 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440286+0000", 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026847399999999999 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440531+0000", 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024496400000000002 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.194 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.448055+0000", 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0075244780000000002 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453518+0000", 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0054625749999999999 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453566+0000", 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7890999999999999e-05 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.195 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453609+0000", 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3559000000000001e-05 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1400 3.22 3:450b599e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.7397193980000001, 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017183650000000002, 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.196 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1400 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.197 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404318+0000", 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6600000000000001e-06 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408668+0000", 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043499589999999996 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408709+0000", 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0580000000000001e-05 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.198 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408728+0000", 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9698999999999999e-05 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408930+0000", 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020164900000000001 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.409187+0000", 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025756999999999999 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.199 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.409423+0000", 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000235565 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.419973+0000", 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010550426 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421320+0000", 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001346243 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.200 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421427+0000", 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107576 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421498+0000", 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0722999999999994e-05 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1409 3.30 3:0da814af:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:42.201 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.6230117679999996, 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018836762999999999, 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1409 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:42.202 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521026+0000", 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5599999999999998e-06 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.203 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526195+0000", 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051697829999999998 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526237+0000", 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1640000000000001e-05 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526256+0000", 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8902999999999998e-05 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.204 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526415+0000", 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015881900000000001 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526672+0000", 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025730399999999997 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526924+0000", 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025230400000000002 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.205 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.536038+0000", 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091132899999999996 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539684+0000", 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036459589999999998 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539785+0000", 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101549 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.206 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539859+0000", 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3652000000000006e-05 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1418 3.28 3:14cb8ba5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.4998012650000003, 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016341517999999999, 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1418 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644237+0000", 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8670000000000002e-06 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650393+0000", 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006155275 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650434+0000", 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1492000000000002e-05 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650453+0000", 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8830000000000001e-05 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650590+0000", 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013698900000000001 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650842+0000", 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025209100000000002 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.651080+0000", 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023778100000000001 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.659932+0000", 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088523860000000003 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660404+0000", 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047188599999999997 2024-05-10T09:56:42.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660503+0000", 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8819000000000004e-05 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660574+0000", 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1101999999999998e-05 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1425 3.3a 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.212 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.097522133, 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.031419395000000003, 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1425 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:42.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046517+0000", 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2639999999999999e-06 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055240+0000", 2024-05-10T09:56:42.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.008723158 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055281+0000", 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1344999999999998e-05 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055301+0000", 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9317000000000002e-05 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055513+0000", 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021243799999999999 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055925+0000", 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041220299999999998 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.056338+0000", 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041247899999999999 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.071484+0000", 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015146359 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077627+0000", 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0061428050000000003 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077805+0000", 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017845400000000001 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077931+0000", 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000125573 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1429 3.16 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.0527255459999996, 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029834811999999999, 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.218 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1429 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.219 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091311+0000", 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.914e-06 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095902+0000", 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045904589999999999 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095938+0000", 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6043e-05 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095955+0000", 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7096e-05 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096104+0000", 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149555 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096348+0000", 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024343499999999999 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096601+0000", 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025365799999999998 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.104881+0000", 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082796310000000008 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120963+0000", 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016081813 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121062+0000", 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9098999999999994e-05 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121143+0000", 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1108999999999999e-05 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1439 3.22 3:47e84655:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.9167437659999997, 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017195082, 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1439 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227293+0000", 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:42.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232364+0000", 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050709479999999996 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232404+0000", 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9895999999999999e-05 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232425+0000", 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0696e-05 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232599+0000", 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000173955 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232995+0000", 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039625000000000001 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:42.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.233424+0000", 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042866900000000001 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.242477+0000", 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090527170000000001 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244152+0000", 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016750140000000001 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244358+0000", 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206825 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244485+0000", 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012660199999999999 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1440 3.1f e71/23 3:f8aeb630:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_17:head v 71'5, mlcod=68'3)", 2024-05-10T09:56:42.229 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.8961289260000003, 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016924982000000002, 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247907+0000", 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0870000000000001e-06 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253015+0000", 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051077270000000003 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253047+0000", 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.201e-05 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253063+0000", 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6433e-05 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253221+0000", 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015811199999999999 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253264+0000", 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3056000000000002e-05 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.264717+0000", 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011452664 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.264830+0000", 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112893 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.233 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1441 3.2 e71/23 3:4091da54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_18:head v 71'4, mlcod=69'2)", 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.8767536480000002, 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016375244000000001, 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:42.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267283+0000", 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6369999999999999e-06 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273216+0000", 2024-05-10T09:56:42.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059333500000000004 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273253+0000", 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6792999999999998e-05 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273269+0000", 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6447e-05 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273422+0000", 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152261 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273459+0000", 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6980000000000002e-05 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.283550+0000", 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010091417 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.283655+0000", 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010535900000000001 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1470 3.5 3:a27e3b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.0755964589999998, 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019770541999999999, 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.238 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1470 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:42.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068440+0000", 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9840000000000001e-06 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073342+0000", 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049020009999999996 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073377+0000", 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4709999999999998e-05 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073393+0000", 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073478+0000", 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4662999999999999e-05 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073598+0000", 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119858 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073708+0000", 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110263 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.081250+0000", 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0075420119999999998 2024-05-10T09:56:42.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088067+0000", 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068170399999999999 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088146+0000", 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8831999999999993e-05 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088208+0000", 2024-05-10T09:56:42.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2043000000000002e-05 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1471 3.30 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.0518378650000004, 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024868991999999999, 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.244 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1471 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092198+0000", 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.125e-06 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096157+0000", 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039586839999999996 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096182+0000", 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096192+0000", 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0208e-05 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096269+0000", 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7440000000000004e-05 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096403+0000", 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013410700000000001 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096528+0000", 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000124583 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.105347+0000", 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088185999999999994 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.116955+0000", 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011608408000000001 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117015+0000", 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0024e-05 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117065+0000", 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9804e-05 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.249 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1473 3.2a 3:570843f4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.0002357140000004, 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019090323999999999, 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1473 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143801+0000", 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.57e-06 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147829+0000", 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004027938 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147871+0000", 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2493000000000001e-05 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147891+0000", 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9922999999999999e-05 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147983+0000", 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2151000000000006e-05 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.148167+0000", 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018379900000000001 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.148341+0000", 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017429000000000001 2024-05-10T09:56:42.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.155685+0000", 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073433999999999999 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162584+0000", 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068995369999999999 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162758+0000", 2024-05-10T09:56:42.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174024 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162888+0000", 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000130199 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.255 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:42.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:42.257 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:42.254+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:42.357 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:42.354+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:42.383 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:42.384 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:42.384 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:42.384 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:42.398 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:42.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:56:42.471 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:42.470+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:42.529 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:42.530 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:42.530 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:42.530 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:42.530 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:42.544 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:42.594 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:42.595+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:42.660 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:42.658+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:42.670 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:42.670 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:42.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:42.670 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 114.983430036, 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.671 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:56:42.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:56:42.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:42.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:56:42.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:56:42.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1279 3.a 3:51af0144:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.873906615999999, 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025099606, 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1279 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796337+0000", 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5070000000000002e-06 2024-05-10T09:56:42.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802095+0000", 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057576520000000003 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802133+0000", 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8349000000000002e-05 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802153+0000", 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9993e-05 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802280+0000", 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012646599999999999 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802566+0000", 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028610300000000001 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802791+0000", 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022570199999999999 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.816789+0000", 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013997486 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821159+0000", 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043700240000000001 2024-05-10T09:56:42.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821316+0000", 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156735 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821432+0000", 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116589 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1284 3.36 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.819543767000001, 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02296221, 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1284 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850699+0000", 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1240000000000001e-06 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855070+0000", 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043709580000000003 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855111+0000", 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1310000000000003e-05 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855134+0000", 2024-05-10T09:56:42.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2860000000000001e-05 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855272+0000", 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013803099999999999 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855551+0000", 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027930799999999998 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:42.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855782+0000", 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000231361 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866830+0000", 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011047631 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873500+0000", 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066699089999999999 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873591+0000", 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1448999999999998e-05 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873658+0000", 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6268999999999999e-05 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1287 3.2c 3:364c59b2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:56:42.689 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.785106287, 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024099597, 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1287 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:56:42.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885136+0000", 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8040000000000002e-06 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889464+0000", 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043279219999999997 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889499+0000", 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5199e-05 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889515+0000", 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6422999999999998e-05 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889643+0000", 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012816600000000001 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889903+0000", 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025949099999999999 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.890132+0000", 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022953700000000001 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.902988+0000", 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012855171 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909041+0000", 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060532249999999998 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909155+0000", 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011380200000000001 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909233+0000", 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7856999999999997e-05 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1302 3.34 e69/23 3:2f2d612e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_2:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:32.417323+0000", 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.252916657, 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016212878, 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.695 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.417323+0000", 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.417323+0000", 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.417325+0000", 2024-05-10T09:56:42.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1500000000000002e-06 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420050+0000", 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00272522 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420091+0000", 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0992999999999999e-05 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420115+0000", 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4456000000000001e-05 2024-05-10T09:56:42.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420318+0000", 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202905 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420366+0000", 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7719999999999997e-05 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433435+0000", 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013069482 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433535+0000", 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9951999999999994e-05 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1397 3.10 3:0a64e0d8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.369283+0000", 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.3009564009999997, 2024-05-10T09:56:42.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017611031999999999, 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1397 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.369283+0000", 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.369283+0000", 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.369286+0000", 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3440000000000001e-06 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374471+0000", 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051846669999999996 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374510+0000", 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8976000000000001e-05 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374530+0000", 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0066999999999999e-05 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374690+0000", 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016001500000000001 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374949+0000", 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025866399999999998 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.375363+0000", 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041460599999999998 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.385970+0000", 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010606994999999999 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386680+0000", 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071035399999999996 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386782+0000", 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101839 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386894+0000", 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111505 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1398 3.2e e71/23 3:74667c03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_3:head v 71'6, mlcod=71'4)", 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.383241+0000", 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.2869978770000001, 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015591554000000001, 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.383241+0000", 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.383241+0000", 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.383244+0000", 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.773e-06 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389161+0000", 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00591663 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389190+0000", 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9657000000000001e-05 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389205+0000", 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.466e-05 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389308+0000", 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010269500000000001 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389351+0000", 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3736000000000003e-05 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.398743+0000", 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0093915409999999998 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.398833+0000", 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9862000000000001e-05 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.708 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1408 3.34 3:2e0b9265:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.508951+0000", 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.1612878139999996, 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014073855, 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1408 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.709 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.508951+0000", 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.508951+0000", 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.508955+0000", 2024-05-10T09:56:42.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2969999999999999e-06 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513049+0000", 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040940509999999996 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513093+0000", 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4379000000000003e-05 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513119+0000", 2024-05-10T09:56:42.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6242999999999999e-05 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513344+0000", 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022438499999999999 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513632+0000", 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0002879 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.522776+0000", 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091441200000000004 2024-05-10T09:56:42.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.522890+0000", 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113775 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.523025+0000", 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013570499999999999 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.713 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1412 3.2c 3:350e49dc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.565759+0000", 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.1044798389999997, 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014499593999999999, 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1412 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.565759+0000", 2024-05-10T09:56:42.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.565759+0000", 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.565763+0000", 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3830000000000001e-06 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.569740+0000", 2024-05-10T09:56:42.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039776819999999997 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.569782+0000", 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1239000000000003e-05 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.569800+0000", 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8754e-05 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.570010+0000", 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020913400000000001 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.570279+0000", 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269945 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.579803+0000", 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095237689999999996 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.579988+0000", 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184255 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.580259+0000", 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027143300000000001 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1413 3.36 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.718 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.0933328189999996, 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024918131999999999, 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1413 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:56:42.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576908+0000", 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581066+0000", 2024-05-10T09:56:42.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004157244 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581103+0000", 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6973e-05 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581120+0000", 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7343e-05 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581261+0000", 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000140672 2024-05-10T09:56:42.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581530+0000", 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026880099999999999 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581772+0000", 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000242754 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.590838+0000", 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090655300000000005 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601650+0000", 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010812307 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601751+0000", 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100766 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601825+0000", 2024-05-10T09:56:42.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3635999999999998e-05 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1415 3.34 3:2fa31341:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.607995+0000", 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.062243982, 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013934139999999999, 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1415 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.607995+0000", 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.607995+0000", 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.607998+0000", 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6599999999999999e-06 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612041+0000", 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040434039999999996 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612079+0000", 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7599999999999999e-05 2024-05-10T09:56:42.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612097+0000", 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7626e-05 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612244+0000", 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014797200000000001 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612502+0000", 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025747399999999999 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.621617+0000", 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091147199999999998 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.621730+0000", 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113112 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.621929+0000", 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019957199999999999 2024-05-10T09:56:42.728 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1417 3.2e e71/23 3:75940b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_22:head v 71'7, mlcod=71'5)", 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.637623+0000", 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.0326166590000003, 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014514175000000001, 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.637623+0000", 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.637623+0000", 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.637673+0000", 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0835999999999999e-05 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642691+0000", 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050172560000000003 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642730+0000", 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9440000000000002e-05 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642748+0000", 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7465999999999998e-05 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642908+0000", 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000160032 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642952+0000", 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4765999999999998e-05 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.651994+0000", 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090416000000000003 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.652137+0000", 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142779 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1424 3.a 3:50b58fe7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.6370565890000002, 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02028814, 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.733 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1424 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033186+0000", 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3840000000000001e-06 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039575+0000", 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063893420000000001 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039613+0000", 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7518999999999998e-05 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039630+0000", 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.751e-05 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039808+0000", 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178025 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.040103+0000", 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000294531 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053142+0000", 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013038696000000001 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053249+0000", 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107255 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053471+0000", 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022187800000000001 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.737 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1430 3.3f e71/23 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head v 71'3, mlcod=71'1)", 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.5621066539999999, 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017678704999999999, 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:56:42.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108135+0000", 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4269999999999998e-06 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111069+0000", 2024-05-10T09:56:42.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029336520000000001 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111113+0000", 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4193000000000002e-05 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111132+0000", 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9157e-05 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111305+0000", 2024-05-10T09:56:42.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000172621 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111372+0000", 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6935999999999997e-05 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.125674+0000", 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014302199999999999 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.125811+0000", 2024-05-10T09:56:42.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013751900000000001 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1434 3.33 e71/23 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head v 71'1, mlcod=0'0)", 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.5104113400000001, 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017779593, 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159831+0000", 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.903e-06 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165818+0000", 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005987643 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165855+0000", 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6866000000000002e-05 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165872+0000", 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6793e-05 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.166014+0000", 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014216200000000001 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.166081+0000", 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.648e-05 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177476+0000", 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011395621 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177607+0000", 2024-05-10T09:56:42.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131125 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1438 3.1e e71/23 3:7ac7bc5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_15:head v 71'3, mlcod=68'1)", 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.216485+0000", 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.4537546179999996, 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014376750000000001, 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.216485+0000", 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.216485+0000", 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.216531+0000", 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6669999999999999e-05 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221602+0000", 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050711189999999998 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221642+0000", 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9802000000000003e-05 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221659+0000", 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7187e-05 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221858+0000", 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000198698 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221903+0000", 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4570000000000002e-05 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.230701+0000", 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0087980149999999993 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.230861+0000", 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016068899999999999 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1444 3.26 3:66bf84d6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.3659589180000005, 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020383655000000001, 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.750 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1444 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304284+0000", 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5300000000000001e-06 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309335+0000", 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050508920000000004 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309376+0000", 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1016000000000002e-05 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309395+0000", 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8810000000000001e-05 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309534+0000", 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013921199999999999 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309788+0000", 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025465399999999999 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.310003+0000", 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021485100000000001 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.317815+0000", 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0078115260000000001 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324488+0000", 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066737289999999998 2024-05-10T09:56:42.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324589+0000", 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100726 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324664+0000", 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4709000000000006e-05 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.755 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1454 3.2c 3:34adac54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.722103+0000", 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.9481361039999996, 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016306314999999998, 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1454 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.722103+0000", 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.722103+0000", 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.722107+0000", 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8770000000000003e-06 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726386+0000", 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042789960000000002 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726424+0000", 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8418999999999999e-05 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726445+0000", 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0720000000000002e-05 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726631+0000", 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018590499999999999 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726918+0000", 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028696400000000001 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.738085+0000", 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011166544 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.738207+0000", 2024-05-10T09:56:42.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122032 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.738409+0000", 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020285799999999999 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1462 3.2e e72/23 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head v 72'8, mlcod=71'6)", 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.7848806579999996, 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021282938000000001, 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.760 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885360+0000", 2024-05-10T09:56:42.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9000000000000005e-07 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892622+0000", 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0072619779999999997 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892660+0000", 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8633000000000001e-05 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892678+0000", 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7649999999999999e-05 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892846+0000", 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000168398 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892886+0000", 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9687000000000001e-05 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906436+0000", 2024-05-10T09:56:42.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013549913 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906641+0000", 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000205689 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1463 3.34 3:2fb45b2e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.904897+0000", 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.7653419799999996, 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013387915, 2024-05-10T09:56:42.764 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1463 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.904897+0000", 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.904897+0000", 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.904900+0000", 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9399999999999998e-06 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910130+0000", 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052303230000000003 2024-05-10T09:56:42.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910176+0000", 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5958999999999998e-05 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910196+0000", 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0032999999999999e-05 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910327+0000", 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013026300000000001 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910597+0000", 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027010000000000001 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.917904+0000", 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073071639999999997 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.918056+0000", 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152165 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:42.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:42.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.918285+0000", 2024-05-10T09:56:42.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022896799999999999 2024-05-10T09:56:42.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.769 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:42.769 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:42.769 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:42.770 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:42.771 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:42.766+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:42.871 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:42.870+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:42.873 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:42.944 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:42.944 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:42.944 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:42.944 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:42.957 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:42.972 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:42.970+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:43.025 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:43.025 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:43.062 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:43.062 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:43.073 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:43.070+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:43.083 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:43.084 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:43.084 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:43.084 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:43.084 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:43.096 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:43.097 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:43.098 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:43.118 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:43.118 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:43.119 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:43.137 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:43.137 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:43.155 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:43.155 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:43.173 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:43.173 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:43.174 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:43.175+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:43.176 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:43.177 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:43.222 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:43.222 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:43.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:43.287 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:43.286+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:43.375 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:43.375+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:43.377 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:43.377 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:43.391 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:43.453 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:56:43.476 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:43.475+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:43.562 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:43.562 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:43.575 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:43.577 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:43.574+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:43.678 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:43.679+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:43.713 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:43.714 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:43.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:43.778 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:43.774+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:43.849 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:43.849 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:43.864 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:43.879 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:43.879+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:43.980 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:43.979+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:44.032 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:44.033 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:44.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:44.080 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:44.079+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:44.175 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:44.175 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:44.181 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:44.179+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:44.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:44.282 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:44.283+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:44.302 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:44.303 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:44.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:44.383 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:44.378+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:44.431 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:44.431 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:44.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:44.484 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:44.483+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:44.585 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:44.582+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:44.604 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:44.604 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:44.618 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:44.703 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:44.702+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:44.787 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:44.786+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:44.789 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:44.789 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:44.802 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:44.887 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:44.886+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:44.957 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:44.957 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:44.970 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:45.011 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:45.010+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:45.089 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:45.086+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:45.133 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:45.133 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:45.147 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:45.177 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:45.192 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:45.190+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:45.279 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:45.280 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:45.291 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:45.291+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:45.293 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:45.327 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:45.327 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:45.343 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:45.343 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:45.360 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:45.360 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:45.377 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:45.377 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:45.377 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:45.392 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:45.391+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:45.397 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:45.397 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:45.428 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:45.429 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:45.456 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:45.456 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:45.456 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:45.456 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:45.456 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:45.463 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:45.463 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:45.468 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:45.468 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:45.470 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:45.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:56:45.519 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:45.518+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:45.594 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:45.590+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1278 3.2f 3:f571631c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.851105474000001, 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024049979999999999, 2024-05-10T09:56:45.638 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1278 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786219+0000", 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790848+0000", 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046288800000000001 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790903+0000", 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5396000000000003e-05 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790931+0000", 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7852999999999999e-05 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791091+0000", 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000160085 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791356+0000", 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026496799999999997 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791614+0000", 2024-05-10T09:56:45.642 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000258304 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.801355+0000", 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097402099999999991 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810050+0000", 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086953199999999994 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.643 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810149+0000", 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9086000000000006e-05 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810266+0000", 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116655 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1282 3.1d 3:bb239e62:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:45.644 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.808190652, 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032019191000000002, 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1282 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.645 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829134+0000", 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1700000000000001e-06 2024-05-10T09:56:45.646 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.650 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.833983+0000", 2024-05-10T09:56:45.650 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048496269999999996 2024-05-10T09:56:45.650 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.650 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.650 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834016+0000", 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2459999999999998e-05 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834034+0000", 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8427000000000002e-05 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834157+0000", 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122502 2024-05-10T09:56:45.651 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834453+0000", 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029603700000000003 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834694+0000", 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024105099999999999 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.652 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.857709+0000", 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023014703000000001 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.860974+0000", 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032658309999999999 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861076+0000", 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010209600000000001 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.653 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861150+0000", 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3287000000000005e-05 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1283 3.37 e69/23 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.792269611, 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021592063000000002, 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.654 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.655 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845054+0000", 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7e-06 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848409+0000", 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003354938 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.656 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848451+0000", 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2259999999999999e-05 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848477+0000", 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5829e-05 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848600+0000", 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122516 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.657 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848685+0000", 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4759000000000006e-05 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866565+0000", 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017880391999999998 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866644+0000", 2024-05-10T09:56:45.658 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8669000000000002e-05 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1289 3.38 e69/23 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.729089819, 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019676500999999999, 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.659 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908231+0000", 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.908234+0000", 2024-05-10T09:56:45.660 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0800000000000002e-06 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912818+0000", 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045836089999999998 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912865+0000", 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6959999999999998e-05 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.661 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.912889+0000", 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4153000000000001e-05 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.913037+0000", 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014763499999999999 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.662 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.913095+0000", 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.8158999999999997e-05 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.927816+0000", 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014720746 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.927908+0000", 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2158999999999996e-05 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.663 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1290 3.1d 3:ba11a2de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.719685909000001, 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026748503999999999, 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.664 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1290 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.665 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917638+0000", 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0570000000000001e-06 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922152+0000", 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045138899999999996 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.666 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922203+0000", 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0649000000000002e-05 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922222+0000", 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9470000000000002e-05 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922397+0000", 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174575 2024-05-10T09:56:45.667 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922662+0000", 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026555799999999999 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922907+0000", 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024483699999999997 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.668 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.937015+0000", 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014107511 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944214+0000", 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071986680000000001 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944311+0000", 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7806000000000005e-05 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.669 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944384+0000", 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2483000000000004e-05 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1294 3.3a 3:5c4910a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.677775871, 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019051561000000002, 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.670 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1294 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.671 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959545+0000", 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.959549+0000", 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.207e-06 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964361+0000", 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048128509999999999 2024-05-10T09:56:45.672 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964396+0000", 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4656000000000002e-05 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964421+0000", 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5057000000000001e-05 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.673 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964573+0000", 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015201099999999999 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.964830+0000", 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025683800000000001 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.965066+0000", 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000236188 2024-05-10T09:56:45.674 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.973334+0000", 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082677270000000008 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978324+0000", 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049900120000000003 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978481+0000", 2024-05-10T09:56:45.675 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157522 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.978597+0000", 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115492 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1295 3.c 3:324d36a8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:45.676 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.668065964, 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016839302, 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1295 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.677 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969255+0000", 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.969258+0000", 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8930000000000001e-06 2024-05-10T09:56:45.678 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975186+0000", 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059273879999999996 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975219+0000", 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3114999999999997e-05 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975244+0000", 2024-05-10T09:56:45.679 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5117e-05 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975367+0000", 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012329600000000001 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975622+0000", 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025457000000000002 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.680 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.975849+0000", 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022689100000000001 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.984503+0000", 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086545649999999995 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.985938+0000", 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014345759999999999 2024-05-10T09:56:45.681 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.986028+0000", 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9992000000000002e-05 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.986095+0000", 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6898999999999998e-05 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.682 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1296 3.2 e69/23 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.612598117999999, 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018465083, 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:45.683 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024723+0000", 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.024740+0000", 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6575999999999999e-05 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.684 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033470+0000", 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0087304400000000008 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033505+0000", 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4666000000000003e-05 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033521+0000", 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6730000000000001e-05 2024-05-10T09:56:45.685 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033676+0000", 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000154439 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.033717+0000", 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0763000000000003e-05 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.686 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.043060+0000", 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0093434929999999996 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.043188+0000", 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000127976 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1304 3.28 3:17fc7310:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:45.687 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.203351484000001, 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019639535999999999, 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1304 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:45.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433970+0000", 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433974+0000", 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4660000000000001e-06 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439744+0000", 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057702939999999996 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439780+0000", 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5880000000000002e-05 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.439806+0000", 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5729999999999999e-05 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440017+0000", 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000211225 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440286+0000", 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026847399999999999 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.440531+0000", 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024496400000000002 2024-05-10T09:56:45.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.448055+0000", 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0075244780000000002 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453518+0000", 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0054625749999999999 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453566+0000", 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7890999999999999e-05 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.453609+0000", 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3559000000000001e-05 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1400 3.22 3:450b599e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:45.693 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.2330068900000004, 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017183650000000002, 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1400 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404314+0000", 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.404318+0000", 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6600000000000001e-06 2024-05-10T09:56:45.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408668+0000", 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043499589999999996 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408709+0000", 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0580000000000001e-05 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408728+0000", 2024-05-10T09:56:45.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9698999999999999e-05 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.408930+0000", 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020164900000000001 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.409187+0000", 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025756999999999999 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.409423+0000", 2024-05-10T09:56:45.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000235565 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.419973+0000", 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010550426 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421320+0000", 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001346243 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421427+0000", 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107576 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.421498+0000", 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0722999999999994e-05 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.699 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1409 3.30 3:0da814af:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.1162992599999999, 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018836762999999999, 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1409 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.700 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521022+0000", 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.521026+0000", 2024-05-10T09:56:45.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5599999999999998e-06 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526195+0000", 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051697829999999998 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526237+0000", 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1640000000000001e-05 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526256+0000", 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8902999999999998e-05 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526415+0000", 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015881900000000001 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526672+0000", 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025730399999999997 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.526924+0000", 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025230400000000002 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.536038+0000", 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091132899999999996 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539684+0000", 2024-05-10T09:56:45.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036459589999999998 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539785+0000", 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101549 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.539859+0000", 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3652000000000006e-05 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1418 3.28 3:14cb8ba5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.9930887570000007, 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016341517999999999, 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1418 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.706 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644232+0000", 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.644237+0000", 2024-05-10T09:56:45.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8670000000000002e-06 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650393+0000", 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.006155275 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650434+0000", 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1492000000000002e-05 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650453+0000", 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8830000000000001e-05 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650590+0000", 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013698900000000001 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.650842+0000", 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025209100000000002 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.651080+0000", 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023778100000000001 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.659932+0000", 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088523860000000003 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660404+0000", 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00047188599999999997 2024-05-10T09:56:45.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660503+0000", 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8819000000000004e-05 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.660574+0000", 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.1101999999999998e-05 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1425 3.3a 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.5908096250000003, 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.031419395000000003, 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1425 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.712 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046517+0000", 2024-05-10T09:56:45.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2639999999999999e-06 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055240+0000", 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.008723158 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055281+0000", 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1344999999999998e-05 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055301+0000", 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9317000000000002e-05 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055513+0000", 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021243799999999999 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055925+0000", 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041220299999999998 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.056338+0000", 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041247899999999999 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.071484+0000", 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015146359 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077627+0000", 2024-05-10T09:56:45.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0061428050000000003 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077805+0000", 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017845400000000001 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077931+0000", 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000125573 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1429 3.16 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.5460130379999999, 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029834811999999999, 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1429 2024-05-10T09:56:45.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.719 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091311+0000", 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.914e-06 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095902+0000", 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045904589999999999 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095938+0000", 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6043e-05 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095955+0000", 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7096e-05 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096104+0000", 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149555 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096348+0000", 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024343499999999999 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096601+0000", 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025365799999999998 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.104881+0000", 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082796310000000008 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120963+0000", 2024-05-10T09:56:45.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016081813 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121062+0000", 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9098999999999994e-05 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121143+0000", 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1108999999999999e-05 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1439 3.22 3:47e84655:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.4100312580000001, 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017195082, 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1439 2024-05-10T09:56:45.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227290+0000", 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.227293+0000", 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5099999999999999e-06 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232364+0000", 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050709479999999996 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232404+0000", 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9895999999999999e-05 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232425+0000", 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0696e-05 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232599+0000", 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000173955 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.232995+0000", 2024-05-10T09:56:45.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00039625000000000001 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.233424+0000", 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00042866900000000001 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.242477+0000", 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090527170000000001 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244152+0000", 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016750140000000001 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244358+0000", 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000206825 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.244485+0000", 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012660199999999999 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1440 3.1f e71/23 3:f8aeb630:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_17:head v 71'5, mlcod=68'3)", 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.3894164179999997, 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016924982000000002, 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:45.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247905+0000", 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.247907+0000", 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0870000000000001e-06 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253015+0000", 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051077270000000003 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253047+0000", 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.201e-05 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253063+0000", 2024-05-10T09:56:45.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6433e-05 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253221+0000", 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015811199999999999 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.253264+0000", 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3056000000000002e-05 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.264717+0000", 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011452664 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.264830+0000", 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112893 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1441 3.2 e71/23 3:4091da54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_18:head v 71'4, mlcod=69'2)", 2024-05-10T09:56:45.734 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.3700411399999997, 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016375244000000001, 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267280+0000", 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.267283+0000", 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6369999999999999e-06 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273216+0000", 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059333500000000004 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273253+0000", 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6792999999999998e-05 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273269+0000", 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6447e-05 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273422+0000", 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152261 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.273459+0000", 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6980000000000002e-05 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.283550+0000", 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010091417 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.283655+0000", 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010535900000000001 2024-05-10T09:56:45.738 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1470 3.5 3:a27e3b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 7.5688839510000001, 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019770541999999999, 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.739 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1470 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068437+0000", 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.068440+0000", 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9840000000000001e-06 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073342+0000", 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049020009999999996 2024-05-10T09:56:45.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073377+0000", 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4709999999999998e-05 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073393+0000", 2024-05-10T09:56:45.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6135999999999999e-05 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073478+0000", 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4662999999999999e-05 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073598+0000", 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119858 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.073708+0000", 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110263 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.081250+0000", 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0075420119999999998 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088067+0000", 2024-05-10T09:56:45.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068170399999999999 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088146+0000", 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8831999999999993e-05 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.088208+0000", 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2043000000000002e-05 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1471 3.30 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 7.5451253569999999, 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024868991999999999, 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1471 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.746 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092198+0000", 2024-05-10T09:56:45.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.125e-06 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096157+0000", 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039586839999999996 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096182+0000", 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096192+0000", 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0208e-05 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096269+0000", 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7440000000000004e-05 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096403+0000", 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013410700000000001 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096528+0000", 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000124583 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.105347+0000", 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088185999999999994 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.116955+0000", 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011608408000000001 2024-05-10T09:56:45.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117015+0000", 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0024e-05 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117065+0000", 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9804e-05 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1473 3.2a 3:570843f4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 7.4935232059999999, 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019090323999999999, 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1473 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:45.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143798+0000", 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.143801+0000", 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.57e-06 2024-05-10T09:56:45.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147829+0000", 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004027938 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147871+0000", 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2493000000000001e-05 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:45.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147891+0000", 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9922999999999999e-05 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.147983+0000", 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2151000000000006e-05 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.148167+0000", 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018379900000000001 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.148341+0000", 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017429000000000001 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.155685+0000", 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073433999999999999 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162584+0000", 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068995369999999999 2024-05-10T09:56:45.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162758+0000", 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174024 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.162888+0000", 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000130199 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:45.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:45.758 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:45.759 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:45.759 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:45.759+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:45.859 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:45.858+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:45.931 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:45.931 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:45.931 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:45.945 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:45.990 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:45.991+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:46.060 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:46.059+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:46.075 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:46.075 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:46.075 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:46.089 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:46.174 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:46.175+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:46.256 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:46.256 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:46.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:46.256 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:46.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 118.569289985, 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.257 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:56:46.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.263 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1279 3.a 3:51af0144:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.459766565000001, 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025099606, 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1279 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796337+0000", 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5070000000000002e-06 2024-05-10T09:56:46.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802095+0000", 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057576520000000003 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802133+0000", 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8349000000000002e-05 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802153+0000", 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9993e-05 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802280+0000", 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012646599999999999 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802566+0000", 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028610300000000001 2024-05-10T09:56:46.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802791+0000", 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022570199999999999 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.816789+0000", 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013997486 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821159+0000", 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043700240000000001 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821316+0000", 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156735 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821432+0000", 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116589 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1284 3.36 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.405403716, 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02296221, 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.273 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1284 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850699+0000", 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1240000000000001e-06 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855070+0000", 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043709580000000003 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855111+0000", 2024-05-10T09:56:46.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1310000000000003e-05 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855134+0000", 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2860000000000001e-05 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855272+0000", 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013803099999999999 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855551+0000", 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027930799999999998 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855782+0000", 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000231361 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866830+0000", 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011047631 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873500+0000", 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066699089999999999 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873591+0000", 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1448999999999998e-05 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873658+0000", 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6268999999999999e-05 2024-05-10T09:56:46.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1287 3.2c 3:364c59b2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.370966235999999, 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024099597, 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1287 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885136+0000", 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8040000000000002e-06 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889464+0000", 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043279219999999997 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889499+0000", 2024-05-10T09:56:46.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5199e-05 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889515+0000", 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6422999999999998e-05 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889643+0000", 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012816600000000001 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889903+0000", 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025949099999999999 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.890132+0000", 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022953700000000001 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.902988+0000", 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012855171 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909041+0000", 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060532249999999998 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909155+0000", 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011380200000000001 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909233+0000", 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7856999999999997e-05 2024-05-10T09:56:46.284 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1302 3.34 e69/23 3:2f2d612e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_2:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:32.417323+0000", 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.838776606, 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016212878, 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.417323+0000", 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.417323+0000", 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.417325+0000", 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1500000000000002e-06 2024-05-10T09:56:46.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420050+0000", 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00272522 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420091+0000", 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0992999999999999e-05 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420115+0000", 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4456000000000001e-05 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420318+0000", 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202905 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.420366+0000", 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7719999999999997e-05 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433435+0000", 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013069482 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:32.433535+0000", 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9951999999999994e-05 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1397 3.10 3:0a64e0d8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.289 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.369283+0000", 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.8868163500000001, 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017611031999999999, 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1397 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.369283+0000", 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.369283+0000", 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.369286+0000", 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3440000000000001e-06 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374471+0000", 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051846669999999996 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374510+0000", 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8976000000000001e-05 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374530+0000", 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0066999999999999e-05 2024-05-10T09:56:46.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374690+0000", 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016001500000000001 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.374949+0000", 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025866399999999998 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.375363+0000", 2024-05-10T09:56:46.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041460599999999998 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.385970+0000", 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010606994999999999 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386680+0000", 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00071035399999999996 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386782+0000", 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101839 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386894+0000", 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111505 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1398 3.2e e71/23 3:74667c03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_3:head v 71'6, mlcod=71'4)", 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.383241+0000", 2024-05-10T09:56:46.295 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.8728578260000006, 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015591554000000001, 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.383241+0000", 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.383241+0000", 2024-05-10T09:56:46.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.383244+0000", 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.773e-06 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389161+0000", 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00591663 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389190+0000", 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9657000000000001e-05 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389205+0000", 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.466e-05 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389308+0000", 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010269500000000001 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.389351+0000", 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3736000000000003e-05 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.398743+0000", 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0093915409999999998 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.398833+0000", 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9862000000000001e-05 2024-05-10T09:56:46.299 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1408 3.34 3:2e0b9265:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.508951+0000", 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.7471477629999992, 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014073855, 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.300 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1408 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.508951+0000", 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.508951+0000", 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.508955+0000", 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2969999999999999e-06 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513049+0000", 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040940509999999996 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513093+0000", 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4379000000000003e-05 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513119+0000", 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6242999999999999e-05 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513344+0000", 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022438499999999999 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.513632+0000", 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0002879 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.522776+0000", 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091441200000000004 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.522890+0000", 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113775 2024-05-10T09:56:46.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.523025+0000", 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013570499999999999 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1412 3.2c 3:350e49dc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.565759+0000", 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.6903397879999993, 2024-05-10T09:56:46.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014499593999999999, 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1412 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.565759+0000", 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.565759+0000", 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.565763+0000", 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3830000000000001e-06 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.569740+0000", 2024-05-10T09:56:46.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039776819999999997 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.569782+0000", 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1239000000000003e-05 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.569800+0000", 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8754e-05 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.570010+0000", 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020913400000000001 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.570279+0000", 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000269945 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.579803+0000", 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0095237689999999996 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.579988+0000", 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184255 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.580259+0000", 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027143300000000001 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1413 3.36 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.6791927680000001, 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024918131999999999, 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1413 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576908+0000", 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581066+0000", 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004157244 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581103+0000", 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6973e-05 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581120+0000", 2024-05-10T09:56:46.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7343e-05 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581261+0000", 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000140672 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581530+0000", 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026880099999999999 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:46.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581772+0000", 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000242754 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.590838+0000", 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090655300000000005 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601650+0000", 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010812307 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601751+0000", 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100766 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601825+0000", 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3635999999999998e-05 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1415 3.34 3:2fa31341:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.316 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.607995+0000", 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.6481039309999996, 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013934139999999999, 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1415 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.607995+0000", 2024-05-10T09:56:46.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.607995+0000", 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.607998+0000", 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6599999999999999e-06 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612041+0000", 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040434039999999996 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612079+0000", 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7599999999999999e-05 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612097+0000", 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7626e-05 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612244+0000", 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014797200000000001 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.612502+0000", 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025747399999999999 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.621617+0000", 2024-05-10T09:56:46.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091147199999999998 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.621730+0000", 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113112 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.621929+0000", 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019957199999999999 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1417 3.2e e71/23 3:75940b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_22:head v 71'7, mlcod=71'5)", 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.637623+0000", 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.6184766079999999, 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014514175000000001, 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.637623+0000", 2024-05-10T09:56:46.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.637623+0000", 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.637673+0000", 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0835999999999999e-05 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642691+0000", 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050172560000000003 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642730+0000", 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9440000000000002e-05 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642748+0000", 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7465999999999998e-05 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642908+0000", 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000160032 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.642952+0000", 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4765999999999998e-05 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.651994+0000", 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090416000000000003 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.652137+0000", 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142779 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1424 3.a 3:50b58fe7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.2229165379999998, 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02028814, 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.326 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1424 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033186+0000", 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3840000000000001e-06 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039575+0000", 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063893420000000001 2024-05-10T09:56:46.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039613+0000", 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7518999999999998e-05 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039630+0000", 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.751e-05 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039808+0000", 2024-05-10T09:56:46.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178025 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.040103+0000", 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000294531 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053142+0000", 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013038696000000001 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053249+0000", 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107255 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053471+0000", 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022187800000000001 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1430 3.3f e71/23 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head v 71'3, mlcod=71'1)", 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:56:46.331 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.1479666030000004, 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017678704999999999, 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108135+0000", 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4269999999999998e-06 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111069+0000", 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029336520000000001 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111113+0000", 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4193000000000002e-05 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111132+0000", 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9157e-05 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111305+0000", 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000172621 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111372+0000", 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6935999999999997e-05 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.125674+0000", 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014302199999999999 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.125811+0000", 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013751900000000001 2024-05-10T09:56:46.335 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1434 3.33 e71/23 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head v 71'1, mlcod=0'0)", 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.0962712890000006, 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017779593, 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159831+0000", 2024-05-10T09:56:46.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.903e-06 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165818+0000", 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005987643 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165855+0000", 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6866000000000002e-05 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165872+0000", 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6793e-05 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.166014+0000", 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014216200000000001 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.166081+0000", 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.648e-05 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177476+0000", 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011395621 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177607+0000", 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131125 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1438 3.1e e71/23 3:7ac7bc5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_15:head v 71'3, mlcod=68'1)", 2024-05-10T09:56:46.340 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.216485+0000", 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.0396145669999992, 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014376750000000001, 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.216485+0000", 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.216485+0000", 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.216531+0000", 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6669999999999999e-05 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221602+0000", 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050711189999999998 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221642+0000", 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9802000000000003e-05 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221659+0000", 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7187e-05 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221858+0000", 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000198698 2024-05-10T09:56:46.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.221903+0000", 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4570000000000002e-05 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.230701+0000", 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0087980149999999993 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.230861+0000", 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016068899999999999 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1444 3.26 3:66bf84d6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.9518188670000001, 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020383655000000001, 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.345 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1444 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:56:46.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304284+0000", 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5300000000000001e-06 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309335+0000", 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050508920000000004 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309376+0000", 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1016000000000002e-05 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309395+0000", 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8810000000000001e-05 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309534+0000", 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013921199999999999 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309788+0000", 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025465399999999999 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.310003+0000", 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021485100000000001 2024-05-10T09:56:46.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.317815+0000", 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0078115260000000001 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324488+0000", 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066737289999999998 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324589+0000", 2024-05-10T09:56:46.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100726 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324664+0000", 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4709000000000006e-05 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1454 3.2c 3:34adac54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.722103+0000", 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.5339960529999992, 2024-05-10T09:56:46.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016306314999999998, 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1454 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.722103+0000", 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.722103+0000", 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.722107+0000", 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8770000000000003e-06 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726386+0000", 2024-05-10T09:56:46.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042789960000000002 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726424+0000", 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8418999999999999e-05 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726445+0000", 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0720000000000002e-05 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726631+0000", 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018590499999999999 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.726918+0000", 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028696400000000001 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.738085+0000", 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011166544 2024-05-10T09:56:46.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.738207+0000", 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122032 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.738409+0000", 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020285799999999999 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1462 3.2e e72/23 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head v 72'8, mlcod=71'6)", 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.3707406070000001, 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021282938000000001, 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885360+0000", 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9000000000000005e-07 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892622+0000", 2024-05-10T09:56:46.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0072619779999999997 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892660+0000", 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8633000000000001e-05 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892678+0000", 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7649999999999999e-05 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892846+0000", 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000168398 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892886+0000", 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9687000000000001e-05 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906436+0000", 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013549913 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906641+0000", 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000205689 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1463 3.34 3:2fb45b2e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.904897+0000", 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.3512019290000001, 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013387915, 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.361 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1463 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.904897+0000", 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.904897+0000", 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.904900+0000", 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9399999999999998e-06 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910130+0000", 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052303230000000003 2024-05-10T09:56:46.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910176+0000", 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5958999999999998e-05 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910196+0000", 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0032999999999999e-05 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910327+0000", 2024-05-10T09:56:46.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013026300000000001 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.910597+0000", 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027010000000000001 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.917904+0000", 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0073071639999999997 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.918056+0000", 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000152165 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.918285+0000", 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022896799999999999 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.366 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:46.368 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:46.368 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:46.366+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:46.468 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:46.466+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:46.471 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:56:46.538 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:46.538 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:46.538 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:56:46.538 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:46.552 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:46.602 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:46.603+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:46.670 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:46.666+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:46.673 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:46.673 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:46.673 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:46.673 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:46.673 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:46.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:46.774 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:46.775+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:46.850 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 139.31198180499999, 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.851 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:56:46.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 138.3883811, 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.858 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:56:46.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:56:46.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 138.38818825800001, 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:56:46.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:56:46.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 138.38814808800001, 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 138.388062862, 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.875 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:56:46.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 138.387870607, 2024-05-10T09:56:46.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:56:46.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:56:46.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:56:46.888 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 138.38783429399999, 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:46.889 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:46.890 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.891 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.892 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:56:46.893 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.894 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1273 3.2d 3:b59bb266:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.734294+0000", 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.114142658, 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018979024000000001, 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.895 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1273 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.734294+0000", 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.896 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.734294+0000", 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.734297+0000", 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1099999999999999e-06 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.738504+0000", 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042070830000000004 2024-05-10T09:56:46.897 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.738542+0000", 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8145999999999997e-05 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.738562+0000", 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9663000000000001e-05 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.738755+0000", 2024-05-10T09:56:46.898 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019335500000000001 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.739010+0000", 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025481400000000002 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.739228+0000", 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021771099999999999 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.899 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.746393+0000", 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071658950000000003 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.753117+0000", 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067233919999999999 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.753204+0000", 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7012e-05 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.900 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.753273+0000", 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8843000000000005e-05 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1277 3.2d 3:b6aa08bb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.071986342000001, 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020498677, 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.901 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1277 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.902 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776453+0000", 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.61e-06 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780453+0000", 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040001919999999996 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.903 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780490+0000", 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6887000000000001e-05 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780514+0000", 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4206000000000002e-05 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780721+0000", 2024-05-10T09:56:46.904 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020692799999999999 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780986+0000", 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026536099999999998 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.781220+0000", 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023365699999999999 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.905 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790889+0000", 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0096689380000000002 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796601+0000", 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005712778 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796764+0000", 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162922 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.906 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796949+0000", 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184198 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1278 3.2f e69/23 3:f571631c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_6:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.791901+0000", 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.056535652999999, 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017808445999999999, 2024-05-10T09:56:46.907 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791901+0000", 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791901+0000", 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.908 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791901+0000", 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9999999999999997e-07 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796207+0000", 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043062020000000003 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796246+0000", 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8290000000000001e-05 2024-05-10T09:56:46.909 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796265+0000", 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9346000000000001e-05 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796449+0000", 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184062 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.910 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796513+0000", 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3546000000000004e-05 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.809608+0000", 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013095018 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.809709+0000", 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101382 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.911 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1283 3.37 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.008745061000001, 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.027466540000000001, 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.912 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1283 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.913 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839695+0000", 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7330000000000001e-06 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843941+0000", 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042461169999999998 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843982+0000", 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1083e-05 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.914 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844002+0000", 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9525999999999999e-05 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844137+0000", 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013504500000000001 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844411+0000", 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027433399999999999 2024-05-10T09:56:46.915 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844789+0000", 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037824700000000001 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.859343+0000", 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014554197 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866992+0000", 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076486699999999998 2024-05-10T09:56:46.916 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867082+0000", 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0229000000000006e-05 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867158+0000", 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5358999999999995e-05 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.917 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1396 3.3b 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.488377819, 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026528719999999999, 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1396 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.918 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360061+0000", 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.919 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364016+0000", 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039552420000000003 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364051+0000", 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4603000000000001e-05 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364069+0000", 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7737e-05 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.920 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364204+0000", 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135048 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364468+0000", 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000264505 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364705+0000", 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000237004 2024-05-10T09:56:46.921 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.375226+0000", 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010521076000000001 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386408+0000", 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011182133 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.922 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386511+0000", 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103226 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386587+0000", 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5685999999999993e-05 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1401 3.11 3:8bf50c8e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.415819+0000", 2024-05-10T09:56:46.923 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.432617014, 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015651326, 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1401 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.415819+0000", 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.415819+0000", 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.415822+0000", 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1030000000000002e-06 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420057+0000", 2024-05-10T09:56:46.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042343099999999998 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420101+0000", 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4672000000000002e-05 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420130+0000", 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8444000000000001e-05 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420305+0000", 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017559800000000001 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420581+0000", 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000275147 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431221+0000", 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010640004999999999 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431315+0000", 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4899000000000001e-05 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431471+0000", 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155148 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.928 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1402 3.2d 3:b5eccbcc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.426632+0000", 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.421804313999999, 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017052339999999999, 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1402 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.426632+0000", 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.426632+0000", 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.426634+0000", 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:56:46.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.430780+0000", 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041461069999999996 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.430812+0000", 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1269000000000002e-05 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.430835+0000", 2024-05-10T09:56:46.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3343e-05 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.430982+0000", 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014662900000000001 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431263+0000", 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028100999999999999 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:46.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431523+0000", 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026044799999999998 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.442969+0000", 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011445705 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.443511+0000", 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054230800000000003 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.443604+0000", 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2765999999999999e-05 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.443684+0000", 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0445000000000007e-05 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.934 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1404 3.e 3:713372cb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.456733+0000", 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.391703061999999, 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015227938, 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1404 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.935 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.456733+0000", 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.456733+0000", 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.456736+0000", 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.123e-06 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.460703+0000", 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039665589999999997 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.460741+0000", 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8009999999999997e-05 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.460768+0000", 2024-05-10T09:56:46.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6676999999999999e-05 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.460956+0000", 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018849399999999999 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.461212+0000", 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025583099999999998 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.471727+0000", 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01051471 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.471833+0000", 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010650900000000001 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.471961+0000", 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012802500000000001 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.939 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1421 3.e 3:73b264db:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.8:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.711591+0000", 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.136845372, 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017678085999999999, 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.940 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1421 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.711591+0000", 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.711591+0000", 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.711594+0000", 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7240000000000001e-06 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.715720+0000", 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041267370000000001 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.715758+0000", 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7589999999999998e-05 2024-05-10T09:56:46.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.715781+0000", 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2687000000000001e-05 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.715930+0000", 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149118 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.716202+0000", 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000272451 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.728977+0000", 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012775092 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.729114+0000", 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013655500000000001 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.729269+0000", 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015513199999999999 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1429 3.16 e71/23 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head v 71'2, mlcod=0'0)", 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.7515414099999997, 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023672451000000001, 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.945 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096897+0000", 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.537e-06 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101828+0000", 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049309260000000004 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101999+0000", 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170528 2024-05-10T09:56:46.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102086+0000", 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7626000000000004e-05 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102334+0000", 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024782500000000002 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102407+0000", 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2595000000000005e-05 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120420+0000", 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018012986000000002 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120567+0000", 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014742800000000001 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1430 3.3f 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.7469544540000008, 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024797998000000002, 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1430 2024-05-10T09:56:46.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101486+0000", 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.704e-06 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107182+0000", 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056960689999999998 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107222+0000", 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0469999999999997e-05 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107242+0000", 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9606000000000002e-05 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107368+0000", 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126375 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107635+0000", 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026656199999999997 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107848+0000", 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000213348 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.124755+0000", 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016906694 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126120+0000", 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001365078 2024-05-10T09:56:46.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126213+0000", 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3392000000000003e-05 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126280+0000", 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6699999999999995e-05 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.955 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1435 3.3b 3:dd2501f8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.174319+0000", 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.6741169980000006, 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017237722, 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1435 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.174319+0000", 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.174319+0000", 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.174324+0000", 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8040000000000001e-06 2024-05-10T09:56:46.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177967+0000", 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036430350000000002 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178007+0000", 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9672000000000002e-05 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178059+0000", 2024-05-10T09:56:46.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2227e-05 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178208+0000", 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014925800000000001 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178458+0000", 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024967799999999998 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:46.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178697+0000", 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000238984 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.189067+0000", 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010370155000000001 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.191260+0000", 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021925719999999998 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.191435+0000", 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000175658 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.191557+0000", 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121679 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1456 3.12 e72/23 3:49fd254a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_5:head v 72'2, mlcod=0'0)", 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.769493+0000", 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.0789432550000004, 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019609181999999999, 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.769493+0000", 2024-05-10T09:56:46.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.769493+0000", 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.769494+0000", 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9699999999999996e-07 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:46.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.774788+0000", 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052944760000000002 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.774828+0000", 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9629000000000003e-05 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.774856+0000", 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8013000000000001e-05 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.775038+0000", 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018195799999999999 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.775103+0000", 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5686999999999996e-05 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.788987+0000", 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013883917000000001 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:46.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.789102+0000", 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115005 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:46.966 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:46.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:46.968 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:46.966+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:47.069 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:47.066+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:47.100 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:47.100 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:47.101 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:47.101 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:47.114 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:47.170 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:47.171+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:47.271 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:47.271+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:47.283 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:47.284 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:47.284 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:47.297 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:47.372 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:47.370+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:47.413 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1276 3.23 3:c6394aa1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.763756+0000", 2024-05-10T09:56:47.413 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.647024643, 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012837995, 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1276 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763756+0000", 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763756+0000", 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763758+0000", 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5579999999999999e-06 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.765997+0000", 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022385159999999999 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766030+0000", 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2573000000000001e-05 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766044+0000", 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4834999999999999e-05 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766122+0000", 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7873000000000005e-05 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766309+0000", 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018692200000000001 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766439+0000", 2024-05-10T09:56:47.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012998900000000001 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.773516+0000", 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007076972 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776490+0000", 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029743479999999999 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776554+0000", 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3736000000000001e-05 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776594+0000", 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9672999999999998e-05 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1291 3.1b 3:d8e30cbd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:47.419 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.485195399, 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020403290000000001, 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1291 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925588+0000", 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.818e-06 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927537+0000", 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001949442 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927563+0000", 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5677000000000002e-05 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927577+0000", 2024-05-10T09:56:47.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3623e-05 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927670+0000", 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3244000000000004e-05 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927880+0000", 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000209662 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:47.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.928062+0000", 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018209899999999999 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.933967+0000", 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0059051989999999999 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945905+0000", 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011938318 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945952+0000", 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6644999999999998e-05 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945988+0000", 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6563000000000002e-05 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.425 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1294 3.3a e69/23 3:5c4910a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_22:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.963919+0000", 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.446861302, 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012596777, 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.963919+0000", 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.963919+0000", 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.963921+0000", 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.826e-06 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.969992+0000", 2024-05-10T09:56:47.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060709359999999999 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.970023+0000", 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1186000000000003e-05 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.970038+0000", 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4714e-05 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.970116+0000", 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8195000000000006e-05 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.970136+0000", 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9928999999999998e-05 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.976449+0000", 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0063127720000000003 2024-05-10T09:56:47.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.976516+0000", 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7218999999999995e-05 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1301 3.23 3:c760cb7d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.013977388000001, 2024-05-10T09:56:47.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014075771000000001, 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1301 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396806+0000", 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2040000000000002e-06 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398853+0000", 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020470060000000001 2024-05-10T09:56:47.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398904+0000", 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1011999999999999e-05 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398935+0000", 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0454e-05 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399051+0000", 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011635 2024-05-10T09:56:47.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399241+0000", 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018986200000000001 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399420+0000", 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017852300000000001 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410164+0000", 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010744258 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410747+0000", 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058339799999999995 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410818+0000", 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1218999999999997e-05 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410879+0000", 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0485000000000001e-05 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1303 3.6 3:6092e388:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.988944096000001, 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019484492999999999, 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1303 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421841+0000", 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5340000000000001e-06 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424916+0000", 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030753439999999998 2024-05-10T09:56:47.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424945+0000", 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8399999999999999e-05 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424957+0000", 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2211e-05 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425038+0000", 2024-05-10T09:56:47.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0659000000000001e-05 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425218+0000", 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018066499999999999 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425377+0000", 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015881599999999999 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.431067+0000", 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056899419999999999 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441200+0000", 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010132755 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441255+0000", 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4864999999999997e-05 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441321+0000", 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6302000000000003e-05 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1308 3.6 3:62f870a7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.481673+0000", 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.929107275, 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012935558999999999, 2024-05-10T09:56:47.442 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1308 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.481673+0000", 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.481673+0000", 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.481676+0000", 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8100000000000002e-06 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484488+0000", 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028119590000000002 2024-05-10T09:56:47.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484531+0000", 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3242999999999999e-05 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484552+0000", 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0761999999999999e-05 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484626+0000", 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4395999999999997e-05 2024-05-10T09:56:47.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484739+0000", 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011300500000000001 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484851+0000", 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000111626 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.493980+0000", 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0091291900000000006 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.494473+0000", 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049296300000000002 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.494541+0000", 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7705000000000003e-05 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.494609+0000", 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7899999999999997e-05 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1312 3.17 3:ebbfdea4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.883501665000001, 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015421182, 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.448 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1312 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527282+0000", 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.366e-06 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528783+0000", 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001500978 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528815+0000", 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1828000000000001e-05 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528829+0000", 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4041e-05 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528931+0000", 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010204600000000001 2024-05-10T09:56:47.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.529101+0000", 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016975900000000001 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.529305+0000", 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000203919 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.534340+0000", 2024-05-10T09:56:47.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0050356369999999999 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542583+0000", 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082426240000000005 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542646+0000", 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3357999999999999e-05 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.453 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542700+0000", 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3625999999999998e-05 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1409 3.30 e71/23 3:0da814af:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_14:head v 71'4, mlcod=68'2)", 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.525712+0000", 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.885068491, 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012184957999999999, 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.454 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.525712+0000", 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.525712+0000", 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.525714+0000", 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9709999999999998e-06 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.531538+0000", 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058235429999999996 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.531568+0000", 2024-05-10T09:56:47.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0488999999999999e-05 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.531585+0000", 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6855e-05 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.531674+0000", 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9456999999999994e-05 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.531732+0000", 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7686000000000003e-05 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.537815+0000", 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060831949999999996 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.537897+0000", 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1761999999999994e-05 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.458 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1410 3.3d 3:be56ca3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.532315+0000", 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.878465992000001, 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012616049000000001, 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.459 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1410 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.532315+0000", 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.532315+0000", 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.532331+0000", 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6818999999999999e-05 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.534972+0000", 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026408759999999999 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535001+0000", 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8445999999999998e-05 2024-05-10T09:56:47.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535015+0000", 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4630999999999999e-05 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535122+0000", 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010685500000000001 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535305+0000", 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000182664 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.535447+0000", 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000142275 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.544604+0000", 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0091566349999999998 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.544793+0000", 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018937500000000001 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.544868+0000", 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5313000000000002e-05 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.544931+0000", 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2160000000000001e-05 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.464 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1414 3.23 3:c5cb197a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.821489530000001, 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014761384000000001, 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.465 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1414 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589295+0000", 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6239999999999999e-06 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591498+0000", 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022029509999999999 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591522+0000", 2024-05-10T09:56:47.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4368000000000001e-05 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591535+0000", 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2652e-05 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591619+0000", 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4571000000000001e-05 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591860+0000", 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024051199999999999 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.592070+0000", 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021078000000000001 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.600032+0000", 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007961437 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.603921+0000", 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0038889419999999998 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.603996+0000", 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5352999999999995e-05 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.604052+0000", 2024-05-10T09:56:47.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6193999999999998e-05 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1425 3.3a e71/23 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head v 71'5, mlcod=71'3)", 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.355528575999999, 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019775094, 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.471 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055255+0000", 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6129999999999998e-06 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066229+0000", 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010974634 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066267+0000", 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7953000000000001e-05 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066283+0000", 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5993000000000001e-05 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066373+0000", 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9370999999999995e-05 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066391+0000", 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8797999999999999e-05 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074966+0000", 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0085746869999999992 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.075027+0000", 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1044999999999996e-05 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.475 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1428 3.32 3:4e529b56:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.332107376, 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016023631999999999, 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1428 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078678+0000", 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6299999999999997e-06 2024-05-10T09:56:47.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084738+0000", 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060599540000000002 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084791+0000", 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3476000000000001e-05 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084846+0000", 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5136000000000002e-05 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084961+0000", 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114948 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.085137+0000", 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017568299999999999 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.085325+0000", 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018774899999999999 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094095+0000", 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087703 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094572+0000", 2024-05-10T09:56:47.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047742699999999999 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094641+0000", 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8231000000000005e-05 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094697+0000", 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6097999999999997e-05 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1432 3.6 3:63c25752:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.282316772, 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015410627, 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1432 2024-05-10T09:56:47.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128466+0000", 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6000000000000001e-06 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130918+0000", 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0024514509999999999 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130959+0000", 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1465999999999999e-05 2024-05-10T09:56:47.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130984+0000", 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5170000000000001e-05 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131078+0000", 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3546000000000002e-05 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131189+0000", 2024-05-10T09:56:47.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000111019 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131293+0000", 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103532 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.137135+0000", 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058429440000000001 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143641+0000", 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065052260000000002 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143783+0000", 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014180599999999999 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143874+0000", 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1867000000000007e-05 2024-05-10T09:56:47.487 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1440 3.1f 3:f8aeb630:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.16730847, 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020526757, 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.488 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1440 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:47.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243475+0000", 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9830000000000001e-06 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245852+0000", 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023767039999999999 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245878+0000", 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5867000000000002e-05 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245889+0000", 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1226999999999999e-05 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245960+0000", 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0693999999999998e-05 2024-05-10T09:56:47.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.246103+0000", 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014311400000000001 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.246193+0000", 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0216000000000005e-05 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.250671+0000", 2024-05-10T09:56:47.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0044783089999999998 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263735+0000", 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013064045999999999 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263891+0000", 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015604099999999999 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263999+0000", 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000107556 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1449 3.1b 3:d8b9774b:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.060636047999999, 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017268909999999998, 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.494 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1449 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350146+0000", 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2160000000000001e-06 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352148+0000", 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020024819999999999 2024-05-10T09:56:47.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352170+0000", 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.16e-05 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352179+0000", 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3470000000000005e-06 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352334+0000", 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015537799999999999 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352777+0000", 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044212500000000003 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367306+0000", 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014529243000000001 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367355+0000", 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8834e-05 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367413+0000", 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8684999999999998e-05 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1456 3.12 3:49fd254a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.6483072280000002, 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.026305321999999999, 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1456 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.500 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762477+0000", 2024-05-10T09:56:47.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3569999999999998e-06 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766831+0000", 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0043540540000000004 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766872+0000", 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1669999999999999e-05 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766897+0000", 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767040+0000", 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014221899999999999 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767300+0000", 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026063300000000002 2024-05-10T09:56:47.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767574+0000", 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027399 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788426+0000", 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020851634000000001 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788542+0000", 2024-05-10T09:56:47.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116322 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788676+0000", 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013342200000000001 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788779+0000", 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103012 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1457 3.12 3:48cf3986:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.6377305020000001, 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018620484999999999, 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.506 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1457 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773053+0000", 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0630000000000002e-06 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776037+0000", 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029840909999999999 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776070+0000", 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2966000000000003e-05 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776090+0000", 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9652000000000001e-05 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.778860+0000", 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027701610000000002 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.779152+0000", 2024-05-10T09:56:47.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029241599999999999 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.779439+0000", 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028643000000000001 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.789444+0000", 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010004822999999999 2024-05-10T09:56:47.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791535+0000", 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020911950000000001 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791613+0000", 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7945e-05 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791671+0000", 2024-05-10T09:56:47.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7742999999999999e-05 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1466 3.23 3:c6625ef2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.4351113019999993, 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017247114000000001, 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.512 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1466 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975673+0000", 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8260000000000003e-06 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978412+0000", 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027384610000000002 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978458+0000", 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6771999999999999e-05 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978487+0000", 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8597000000000001e-05 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.515 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978660+0000", 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017359400000000001 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978964+0000", 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030344999999999998 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.979245+0000", 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028105300000000002 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.986720+0000", 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007474596 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992704+0000", 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.005984708 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992816+0000", 2024-05-10T09:56:47.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112025 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992916+0000", 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010003199999999999 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1471 3.30 e72/23 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head v 72'5, mlcod=71'3)", 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:47.518 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.3154890530000003, 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01989001, 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:47.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095294+0000", 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.847e-06 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100863+0000", 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055683529999999998 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100908+0000", 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5663e-05 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100936+0000", 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7535999999999999e-05 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.101115+0000", 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179548 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.101182+0000", 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6262999999999999e-05 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.115085+0000", 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013903067999999999 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.115181+0000", 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6731999999999995e-05 2024-05-10T09:56:47.522 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1481 3.23 3:c69e0ccf:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.9TGTnc9vG5KyjmhwrXgYxlQx6jov7Nj_1:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.293861+0000", 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.1169194699999991, 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011819980000000001, 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "started", 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:47.523 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1481 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.293861+0000", 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.293861+0000", 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:47.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.293865+0000", 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1629999999999998e-06 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.293888+0000", 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2719999999999999e-05 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.293934+0000", 2024-05-10T09:56:47.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6508999999999998e-05 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.293959+0000", 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4856999999999999e-05 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.294137+0000", 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000177844 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.294407+0000", 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027033299999999999 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.305681+0000", 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011273554 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:47.527 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:47.528 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:47.529 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:47.530 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:47.531+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:47.630 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:47.626+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_29: 100Mb.10 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.1 from bucket to /tmp/downloadfile.1 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.2 from bucket to /tmp/downloadfile.2 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.3 from bucket to /tmp/downloadfile.3 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.4 from bucket to /tmp/downloadfile.4 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.5 from bucket to /tmp/downloadfile.5 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.6 from bucket to /tmp/downloadfile.6 2024-05-10T09:56:47.641 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.7 from bucket to /tmp/downloadfile.7 2024-05-10T09:56:47.642 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.8 from bucket to /tmp/downloadfile.8 2024-05-10T09:56:47.642 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.9 from bucket to /tmp/downloadfile.9 2024-05-10T09:56:47.642 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 100Mb.10 from bucket to /tmp/downloadfile.10 2024-05-10T09:56:47.642 INFO:tasks.workunit.client.0.smithi042.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-10T09:56:47.642 INFO:tasks.workunit.client.0.smithi042.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-05-10T09:56:47.642 INFO:tasks.workunit.client.0.smithi042.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-10T09:56:47.703 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:47.704 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:47.704 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:47.724 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:47.729 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:47.729 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:47.731 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:47.731+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:47.751 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:47.751 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:47.770 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:47.770 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:47.790 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:47.790 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:47.812 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:47.813 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:47.831 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:47.826+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:47.834 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:47.834 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:47.853 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:47.853 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:47.856 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:47.856 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:47.862 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:47.862 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:47.870 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:47.932 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:47.931+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:48.026 INFO:tasks.workunit.client.0.smithi042.stdout:user 0.871429276493476 deleted 2024-05-10T09:56:48.033 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:48.030+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:48.033 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:48.033 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:48.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:48.134 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:48.135+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:48.203 INFO:tasks.workunit.client.0.smithi042.stdout:Bucket Created: buck_2024_04_10_09_56_48 2024-05-10T09:56:48.203 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 1 2024-05-10T09:56:48.212 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:48.212 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:48.212 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:48.213 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:48.213 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00841307 s, 1.2 GB/s 2024-05-10T09:56:48.225 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:48.234 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:48.235+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:48.314 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.1 2024-05-10T09:56:48.314 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:48.314 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 2 2024-05-10T09:56:48.324 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:48.324 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:48.324 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00817715 s, 1.3 GB/s 2024-05-10T09:56:48.335 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:48.334+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:48.344 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:48.344 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:48.357 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:48.443 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:48.442+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:48.449 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.2 2024-05-10T09:56:48.449 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:48.449 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 3 2024-05-10T09:56:48.462 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:48.462 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:48.462 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.01046 s, 1.0 GB/s 2024-05-10T09:56:48.497 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:56:48.528 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:48.529 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:48.537 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:48.534+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:48.545 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:48.574 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.3 2024-05-10T09:56:48.574 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:48.574 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 4 2024-05-10T09:56:48.584 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:48.584 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:48.584 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00824904 s, 1.3 GB/s 2024-05-10T09:56:48.637 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:48.634+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:48.678 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.4 2024-05-10T09:56:48.678 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:48.678 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 5 2024-05-10T09:56:48.688 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:48.688 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:48.688 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00818789 s, 1.3 GB/s 2024-05-10T09:56:48.700 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:48.700 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:48.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:48.739 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:48.739+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:48.773 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.5 2024-05-10T09:56:48.773 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:48.773 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 6 2024-05-10T09:56:48.784 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:48.784 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:48.784 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00956598 s, 1.1 GB/s 2024-05-10T09:56:48.840 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:48.839+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:48.885 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:48.886 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:48.891 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.6 2024-05-10T09:56:48.891 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:48.891 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 7 2024-05-10T09:56:48.900 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:48.905 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:48.905 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:48.905 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110184 s, 952 MB/s 2024-05-10T09:56:48.947 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:48.946+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:49.008 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.7 2024-05-10T09:56:49.008 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:49.008 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 8 2024-05-10T09:56:49.022 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:49.022 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:49.022 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113026 s, 928 MB/s 2024-05-10T09:56:49.035 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:49.035 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:49.042 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:49.043+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:49.050 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:49.117 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.8 2024-05-10T09:56:49.117 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:49.117 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 9 2024-05-10T09:56:49.131 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:49.131 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:49.131 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115011 s, 912 MB/s 2024-05-10T09:56:49.143 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:49.138+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:49.183 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:49.184 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:49.198 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:49.244 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:49.242+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:49.261 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.9 2024-05-10T09:56:49.261 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:49.261 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 10 2024-05-10T09:56:49.275 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:49.276 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:49.276 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0117404 s, 893 MB/s 2024-05-10T09:56:49.322 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:49.323 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:49.336 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:49.344 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:49.342+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:49.409 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.10 2024-05-10T09:56:49.410 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:49.410 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 11 2024-05-10T09:56:49.424 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:49.424 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:49.424 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120637 s, 869 MB/s 2024-05-10T09:56:49.445 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:49.442+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:49.457 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:49.457 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:49.473 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:49.480 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:56:49.545 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:49.547+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:49.602 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.11 2024-05-10T09:56:49.602 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:49.602 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 12 2024-05-10T09:56:49.603 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:49.603 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:49.617 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:49.617 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:49.617 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122267 s, 858 MB/s 2024-05-10T09:56:49.618 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:49.646 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:49.642+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:49.746 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:49.742+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:49.757 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.12 2024-05-10T09:56:49.757 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:49.757 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 13 2024-05-10T09:56:49.772 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:49.772 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:49.772 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123049 s, 852 MB/s 2024-05-10T09:56:49.790 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:49.790 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:49.804 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:49.849 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:49.851+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:49.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:49.897 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.13 2024-05-10T09:56:49.897 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:49.897 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 14 2024-05-10T09:56:49.908 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:49.909 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:49.909 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00959501 s, 1.1 GB/s 2024-05-10T09:56:49.930 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:49.931 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:49.945 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:49.989 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:49.991+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:50.024 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.14 2024-05-10T09:56:50.024 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:50.024 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 15 2024-05-10T09:56:50.028 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:50.028 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:50.034 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:50.034 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:50.035 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00890844 s, 1.2 GB/s 2024-05-10T09:56:50.048 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:50.047+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:50.058 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:50.058 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:50.091 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:50.091 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:50.111 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:50.111 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:50.112 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:50.113 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:50.113 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:50.128 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:50.133 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:50.134 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:50.136 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.15 2024-05-10T09:56:50.136 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:50.137 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 16 2024-05-10T09:56:50.147 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:50.147 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:50.147 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00878008 s, 1.2 GB/s 2024-05-10T09:56:50.154 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:50.154 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:50.174 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:50.175+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:50.176 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:50.176 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:50.180 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:50.180 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:50.236 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.16 2024-05-10T09:56:50.237 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:50.237 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 17 2024-05-10T09:56:50.247 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:50.247 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:50.247 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00884922 s, 1.2 GB/s 2024-05-10T09:56:50.249 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:50.246+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:50.296 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:50.297 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:56:50.297 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:56:50.297 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:56:50.297 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:50.311 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:50.350 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:50.346+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:50.358 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.17 2024-05-10T09:56:50.358 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:50.358 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 18 2024-05-10T09:56:50.373 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:50.374 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:50.374 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127368 s, 823 MB/s 2024-05-10T09:56:50.442 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:56:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:56:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:56:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:56:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:50.442 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 142.90280149700001, 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.443 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:56:50.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:56:50.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:56:50.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:56:50.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 141.979200792, 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016000197000000001, 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.449 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 47 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460055+0000", 2024-05-10T09:56:50.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460056+0000", 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0299999999999998e-07 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460204+0000", 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014830900000000001 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460218+0000", 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3504e-05 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460227+0000", 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7000000000000003e-06 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.471947+0000", 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011719462999999999 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472080+0000", 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000133449 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.472317+0000", 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023705800000000001 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.474852+0000", 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00253492 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475882+0000", 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010294220000000001 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475977+0000", 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5451999999999993e-05 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476055+0000", 2024-05-10T09:56:50.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8116999999999998e-05 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 141.97900795000001, 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017413642, 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.455 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 48 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460248+0000", 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460249+0000", 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9999999999999996e-07 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460255+0000", 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9669999999999998e-06 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460268+0000", 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3135999999999999e-05 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460276+0000", 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8269999999999998e-06 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473503+0000", 2024-05-10T09:56:50.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013227001 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473725+0000", 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022255199999999999 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.473931+0000", 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020570500000000001 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477493+0000", 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035621419999999999 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477522+0000", 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9045999999999999e-05 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477598+0000", 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5483999999999998e-05 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.460 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477662+0000", 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3881999999999996e-05 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 141.97896778, 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018574650000000002, 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.461 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 49 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460288+0000", 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460289+0000", 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5000000000000002e-07 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460295+0000", 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4160000000000001e-06 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460305+0000", 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3170000000000008e-06 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460316+0000", 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0995999999999999e-05 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475015+0000", 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014698914 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475154+0000", 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013971200000000001 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.475357+0000", 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000202692 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477763+0000", 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0024059139999999999 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478722+0000", 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00095886599999999995 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478803+0000", 2024-05-10T09:56:50.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1532999999999993e-05 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478863+0000", 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9540000000000003e-05 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 141.97888255399999, 2024-05-10T09:56:50.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019642788000000001, 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 50 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460373+0000", 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460374+0000", 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.5300000000000003e-07 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460521+0000", 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147002 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460537+0000", 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.613e-05 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460548+0000", 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0297e-05 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476147+0000", 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015599646 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476313+0000", 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000165525 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.476530+0000", 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021686899999999999 2024-05-10T09:56:50.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479846+0000", 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033157999999999998 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479874+0000", 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8744000000000001e-05 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479953+0000", 2024-05-10T09:56:50.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9048999999999995e-05 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480016+0000", 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.2873000000000006e-05 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:50.473 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 141.97869029899999, 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019707664, 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 51 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460566+0000", 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460567+0000", 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9600000000000008e-07 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460573+0000", 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6239999999999996e-06 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460583+0000", 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7200000000000001e-06 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460591+0000", 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5730000000000002e-06 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477847+0000", 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017256157000000001 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.477989+0000", 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000142299 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478215+0000", 2024-05-10T09:56:50.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022629099999999999 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480040+0000", 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001824726 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480105+0000", 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.4893000000000004e-05 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480200+0000", 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4843e-05 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480273+0000", 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3541999999999995e-05 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.479 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 141.97865398600001, 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:56:50.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1273 3.2d 3:b59bb266:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.734294+0000", 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.704962349999999, 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018979024000000001, 2024-05-10T09:56:50.485 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1273 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.734294+0000", 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.734294+0000", 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.734297+0000", 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1099999999999999e-06 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.738504+0000", 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042070830000000004 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.738542+0000", 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8145999999999997e-05 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.738562+0000", 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9663000000000001e-05 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.738755+0000", 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019335500000000001 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.739010+0000", 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025481400000000002 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.739228+0000", 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021771099999999999 2024-05-10T09:56:50.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.746393+0000", 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071658950000000003 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.753117+0000", 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0067233919999999999 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.753204+0000", 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7012e-05 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.753273+0000", 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8843000000000005e-05 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1277 3.2d 3:b6aa08bb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:50.491 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.662806033999999, 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020498677, 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1277 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:56:50.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776453+0000", 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.61e-06 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780453+0000", 2024-05-10T09:56:50.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040001919999999996 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780490+0000", 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6887000000000001e-05 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780514+0000", 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4206000000000002e-05 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780721+0000", 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020692799999999999 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780986+0000", 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026536099999999998 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.781220+0000", 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023365699999999999 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.495 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790889+0000", 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0096689380000000002 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796601+0000", 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005712778 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796764+0000", 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162922 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.496 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796949+0000", 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184198 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1278 3.2f e69/23 3:f571631c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_6:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.791901+0000", 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.647355345000001, 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017808445999999999, 2024-05-10T09:56:50.497 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791901+0000", 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791901+0000", 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791901+0000", 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.9999999999999997e-07 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796207+0000", 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043062020000000003 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796246+0000", 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8290000000000001e-05 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796265+0000", 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9346000000000001e-05 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796449+0000", 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184062 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796513+0000", 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3546000000000004e-05 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.809608+0000", 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013095018 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.809709+0000", 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000101382 2024-05-10T09:56:50.501 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1283 3.37 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.599564752999999, 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.027466540000000001, 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.502 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1283 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.503 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839695+0000", 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7330000000000001e-06 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843941+0000", 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042461169999999998 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843982+0000", 2024-05-10T09:56:50.504 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1083e-05 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844002+0000", 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9525999999999999e-05 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844137+0000", 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013504500000000001 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.505 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844411+0000", 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027433399999999999 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844789+0000", 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037824700000000001 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.859343+0000", 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014554197 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.506 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866992+0000", 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076486699999999998 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867082+0000", 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0229000000000006e-05 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867158+0000", 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5358999999999995e-05 2024-05-10T09:56:50.507 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1396 3.3b 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.079197511, 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026528719999999999, 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.508 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1396 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.509 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360061+0000", 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364016+0000", 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039552420000000003 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.510 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364051+0000", 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4603000000000001e-05 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364069+0000", 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7737e-05 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364204+0000", 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135048 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.511 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364468+0000", 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000264505 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364705+0000", 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000237004 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.375226+0000", 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010521076000000001 2024-05-10T09:56:50.512 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386408+0000", 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011182133 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386511+0000", 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103226 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386587+0000", 2024-05-10T09:56:50.513 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5685999999999993e-05 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1401 3.11 3:8bf50c8e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.415819+0000", 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.023436706, 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015651326, 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.514 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1401 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.415819+0000", 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.415819+0000", 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.515 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.415822+0000", 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1030000000000002e-06 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420057+0000", 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042343099999999998 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420101+0000", 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4672000000000002e-05 2024-05-10T09:56:50.516 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420130+0000", 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8444000000000001e-05 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420305+0000", 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017559800000000001 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.420581+0000", 2024-05-10T09:56:50.517 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000275147 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431221+0000", 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010640004999999999 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431315+0000", 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.4899000000000001e-05 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.518 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431471+0000", 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000155148 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1402 3.2d 3:b5eccbcc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.426632+0000", 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.012624005999999, 2024-05-10T09:56:50.519 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017052339999999999, 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1402 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.426632+0000", 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.520 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.426632+0000", 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.426634+0000", 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3099999999999999e-06 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.430780+0000", 2024-05-10T09:56:50.521 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041461069999999996 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.430812+0000", 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1269000000000002e-05 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.430835+0000", 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3343e-05 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.522 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.430982+0000", 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014662900000000001 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431263+0000", 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028100999999999999 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.431523+0000", 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026044799999999998 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.523 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.442969+0000", 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011445705 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.443511+0000", 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054230800000000003 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.443604+0000", 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2765999999999999e-05 2024-05-10T09:56:50.524 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.443684+0000", 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0445000000000007e-05 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1421 3.e 3:73b264db:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.8:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.711591+0000", 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.727665064, 2024-05-10T09:56:50.525 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017678085999999999, 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1421 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.526 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.711591+0000", 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.711591+0000", 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.711594+0000", 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7240000000000001e-06 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.527 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.715720+0000", 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041267370000000001 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.715758+0000", 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7589999999999998e-05 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.715781+0000", 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2687000000000001e-05 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.528 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.715930+0000", 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149118 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.716202+0000", 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000272451 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.728977+0000", 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012775092 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.529 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.729114+0000", 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013655500000000001 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.729269+0000", 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015513199999999999 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.530 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1429 3.16 e71/23 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head v 71'2, mlcod=0'0)", 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.342361102, 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023672451000000001, 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096897+0000", 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.537e-06 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101828+0000", 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049309260000000004 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101999+0000", 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170528 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102086+0000", 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7626000000000004e-05 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102334+0000", 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024782500000000002 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102407+0000", 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2595000000000005e-05 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120420+0000", 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018012986000000002 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120567+0000", 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014742800000000001 2024-05-10T09:56:50.534 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1430 3.3f 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.337774145999999, 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024797998000000002, 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.535 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1430 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101486+0000", 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.704e-06 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107182+0000", 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056960689999999998 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107222+0000", 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0469999999999997e-05 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107242+0000", 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9606000000000002e-05 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107368+0000", 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126375 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107635+0000", 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026656199999999997 2024-05-10T09:56:50.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107848+0000", 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000213348 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.124755+0000", 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016906694 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126120+0000", 2024-05-10T09:56:50.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001365078 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126213+0000", 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3392000000000003e-05 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126280+0000", 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6699999999999995e-05 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.540 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1435 3.3b 3:dd2501f8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.174319+0000", 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.264936690000001, 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017237722, 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1435 2024-05-10T09:56:50.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.174319+0000", 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.174319+0000", 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.174324+0000", 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8040000000000001e-06 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177967+0000", 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036430350000000002 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178007+0000", 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9672000000000002e-05 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178059+0000", 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2227e-05 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178208+0000", 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014925800000000001 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178458+0000", 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024967799999999998 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.178697+0000", 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000238984 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.189067+0000", 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010370155000000001 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.191260+0000", 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021925719999999998 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.191435+0000", 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000175658 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.191557+0000", 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121679 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1456 3.12 e72/23 3:49fd254a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_5:head v 72'2, mlcod=0'0)", 2024-05-10T09:56:50.546 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.769493+0000", 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 12.669762947000001, 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019609181999999999, 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.769493+0000", 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.769493+0000", 2024-05-10T09:56:50.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.769494+0000", 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9699999999999996e-07 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.774788+0000", 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052944760000000002 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.774828+0000", 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9629000000000003e-05 2024-05-10T09:56:50.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.774856+0000", 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8013000000000001e-05 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.775038+0000", 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018195799999999999 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.775103+0000", 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5686999999999996e-05 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.788987+0000", 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013883917000000001 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.789102+0000", 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115005 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.550 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1878 3.12 e76/23 3:498399a7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.IorLTFkUppimHUwkeqi1iN_ZoWplKhv_1:head v 76'4, mlcod=72'2)", 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.206087+0000", 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.23316894099999999, 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017708484, 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.206087+0000", 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.206087+0000", 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.206089+0000", 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1710000000000001e-06 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.210962+0000", 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004872604 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:56:50.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.210991+0000", 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9434e-05 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.211004+0000", 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2374999999999999e-05 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.211099+0000", 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5573000000000001e-05 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:56:50.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.211123+0000", 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3836999999999999e-05 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.223746+0000", 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012623406 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.223796+0000", 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9084e-05 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.554 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:56:50.555 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:56:50.555 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:56:50.556 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.18 2024-05-10T09:56:50.556 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:50.556 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 19 2024-05-10T09:56:50.556 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:50.556 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:50.556 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127326 s, 824 MB/s 2024-05-10T09:56:50.557 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:50.554+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:50.557 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:50.632 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.19 2024-05-10T09:56:50.632 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:50.633 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 20 2024-05-10T09:56:50.643 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:50.643 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:50.643 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00885563 s, 1.2 GB/s 2024-05-10T09:56:50.657 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:50.654+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:50.703 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:50.704 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:50.704 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:50.704 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:50.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:50.753 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.20 2024-05-10T09:56:50.753 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:50.753 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 21 2024-05-10T09:56:50.757 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:50.759+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:50.768 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:50.768 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:50.768 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120396 s, 871 MB/s 2024-05-10T09:56:50.858 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:50.854+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:50.895 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.21 2024-05-10T09:56:50.895 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:50.895 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 22 2024-05-10T09:56:50.909 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:50.909 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:50.909 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115131 s, 911 MB/s 2024-05-10T09:56:50.912 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:50.912 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:50.913 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:50.913 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:50.913 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:50.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:50.959 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:50.959+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:51.010 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.22 2024-05-10T09:56:51.010 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.010 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 23 2024-05-10T09:56:51.022 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.022 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.022 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00979708 s, 1.1 GB/s 2024-05-10T09:56:51.059 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:51.058+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1276 3.23 3:c6394aa1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.763756+0000", 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.343783220999999, 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012837995, 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.110 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1276 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763756+0000", 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763756+0000", 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763758+0000", 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5579999999999999e-06 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.765997+0000", 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022385159999999999 2024-05-10T09:56:51.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766030+0000", 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2573000000000001e-05 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766044+0000", 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4834999999999999e-05 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766122+0000", 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7873000000000005e-05 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766309+0000", 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018692200000000001 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.766439+0000", 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012998900000000001 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.773516+0000", 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007076972 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776490+0000", 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029743479999999999 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776554+0000", 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3736000000000001e-05 2024-05-10T09:56:51.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.776594+0000", 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9672999999999998e-05 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1291 3.1b 3:d8e30cbd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.181953976999999, 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020403290000000001, 2024-05-10T09:56:51.116 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1291 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925588+0000", 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.818e-06 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927537+0000", 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001949442 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927563+0000", 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5677000000000002e-05 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927577+0000", 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3623e-05 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927670+0000", 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3244000000000004e-05 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927880+0000", 2024-05-10T09:56:51.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000209662 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.928062+0000", 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018209899999999999 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.933967+0000", 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0059051989999999999 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945905+0000", 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011938318 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945952+0000", 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6644999999999998e-05 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945988+0000", 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6563000000000002e-05 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.122 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1301 3.23 3:c760cb7d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.710735966000001, 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014075771000000001, 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1301 2024-05-10T09:56:51.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396806+0000", 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2040000000000002e-06 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398853+0000", 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020470060000000001 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398904+0000", 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1011999999999999e-05 2024-05-10T09:56:51.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398935+0000", 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0454e-05 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399051+0000", 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011635 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399241+0000", 2024-05-10T09:56:51.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018986200000000001 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399420+0000", 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017852300000000001 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410164+0000", 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010744258 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410747+0000", 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058339799999999995 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410818+0000", 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1218999999999997e-05 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410879+0000", 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0485000000000001e-05 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.128 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1303 3.6 3:6092e388:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.685702674000002, 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019484492999999999, 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.129 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1303 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421841+0000", 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5340000000000001e-06 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424916+0000", 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030753439999999998 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424945+0000", 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8399999999999999e-05 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424957+0000", 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2211e-05 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425038+0000", 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0659000000000001e-05 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425218+0000", 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018066499999999999 2024-05-10T09:56:51.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425377+0000", 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015881599999999999 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.431067+0000", 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056899419999999999 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441200+0000", 2024-05-10T09:56:51.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010132755 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441255+0000", 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4864999999999997e-05 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441321+0000", 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6302000000000003e-05 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1308 3.6 3:62f870a7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.481673+0000", 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.625865853000001, 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012935558999999999, 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1308 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.135 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.481673+0000", 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.481673+0000", 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.481676+0000", 2024-05-10T09:56:51.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8100000000000002e-06 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484488+0000", 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028119590000000002 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484531+0000", 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3242999999999999e-05 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484552+0000", 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0761999999999999e-05 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484626+0000", 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4395999999999997e-05 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484739+0000", 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011300500000000001 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.484851+0000", 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000111626 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.493980+0000", 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0091291900000000006 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.494473+0000", 2024-05-10T09:56:51.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049296300000000002 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.494541+0000", 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7705000000000003e-05 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.494609+0000", 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7899999999999997e-05 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1312 3.17 3:ebbfdea4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.580260243000001, 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015421182, 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1312 2024-05-10T09:56:51.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527282+0000", 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.366e-06 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528783+0000", 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001500978 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528815+0000", 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1828000000000001e-05 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528829+0000", 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4041e-05 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528931+0000", 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010204600000000001 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.529101+0000", 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016975900000000001 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.529305+0000", 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000203919 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.534340+0000", 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0050356369999999999 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542583+0000", 2024-05-10T09:56:51.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082426240000000005 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542646+0000", 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3357999999999999e-05 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542700+0000", 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3625999999999998e-05 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.146 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1414 3.23 3:c5cb197a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.518248108, 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014761384000000001, 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.147 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1414 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589295+0000", 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6239999999999999e-06 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591498+0000", 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022029509999999999 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591522+0000", 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4368000000000001e-05 2024-05-10T09:56:51.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591535+0000", 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2652e-05 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591619+0000", 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4571000000000001e-05 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591860+0000", 2024-05-10T09:56:51.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024051199999999999 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.592070+0000", 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021078000000000001 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.600032+0000", 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007961437 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.603921+0000", 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0038889419999999998 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.603996+0000", 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5352999999999995e-05 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.604052+0000", 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6193999999999998e-05 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.152 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1425 3.3a e71/23 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head v 71'5, mlcod=71'3)", 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.052287154, 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019775094, 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:51.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055255+0000", 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6129999999999998e-06 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066229+0000", 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010974634 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066267+0000", 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7953000000000001e-05 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066283+0000", 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5993000000000001e-05 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066373+0000", 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9370999999999995e-05 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066391+0000", 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8797999999999999e-05 2024-05-10T09:56:51.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074966+0000", 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0085746869999999992 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.075027+0000", 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1044999999999996e-05 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1428 3.32 3:4e529b56:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.028865954, 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016023631999999999, 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1428 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078678+0000", 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6299999999999997e-06 2024-05-10T09:56:51.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084738+0000", 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060599540000000002 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084791+0000", 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3476000000000001e-05 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084846+0000", 2024-05-10T09:56:51.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5136000000000002e-05 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084961+0000", 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114948 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.085137+0000", 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017568299999999999 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:51.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.085325+0000", 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018774899999999999 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094095+0000", 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087703 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094572+0000", 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047742699999999999 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094641+0000", 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8231000000000005e-05 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094697+0000", 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6097999999999997e-05 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.163 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1432 3.6 3:63c25752:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.97907535, 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015410627, 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1432 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128466+0000", 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6000000000000001e-06 2024-05-10T09:56:51.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130918+0000", 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0024514509999999999 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130959+0000", 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1465999999999999e-05 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130984+0000", 2024-05-10T09:56:51.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5170000000000001e-05 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131078+0000", 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3546000000000002e-05 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131189+0000", 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000111019 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:51.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131293+0000", 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103532 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.137135+0000", 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058429440000000001 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143641+0000", 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065052260000000002 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143783+0000", 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014180599999999999 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143874+0000", 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1867000000000007e-05 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.169 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1440 3.1f 3:f8aeb630:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.864067048000001, 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020526757, 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1440 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.170 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243475+0000", 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9830000000000001e-06 2024-05-10T09:56:51.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245852+0000", 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023767039999999999 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245878+0000", 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5867000000000002e-05 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245889+0000", 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1226999999999999e-05 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245960+0000", 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0693999999999998e-05 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.246103+0000", 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014311400000000001 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.246193+0000", 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0216000000000005e-05 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.250671+0000", 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0044783089999999998 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263735+0000", 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013064045999999999 2024-05-10T09:56:51.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263891+0000", 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015604099999999999 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263999+0000", 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000107556 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1449 3.1b 3:d8b9774b:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.757394626, 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017268909999999998, 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1449 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.176 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350146+0000", 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2160000000000001e-06 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352148+0000", 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020024819999999999 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352170+0000", 2024-05-10T09:56:51.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.16e-05 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352179+0000", 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3470000000000005e-06 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352334+0000", 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015537799999999999 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352777+0000", 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044212500000000003 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367306+0000", 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014529243000000001 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367355+0000", 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8834e-05 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367413+0000", 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8684999999999998e-05 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1456 3.12 3:49fd254a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.345065805999999, 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.026305321999999999, 2024-05-10T09:56:51.181 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1456 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762477+0000", 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3569999999999998e-06 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766831+0000", 2024-05-10T09:56:51.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0043540540000000004 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766872+0000", 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1669999999999999e-05 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766897+0000", 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767040+0000", 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014221899999999999 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767300+0000", 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026063300000000002 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767574+0000", 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027399 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788426+0000", 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020851634000000001 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788542+0000", 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116322 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788676+0000", 2024-05-10T09:56:51.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013342200000000001 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788779+0000", 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103012 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1457 3.12 3:48cf3986:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.334489080000001, 2024-05-10T09:56:51.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018620484999999999, 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1457 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773053+0000", 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0630000000000002e-06 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776037+0000", 2024-05-10T09:56:51.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029840909999999999 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776070+0000", 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2966000000000003e-05 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776090+0000", 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9652000000000001e-05 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.778860+0000", 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027701610000000002 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.779152+0000", 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029241599999999999 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.779439+0000", 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028643000000000001 2024-05-10T09:56:51.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.789444+0000", 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010004822999999999 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791535+0000", 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020911950000000001 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791613+0000", 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7945e-05 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791671+0000", 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7742999999999999e-05 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1466 3.23 3:c6625ef2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:51.193 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.13186988, 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017247114000000001, 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1466 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975673+0000", 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8260000000000003e-06 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978412+0000", 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027384610000000002 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978458+0000", 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6771999999999999e-05 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978487+0000", 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8597000000000001e-05 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978660+0000", 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017359400000000001 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978964+0000", 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030344999999999998 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.979245+0000", 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028105300000000002 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.986720+0000", 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007474596 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992704+0000", 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.005984708 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992816+0000", 2024-05-10T09:56:51.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112025 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992916+0000", 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010003199999999999 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1471 3.30 e72/23 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head v 72'5, mlcod=71'3)", 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.012247630999999, 2024-05-10T09:56:51.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01989001, 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095294+0000", 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.847e-06 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100863+0000", 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055683529999999998 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100908+0000", 2024-05-10T09:56:51.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5663e-05 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100936+0000", 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7535999999999999e-05 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.101115+0000", 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179548 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.101182+0000", 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6262999999999999e-05 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.115085+0000", 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013903067999999999 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.115181+0000", 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6731999999999995e-05 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.203 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1872 3.2b 3:d72b79dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_._kyUpRWiSfEdsJW4YJl14_dAfxMYkn-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.100762+0000", 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.0067772690000001, 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.024701033000000001, 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.204 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1872 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.100762+0000", 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.100762+0000", 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.205 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.100764+0000", 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6400000000000001e-06 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.102762+0000", 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001997291 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.102791+0000", 2024-05-10T09:56:51.206 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9578e-05 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.102803+0000", 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1841000000000001e-05 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.102890+0000", 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7262000000000006e-05 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.103077+0000", 2024-05-10T09:56:51.207 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018621999999999999 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.103249+0000", 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017271699999999999 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.108571+0000", 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053216189999999997 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.208 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.125329+0000", 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016757575 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.125404+0000", 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5028000000000001e-05 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.125463+0000", 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9262000000000003e-05 2024-05-10T09:56:51.209 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1878 3.12 3:498399a7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.IorLTFkUppimHUwkeqi1iN_ZoWplKhv_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.202545+0000", 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.904994454, 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019856743, 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.210 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1878 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.202545+0000", 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.202545+0000", 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.211 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.202547+0000", 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4090000000000001e-06 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.203866+0000", 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001319167 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.203895+0000", 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.836e-05 2024-05-10T09:56:51.212 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.203906+0000", 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1083e-05 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.203987+0000", 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1749999999999995e-05 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.204108+0000", 2024-05-10T09:56:51.213 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120989 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.204213+0000", 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104512 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.208508+0000", 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042946310000000001 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.214 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.222328+0000", 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013820412000000001 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.222372+0000", 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4464e-05 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.222401+0000", 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8966e-05 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.215 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1908 3.20 e76/23 3:07202f49:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.mvxZi7wWQp_ksYLH8UPXA9st4FR8xsC_1:head v 76'4, mlcod=71'2)", 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.851464+0000", 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.25607522599999999, 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013514132, 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.851464+0000", 2024-05-10T09:56:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.851464+0000", 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.851465+0000", 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.257e-06 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.857230+0000", 2024-05-10T09:56:51.217 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0057652700000000003 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.857252+0000", 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1953000000000001e-05 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.857268+0000", 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5489999999999999e-05 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.218 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.857343+0000", 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5409999999999998e-05 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.857373+0000", 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9937000000000002e-05 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.864912+0000", 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0075389039999999999 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.219 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.864978+0000", 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5911e-05 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1911 3.12 3:487aa37e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.21:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.869427+0000", 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.23811236499999999, 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.024950852999999999, 2024-05-10T09:56:51.220 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1911 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.869427+0000", 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.221 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.869427+0000", 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.869429+0000", 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3750000000000001e-06 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.222 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.871429+0000", 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020001649999999999 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.871463+0000", 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3834000000000002e-05 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.871481+0000", 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.223 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.871637+0000", 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015618000000000001 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.872066+0000", 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042970699999999998 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.873264+0000", 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011980389999999999 2024-05-10T09:56:51.224 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.886943+0000", 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013678218000000001 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.894255+0000", 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0073126720000000001 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.894328+0000", 2024-05-10T09:56:51.225 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3100000000000001e-05 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.894378+0000", 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.914e-05 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.226 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:51.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:51.228 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.23 2024-05-10T09:56:51.228 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.228 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 24 2024-05-10T09:56:51.229 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.229 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.229 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011979 s, 875 MB/s 2024-05-10T09:56:51.229 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:51.226+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:51.269 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.24 2024-05-10T09:56:51.270 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.270 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 25 2024-05-10T09:56:51.284 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.285 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.285 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123637 s, 848 MB/s 2024-05-10T09:56:51.328 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:51.327+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:51.400 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.25 2024-05-10T09:56:51.400 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.400 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 26 2024-05-10T09:56:51.411 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:51.411 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:51.411 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:51.412 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:51.414 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.414 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.414 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115004 s, 912 MB/s 2024-05-10T09:56:51.427 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:51.471 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:51.470+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:51.521 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:56:51.528 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.26 2024-05-10T09:56:51.528 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.528 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 27 2024-05-10T09:56:51.529 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:51.527+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:51.539 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.539 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.539 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00916267 s, 1.1 GB/s 2024-05-10T09:56:51.616 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:51.617 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:51.617 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:51.617 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:51.617 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:51.629 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:51.626+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:51.633 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:51.649 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.27 2024-05-10T09:56:51.649 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.649 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 28 2024-05-10T09:56:51.661 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.661 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.661 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00984751 s, 1.1 GB/s 2024-05-10T09:56:51.730 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:51.726+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:51.754 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.28 2024-05-10T09:56:51.755 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.755 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 29 2024-05-10T09:56:51.765 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.765 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.765 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00877519 s, 1.2 GB/s 2024-05-10T09:56:51.778 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:51.778 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:51.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:51.778 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:51.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.778 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 128.12957004099999, 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.779 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:51.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:51.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1274 3.8 e69/23 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.031041961, 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015717301999999999, 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745751+0000", 2024-05-10T09:56:51.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8789999999999999e-06 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748049+0000", 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022981820000000002 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748076+0000", 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6361999999999999e-05 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748093+0000", 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7329e-05 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748193+0000", 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9562000000000007e-05 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748228+0000", 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4962999999999997e-05 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761399+0000", 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013171173 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761467+0000", 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7852e-05 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.788 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1275 3.4 3:20482490:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.024335106999999, 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011423600000000001, 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1275 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752458+0000", 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7039999999999999e-06 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754116+0000", 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016577129999999999 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754147+0000", 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1782999999999997e-05 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754161+0000", 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3715e-05 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754265+0000", 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103349 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754448+0000", 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018395900000000001 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754563+0000", 2024-05-10T09:56:51.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114115 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763241+0000", 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086780859999999998 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763738+0000", 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049755700000000003 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763816+0000", 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7987999999999999e-05 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763880+0000", 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3631000000000001e-05 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1286 3.25 3:a4ea653e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:51.794 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.90481303, 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010955397, 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1286 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871981+0000", 2024-05-10T09:56:51.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7410000000000001e-06 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874251+0000", 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022695770000000001 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874271+0000", 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9870000000000001e-05 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874280+0000", 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2779999999999999e-06 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874348+0000", 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8518999999999999e-05 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874512+0000", 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016358200000000001 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874616+0000", 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103924 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.879896+0000", 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052805279999999996 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882804+0000", 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029073749999999998 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882877+0000", 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2788999999999997e-05 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882934+0000", 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7213999999999998e-05 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1288 3.1a e69/23 3:5902eff1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_16:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:51.802 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.876591414, 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013345268, 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.803 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900205+0000", 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1390000000000003e-06 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906219+0000", 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060138969999999998 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906247+0000", 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7881999999999998e-05 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906259+0000", 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2334000000000001e-05 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906321+0000", 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2045999999999995e-05 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906353+0000", 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622000000000003e-05 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913476+0000", 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071233490000000002 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913545+0000", 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8998999999999994e-05 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.806 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1303 3.6 e69/23 3:6092e388:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_3:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.351245849000001, 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015397114999999999, 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425547+0000", 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5889999999999999e-06 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428542+0000", 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029953570000000001 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428568+0000", 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5621000000000001e-05 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428582+0000", 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3560999999999999e-05 2024-05-10T09:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428719+0000", 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013757600000000001 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428764+0000", 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4425999999999998e-05 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.440889+0000", 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012125095000000001 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.440943+0000", 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3890000000000001e-05 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1403 3.25 3:a72e587a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:51.811 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.339412696, 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017687321999999998, 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1403 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:51.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437382+0000", 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2140000000000001e-06 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440350+0000", 2024-05-10T09:56:51.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029685520000000002 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440386+0000", 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5781999999999997e-05 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440404+0000", 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7859e-05 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440495+0000", 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0847000000000006e-05 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440670+0000", 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017521099999999999 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440835+0000", 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000165098 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.815 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.450501+0000", 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0096655430000000004 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.454890+0000", 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0043887639999999999 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.454983+0000", 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3664000000000003e-05 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.455066+0000", 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2787999999999994e-05 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1426 3.25 3:a4c8f94a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.719314424, 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017387981, 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.817 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1426 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057479+0000", 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4040000000000002e-06 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059118+0000", 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001638376 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059148+0000", 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0670000000000003e-05 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059164+0000", 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5916000000000001e-05 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059242+0000", 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8102000000000005e-05 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059368+0000", 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012511799999999999 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059479+0000", 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000111535 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.063977+0000", 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0044975090000000002 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074740+0000", 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010763503000000001 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074815+0000", 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4590000000000002e-05 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074865+0000", 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0257999999999999e-05 2024-05-10T09:56:51.822 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1427 3.31 3:8c9c1f42:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.708373168, 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018352572000000001, 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.823 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1427 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068421+0000", 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7590000000000002e-06 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071398+0000", 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002976762 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071421+0000", 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2949e-05 2024-05-10T09:56:51.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071432+0000", 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1265e-05 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071590+0000", 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015817300000000001 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.072017+0000", 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042705199999999998 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086604+0000", 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01458713 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086676+0000", 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1692000000000004e-05 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086771+0000", 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4790000000000006e-05 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1432 3.6 e71/23 3:63c25752:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_9:head v 71'6, mlcod=71'4)", 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.645379287000001, 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011963349, 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.828 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131414+0000", 2024-05-10T09:56:51.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6959999999999999e-06 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133867+0000", 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0024533469999999998 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133893+0000", 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5511e-05 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133905+0000", 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2758999999999999e-05 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.134012+0000", 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106496 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.134048+0000", 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6505999999999999e-05 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143310+0000", 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092617510000000004 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143375+0000", 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5283000000000005e-05 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.832 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1445 3.0 3:0255dc8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.45806709, 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011906963, 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1445 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.833 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318727+0000", 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9629999999999998e-06 2024-05-10T09:56:51.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320387+0000", 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016598749999999999 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320411+0000", 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3419999999999999e-05 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320421+0000", 2024-05-10T09:56:51.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320492+0000", 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1569999999999994e-05 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320644+0000", 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015139099999999999 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:51.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320805+0000", 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000161469 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.325790+0000", 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0049845879999999999 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330527+0000", 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047375519999999999 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330571+0000", 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3682e-05 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330631+0000", 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0359999999999998e-05 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.838 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1453 3.25 3:a7a3552c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.067299344, 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012007802, 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1453 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709495+0000", 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0290000000000001e-06 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.840 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710835+0000", 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001339556 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710865+0000", 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0808e-05 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710879+0000", 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4039999999999999e-05 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710961+0000", 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1358000000000003e-05 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.711086+0000", 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012547799999999999 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.711183+0000", 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6404999999999996e-05 2024-05-10T09:56:51.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.715963+0000", 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047807889999999997 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721253+0000", 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052894650000000001 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721400+0000", 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014675300000000001 2024-05-10T09:56:51.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721500+0000", 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000100121 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1455 3.21 e72/42 3:848162d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_4:head v 72'4, mlcod=69'2)", 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.037272160000001, 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011681792, 2024-05-10T09:56:51.844 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9400000000000001e-07 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741481+0000", 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019617089999999998 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741520+0000", 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8506e-05 2024-05-10T09:56:51.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741543+0000", 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3632999999999999e-05 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741691+0000", 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014779999999999999 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741744+0000", 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3359000000000002e-05 2024-05-10T09:56:51.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751059+0000", 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093147860000000002 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751201+0000", 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000141705 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1460 3.21 e72/42 3:86cfe81c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_9:head v 72'5, mlcod=71'3)", 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.939635046999999, 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012644017, 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837159+0000", 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5000000000000002e-06 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840513+0000", 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003354686 2024-05-10T09:56:51.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840551+0000", 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7956e-05 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840569+0000", 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7934000000000001e-05 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840727+0000", 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015768100000000001 2024-05-10T09:56:51.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840790+0000", 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3249000000000004e-05 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.849680+0000", 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088892490000000001 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.849800+0000", 2024-05-10T09:56:51.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012076199999999999 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1469 3.8 e72/23 3:108a86fb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_18:head v 72'5, mlcod=69'3)", 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.731591366, 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012011735000000001, 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.853 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045204+0000", 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6430000000000001e-06 2024-05-10T09:56:51.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048886+0000", 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003681915 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048927+0000", 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1566999999999997e-05 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048946+0000", 2024-05-10T09:56:51.855 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9076000000000002e-05 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.049107+0000", 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.049149+0000", 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2119000000000001e-05 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.856 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057149+0000", 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079999349999999997 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057212+0000", 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3058000000000005e-05 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1474 3.8 e72/23 3:1087178a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_23:head v 72'6, mlcod=69'4)", 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.606470479, 2024-05-10T09:56:51.857 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015885412000000002, 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.858 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170324+0000", 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175618+0000", 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052940560000000001 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175659+0000", 2024-05-10T09:56:51.859 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175677+0000", 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8519e-05 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175857+0000", 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018009800000000001 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175912+0000", 2024-05-10T09:56:51.860 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4373000000000003e-05 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186141+0000", 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010229591999999999 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186206+0000", 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5093999999999997e-05 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.861 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1891 3.19 3:9a43e86c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eLGRCzvAKn5Xe45EeKu1jRkfp7sri7Z_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.3123682379999999, 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011028723000000001, 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1891 2024-05-10T09:56:51.862 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.863 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464426+0000", 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.27e-06 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466548+0000", 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021214620000000002 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466591+0000", 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3452999999999999e-05 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.864 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466611+0000", 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9986000000000001e-05 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466751+0000", 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013972600000000001 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.467017+0000", 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026603400000000001 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.865 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.467259+0000", 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024156000000000001 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.474806+0000", 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0075472509999999996 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475355+0000", 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054962000000000001 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475408+0000", 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2281999999999999e-05 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475452+0000", 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4079000000000003e-05 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.867 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1916 3.19 3:9bc12e34:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.F65ETUPaF-FOL5UgmtNLtq7r2nquRij_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.80715272000000005, 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012330288999999999, 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1916 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.868 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969641+0000", 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5579999999999999e-06 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971277+0000", 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016355090000000001 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971319+0000", 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1842999999999999e-05 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971338+0000", 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9449999999999998e-05 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.870 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971440+0000", 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102027 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971611+0000", 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017066100000000001 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971786+0000", 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000174928 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.871 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981651+0000", 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.009865614 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981884+0000", 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023318899999999999 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981929+0000", 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4601000000000002e-05 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981969+0000", 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9909e-05 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1922 3.21 e76/42 3:84b5b706:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.PBl2-twCS8ooY6U8CbDbsMdnzO_2t6r_1:head v 76'8, mlcod=72'6)", 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.67673066500000001, 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01401399, 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.873 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100062+0000", 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.437e-06 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102533+0000", 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002470486 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102571+0000", 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8393000000000003e-05 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102588+0000", 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6592999999999999e-05 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102784+0000", 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019662099999999999 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102823+0000", 2024-05-10T09:56:51.876 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8509e-05 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.113950+0000", 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011127386 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114075+0000", 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012456500000000001 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.877 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1931 3.0 3:0050c674:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.52836611099999997, 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019806678000000001, 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1931 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:51.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248427+0000", 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2170000000000001e-06 2024-05-10T09:56:51.879 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250923+0000", 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002495588 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250957+0000", 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3994e-05 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250974+0000", 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6595999999999998e-05 2024-05-10T09:56:51.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.251151+0000", 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176995 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.251461+0000", 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031083 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.252422+0000", 2024-05-10T09:56:51.881 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00096011600000000001 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.266082+0000", 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013660603 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.267953+0000", 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018704290000000001 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:51.882 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.268108+0000", 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155394 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.268232+0000", 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012391600000000001 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:51.883 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:51.885 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:51.885 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.29 2024-05-10T09:56:51.885 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.885 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 30 2024-05-10T09:56:51.886 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:51.882+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:51.892 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.892 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.892 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011195 s, 937 MB/s 2024-05-10T09:56:51.984 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.30 2024-05-10T09:56:51.984 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:51.984 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 31 2024-05-10T09:56:51.986 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:51.987+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:51.998 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:51.998 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:51.998 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107115 s, 979 MB/s 2024-05-10T09:56:52.030 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:52.030 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:52.030 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:52.030 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:52.048 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:52.091 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:52.090+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:52.107 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.31 2024-05-10T09:56:52.107 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:52.108 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 32 2024-05-10T09:56:52.119 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:52.119 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:52.119 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0100965 s, 1.0 GB/s 2024-05-10T09:56:52.173 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:52.173 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:52.174 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:52.174 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:52.174 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:52.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:52.191 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:52.191 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:52.186+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:52.231 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.32 2024-05-10T09:56:52.231 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:52.231 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 33 2024-05-10T09:56:52.243 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:52.243 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:52.243 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00976421 s, 1.1 GB/s 2024-05-10T09:56:52.289 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:52.287+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:52.338 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.33 2024-05-10T09:56:52.338 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:52.339 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 34 2024-05-10T09:56:52.348 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:52.348 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:52.349 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:52.349 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:52.349 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00886724 s, 1.2 GB/s 2024-05-10T09:56:52.365 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:52.365 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:52.373 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:52.373 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:52.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1273 3.2d e69/23 3:b59bb266:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_1:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.63326885, 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013030055, 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.375 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.35e-07 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744317+0000", 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060981630000000002 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744349+0000", 2024-05-10T09:56:52.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744363+0000", 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4742e-05 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744467+0000", 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103656 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744487+0000", 2024-05-10T09:56:52.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9893000000000001e-05 2024-05-10T09:56:52.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751184+0000", 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066971670000000004 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751249+0000", 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4789000000000006e-05 2024-05-10T09:56:52.379 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1284 3.36 e69/42 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.516874693999998, 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010399762999999999, 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854613+0000", 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.854615+0000", 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4380000000000002e-06 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858639+0000", 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040232239999999997 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858672+0000", 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3149999999999999e-05 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858689+0000", 2024-05-10T09:56:52.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7342000000000001e-05 2024-05-10T09:56:52.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858762+0000", 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3162000000000002e-05 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.858782+0000", 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9330999999999998e-05 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.864942+0000", 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061601889999999999 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.865013+0000", 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0926999999999994e-05 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1285 3.21 3:85614eff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 20.511907324999999, 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014048458, 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.387 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1285 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859583+0000", 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.932e-06 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862407+0000", 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028238030000000002 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862436+0000", 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9264999999999998e-05 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862452+0000", 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6161999999999999e-05 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862553+0000", 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001002 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862721+0000", 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016805100000000001 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862850+0000", 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012889600000000001 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873327+0000", 2024-05-10T09:56:52.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010477288 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873512+0000", 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018525099999999999 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873586+0000", 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3559999999999994e-05 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873629+0000", 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3050000000000003e-05 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1396 3.3b e71/23 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head v 71'3, mlcod=68'1)", 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.007971016999999, 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020899485999999998, 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.393 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363519+0000", 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370796+0000", 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00727693 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370839+0000", 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2802000000000001e-05 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370857+0000", 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8703e-05 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371003+0000", 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145668 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371048+0000", 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4512999999999999e-05 2024-05-10T09:56:52.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384144+0000", 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013096607 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384416+0000", 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000271883 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1398 3.2e 3:74667c03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.992748638, 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019068742, 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1398 2024-05-10T09:56:52.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378742+0000", 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0299999999999998e-06 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380905+0000", 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021633329999999999 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380931+0000", 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5216e-05 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380945+0000", 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4579999999999999e-05 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381044+0000", 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8981000000000007e-05 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381262+0000", 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218221 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381455+0000", 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019242599999999999 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.389370+0000", 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079151280000000004 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397668+0000", 2024-05-10T09:56:52.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.008297759 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397742+0000", 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3872e-05 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397808+0000", 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6196000000000001e-05 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1402 3.2d e71/23 3:b5eccbcc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_7:head v 71'3, mlcod=69'1)", 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.941182342999999, 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010699695, 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430305+0000", 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.430307+0000", 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.288e-06 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435405+0000", 2024-05-10T09:56:52.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0050987070000000001 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435436+0000", 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1177000000000003e-05 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435451+0000", 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.501e-05 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.406 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435536+0000", 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4101e-05 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.435564+0000", 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8818000000000001e-05 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440940+0000", 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053758870000000002 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.407 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.441005+0000", 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4707000000000002e-05 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1413 3.36 e71/42 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head v 71'3, mlcod=69'1)", 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.790933152999999, 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019195001, 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.408 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.409 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580561+0000", 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6420000000000001e-06 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588455+0000", 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078937079999999993 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588485+0000", 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0411000000000001e-05 2024-05-10T09:56:52.410 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588499+0000", 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3370000000000001e-05 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588602+0000", 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010296 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588630+0000", 2024-05-10T09:56:52.411 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8904999999999999e-05 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599682+0000", 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011051963999999999 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599749+0000", 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7040999999999997e-05 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.412 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1417 3.2e 3:75940b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.739129281, 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018750408999999999, 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1417 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.413 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632361+0000", 2024-05-10T09:56:52.414 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1030000000000002e-06 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635167+0000", 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028054070000000002 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635203+0000", 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6476000000000001e-05 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.415 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635220+0000", 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6393999999999999e-05 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635311+0000", 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1445000000000003e-05 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635439+0000", 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012746900000000001 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.416 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635545+0000", 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106335 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.640654+0000", 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051087379999999998 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651021+0000", 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01036726 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.417 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651068+0000", 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7182999999999999e-05 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651109+0000", 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0599000000000002e-05 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.418 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1435 3.3b e71/23 3:dd2501f8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_12:head v 71'4, mlcod=71'2)", 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 15.193966825, 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011886904, 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177523+0000", 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.266e-06 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182873+0000", 2024-05-10T09:56:52.420 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053496560000000004 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182914+0000", 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1134999999999998e-05 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182934+0000", 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9922e-05 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.421 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.183040+0000", 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010644799999999999 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.183073+0000", 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2756999999999998e-05 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.189310+0000", 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0062369749999999996 2024-05-10T09:56:52.422 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.189408+0000", 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7744999999999993e-05 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1455 3.21 3:848162d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.634709257000001, 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015185799, 2024-05-10T09:56:52.423 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1455 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.424 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736781+0000", 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.773e-06 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738650+0000", 2024-05-10T09:56:52.425 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018684820000000001 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738682+0000", 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2483000000000001e-05 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738697+0000", 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4831000000000001e-05 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.426 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738838+0000", 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014086599999999999 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739132+0000", 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029422999999999998 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739328+0000", 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019572 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.427 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751391+0000", 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012062969 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751830+0000", 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043945200000000001 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751908+0000", 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7391000000000005e-05 2024-05-10T09:56:52.428 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751964+0000", 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6601999999999998e-05 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1460 3.21 3:86cfe81c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.536928103999999, 2024-05-10T09:56:52.429 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015558268, 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1460 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834564+0000", 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9940000000000002e-06 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836403+0000", 2024-05-10T09:56:52.431 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001839898 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836447+0000", 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3228e-05 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836471+0000", 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4074e-05 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.432 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836588+0000", 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117508 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836798+0000", 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000209934 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836980+0000", 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018196299999999999 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.433 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.842755+0000", 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0057745660000000001 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850035+0000", 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072807139999999998 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850078+0000", 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.303e-05 2024-05-10T09:56:52.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850118+0000", 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9359e-05 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1462 3.2e 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.491054175, 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.025347350000000001, 2024-05-10T09:56:52.435 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1462 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.436 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880438+0000", 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.9099999999999996e-06 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882457+0000", 2024-05-10T09:56:52.437 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020182120000000001 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882501+0000", 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4345999999999999e-05 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882526+0000", 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4890000000000001e-05 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882714+0000", 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018791500000000001 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.883115+0000", 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000401245 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.883513+0000", 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039829500000000001 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.439 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.890718+0000", 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072049560000000002 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905553+0000", 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014834340999999999 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905659+0000", 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010660800000000001 2024-05-10T09:56:52.440 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905781+0000", 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121632 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1465 3.21 3:85e7ecaf:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.421714643, 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015113694, 2024-05-10T09:56:52.441 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1465 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.442 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949778+0000", 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6229999999999996e-06 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952377+0000", 2024-05-10T09:56:52.443 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002599826 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952419+0000", 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1854999999999998e-05 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952446+0000", 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6526999999999999e-05 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.444 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952608+0000", 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016185799999999999 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952884+0000", 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027616499999999998 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.953125+0000", 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000241139 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.445 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.960413+0000", 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072875539999999999 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964569+0000", 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041563540000000001 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964749+0000", 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018009800000000001 2024-05-10T09:56:52.446 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964887+0000", 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013769499999999999 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1472 3.2e 3:75ea7f72:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.255394178, 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015083343000000001, 2024-05-10T09:56:52.447 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1472 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.448 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116097+0000", 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.817e-06 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119039+0000", 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029415370000000001 2024-05-10T09:56:52.449 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119094+0000", 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5346000000000002e-05 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119116+0000", 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2010000000000001e-05 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.450 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119251+0000", 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135096 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119529+0000", 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027775800000000002 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119820+0000", 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029083499999999998 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.451 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.127004+0000", 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071846330000000002 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.130987+0000", 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0039825379999999999 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.131095+0000", 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001075 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.452 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.131177+0000", 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2273000000000003e-05 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1899 3.39 3:9f007745:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.19:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.7532349979999999, 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013350934, 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.453 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1899 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.454 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618255+0000", 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1229999999999998e-06 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620406+0000", 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002151207 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.455 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620440+0000", 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4514000000000002e-05 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620452+0000", 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1793999999999999e-05 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620528+0000", 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5919000000000003e-05 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.456 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620673+0000", 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000144909 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.621126+0000", 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045314800000000001 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631092+0000", 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0099662069999999995 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.457 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631491+0000", 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039829900000000002 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631555+0000", 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4424999999999994e-05 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631604+0000", 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8389e-05 2024-05-10T09:56:52.458 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1919 3.3b e76/23 3:dd39ec35:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.22:head v 76'6, mlcod=71'4)", 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.3767078580000001, 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012143592, 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.459 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994782+0000", 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8670000000000001e-06 2024-05-10T09:56:52.460 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001902+0000", 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007120042 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001929+0000", 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7784e-05 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001941+0000", 2024-05-10T09:56:52.461 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2002e-05 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.002027+0000", 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5606000000000007e-05 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.002053+0000", 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5935000000000002e-05 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.462 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.006843+0000", 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047895389999999998 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.006923+0000", 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0816999999999996e-05 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1922 3.21 3:84b5b706:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.PBl2-twCS8ooY6U8CbDbsMdnzO_2t6r_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:52.463 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.2739127080000001, 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016902717000000001, 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1922 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.464 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097579+0000", 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5360000000000003e-06 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.465 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099327+0000", 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001747551 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099369+0000", 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1842999999999999e-05 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099393+0000", 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3805999999999999e-05 2024-05-10T09:56:52.466 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099496+0000", 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010288100000000001 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099682+0000", 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186801 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:52.467 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099867+0000", 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000184811 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.105304+0000", 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054372530000000004 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114344+0000", 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0090392019999999997 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114419+0000", 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5476999999999996e-05 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114478+0000", 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8556e-05 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1955 3.21 3:84c95482:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.28:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:52.469 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.742792+0000", 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.62869517900000005, 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011136042000000001, 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1955 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.742792+0000", 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.742792+0000", 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.742794+0000", 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9860000000000001e-06 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.744574+0000", 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017791269999999999 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.744604+0000", 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.074e-05 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.744615+0000", 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1131000000000001e-05 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.744714+0000", 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8870999999999996e-05 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.744842+0000", 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000127329 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.745266+0000", 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000424537 2024-05-10T09:56:52.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.753558+0000", 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082916870000000007 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.753774+0000", 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021606199999999999 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.474 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.753876+0000", 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010212099999999999 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.753928+0000", 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2451000000000003e-05 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1961 3.2d e76/23 3:b4c474b1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.29:head v 76'6, mlcod=75'4)", 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:56:52.475 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.511022054, 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011668352, 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:56:52.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860468+0000", 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6199999999999999e-06 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866306+0000", 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058373210000000003 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866327+0000", 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1929999999999998e-05 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866342+0000", 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4259e-05 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866434+0000", 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1799000000000007e-05 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866466+0000", 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2787999999999998e-05 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.872063+0000", 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055964889999999996 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.872134+0000", 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.479 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1970 3.3b e76/23 3:dcb16968:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Qq3K6xfP5QCojisff7ShvnV05-qCdEI_1:head v 76'8, mlcod=76'6)", 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.31197143100000002, 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011621586, 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:52.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059527+0000", 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0621999999999999e-05 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066197+0000", 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066698180000000001 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066219+0000", 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2691e-05 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066231+0000", 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1382e-05 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066311+0000", 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0203000000000004e-05 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066334+0000", 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2597000000000001e-05 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.071082+0000", 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004748932 2024-05-10T09:56:52.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.071138+0000", 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5340999999999998e-05 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:52.484 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:52.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:52.486 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:52.486 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:52.487 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:52.487 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:52.487 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:52.488 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:52.488 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:52.488 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.34 2024-05-10T09:56:52.488 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:52.488 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 35 2024-05-10T09:56:52.489 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:52.489 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:52.489 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:52.489 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:52.489 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00895722 s, 1.2 GB/s 2024-05-10T09:56:52.490 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:52.490 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:52.490 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:52.482+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:52.491 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:52.491 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:52.506 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:56:52.572 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.35 2024-05-10T09:56:52.573 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:52.573 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 36 2024-05-10T09:56:52.583 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:52.583 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:52.584 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00905037 s, 1.2 GB/s 2024-05-10T09:56:52.586 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:52.587+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:52.644 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:52.644 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:52.661 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:52.687 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:52.687+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:52.698 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.36 2024-05-10T09:56:52.698 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:52.698 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 37 2024-05-10T09:56:52.712 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:52.712 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:52.712 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115373 s, 909 MB/s 2024-05-10T09:56:52.788 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:52.787+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:52.815 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.37 2024-05-10T09:56:52.815 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:52.815 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 38 2024-05-10T09:56:52.829 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:52.829 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:52.829 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115496 s, 908 MB/s 2024-05-10T09:56:52.835 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:52.835 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:52.850 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:52.891 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:52.890+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:52.946 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.38 2024-05-10T09:56:52.946 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:52.946 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 39 2024-05-10T09:56:52.959 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:52.959 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:52.959 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105955 s, 990 MB/s 2024-05-10T09:56:52.989 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:52.986+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:53.035 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:53.035 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:53.053 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:53.086 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.39 2024-05-10T09:56:53.086 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:53.086 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 40 2024-05-10T09:56:53.090 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:53.086+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:53.099 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:53.099 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:53.099 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109672 s, 956 MB/s 2024-05-10T09:56:53.178 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:53.178 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:53.191 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:53.191+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:53.192 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:53.220 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.40 2024-05-10T09:56:53.220 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:53.220 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 41 2024-05-10T09:56:53.236 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:53.236 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:53.236 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130427 s, 804 MB/s 2024-05-10T09:56:53.291 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:53.291+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:53.356 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:53.356 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:53.370 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:53.376 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.41 2024-05-10T09:56:53.376 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:53.377 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 42 2024-05-10T09:56:53.392 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:53.390+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:53.393 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:53.393 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:53.393 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0140651 s, 746 MB/s 2024-05-10T09:56:53.493 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:53.491+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:53.530 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.42 2024-05-10T09:56:53.531 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:53.531 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 43 2024-05-10T09:56:53.544 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:53.544 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:53.547 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:53.547 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:53.547 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132552 s, 791 MB/s 2024-05-10T09:56:53.558 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:53.593 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:53.590+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:53.676 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.43 2024-05-10T09:56:53.676 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:53.676 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 44 2024-05-10T09:56:53.693 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:53.693 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:53.693 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0134801 s, 778 MB/s 2024-05-10T09:56:53.694 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:53.695+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:53.725 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:53.725 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:53.739 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:53.825 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:53.827+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:53.832 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.44 2024-05-10T09:56:53.832 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:53.832 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 45 2024-05-10T09:56:53.848 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:53.848 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:53.848 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132379 s, 792 MB/s 2024-05-10T09:56:53.895 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:53.890+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:53.908 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:53.908 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:53.922 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:53.995 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:53.994+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:53.996 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.45 2024-05-10T09:56:53.996 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:53.996 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 46 2024-05-10T09:56:54.012 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:54.012 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:54.012 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123328 s, 850 MB/s 2024-05-10T09:56:54.086 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:54.086 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:54.097 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:54.094+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:54.100 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:54.163 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.46 2024-05-10T09:56:54.163 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:54.163 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 47 2024-05-10T09:56:54.177 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:54.177 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:54.178 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126406 s, 830 MB/s 2024-05-10T09:56:54.197 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:54.195+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:54.228 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:54.228 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:54.242 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:54.298 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:54.294+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:54.331 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.47 2024-05-10T09:56:54.331 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:54.331 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 48 2024-05-10T09:56:54.347 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:54.347 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:54.347 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128489 s, 816 MB/s 2024-05-10T09:56:54.399 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:54.394+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:54.409 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:54.409 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:54.424 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:54.480 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.48 2024-05-10T09:56:54.480 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:54.480 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 49 2024-05-10T09:56:54.492 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:54.496 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:54.496 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:54.496 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127068 s, 825 MB/s 2024-05-10T09:56:54.500 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:54.498+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:54.539 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:56:54.545 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:54.546 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:54.560 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:54.603 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.49 2024-05-10T09:56:54.603 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:54.604 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 50 2024-05-10T09:56:54.604 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:54.602+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:54.614 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:54.614 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:54.614 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00900551 s, 1.2 GB/s 2024-05-10T09:56:54.658 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:54.658 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:54.685 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:54.685 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:54.701 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:54.698+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:54.720 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:54.720 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:54.724 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.50 2024-05-10T09:56:54.724 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:54.725 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 51 2024-05-10T09:56:54.735 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:54.735 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:54.736 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00922507 s, 1.1 GB/s 2024-05-10T09:56:54.739 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:54.740 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:54.740 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:54.761 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:54.761 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:54.765 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:54.765 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:54.765 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:54.765 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:54.784 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:54.787 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:54.787 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:54.817 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:54.817 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:54.817 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:54.814+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:54.820 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:54.820 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:54.836 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.51 2024-05-10T09:56:54.836 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:54.836 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 52 2024-05-10T09:56:54.847 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:54.847 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:54.847 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00883659 s, 1.2 GB/s 2024-05-10T09:56:54.903 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:54.898+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:54.921 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:54.921 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:54.921 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:54.921 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:54.921 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:54.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:54.955 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.52 2024-05-10T09:56:54.955 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:54.955 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 53 2024-05-10T09:56:54.965 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:54.965 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:54.965 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00921237 s, 1.1 GB/s 2024-05-10T09:56:55.004 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:55.002+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:55.072 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.53 2024-05-10T09:56:55.072 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:55.072 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 54 2024-05-10T09:56:55.085 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:55.085 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:55.085 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:55.085 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:55.085 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.085 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1291 3.1b 3:d8e30cbd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.155160092999999, 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020403290000000001, 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1291 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.086 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925585+0000", 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.925588+0000", 2024-05-10T09:56:55.087 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.818e-06 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927537+0000", 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001949442 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927563+0000", 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5677000000000002e-05 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927577+0000", 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3623e-05 2024-05-10T09:56:55.088 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927670+0000", 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3244000000000004e-05 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927880+0000", 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000209662 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.928062+0000", 2024-05-10T09:56:55.089 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018209899999999999 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.933967+0000", 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0059051989999999999 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945905+0000", 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011938318 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.090 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945952+0000", 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6644999999999998e-05 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.945988+0000", 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6563000000000002e-05 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1301 3.23 3:c760cb7d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:55.091 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.683942082000002, 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014075771000000001, 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1301 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:55.092 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396803+0000", 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.396806+0000", 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2040000000000002e-06 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398853+0000", 2024-05-10T09:56:55.093 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020470060000000001 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398904+0000", 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1011999999999999e-05 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.398935+0000", 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0454e-05 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.094 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399051+0000", 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011635 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399241+0000", 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018986200000000001 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.399420+0000", 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017852300000000001 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.095 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410164+0000", 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010744258 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410747+0000", 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00058339799999999995 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410818+0000", 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1218999999999997e-05 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.096 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.410879+0000", 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0485000000000001e-05 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1303 3.6 3:6092e388:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.658908790000002, 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019484492999999999, 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.097 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1303 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421836+0000", 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.098 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.421841+0000", 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5340000000000001e-06 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424916+0000", 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030753439999999998 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424945+0000", 2024-05-10T09:56:55.099 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8399999999999999e-05 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.424957+0000", 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2211e-05 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425038+0000", 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0659000000000001e-05 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425218+0000", 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018066499999999999 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425377+0000", 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015881599999999999 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.431067+0000", 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056899419999999999 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441200+0000", 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010132755 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441255+0000", 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4864999999999997e-05 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.441321+0000", 2024-05-10T09:56:55.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6302000000000003e-05 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1312 3.17 3:ebbfdea4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.553466359000002, 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015421182, 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.103 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1312 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527279+0000", 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.527282+0000", 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.366e-06 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528783+0000", 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001500978 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528815+0000", 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1828000000000001e-05 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528829+0000", 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4041e-05 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.528931+0000", 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010204600000000001 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.529101+0000", 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016975900000000001 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.529305+0000", 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000203919 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.534340+0000", 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0050356369999999999 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542583+0000", 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082426240000000005 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542646+0000", 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3357999999999999e-05 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.542700+0000", 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3625999999999998e-05 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1414 3.23 3:c5cb197a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.108 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.491454224000002, 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014761384000000001, 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1414 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589291+0000", 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.589295+0000", 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6239999999999999e-06 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591498+0000", 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022029509999999999 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591522+0000", 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4368000000000001e-05 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591535+0000", 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2652e-05 2024-05-10T09:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591619+0000", 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.4571000000000001e-05 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.591860+0000", 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024051199999999999 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.592070+0000", 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021078000000000001 2024-05-10T09:56:55.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.600032+0000", 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007961437 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.603921+0000", 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0038889419999999998 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.603996+0000", 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5352999999999995e-05 2024-05-10T09:56:55.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.604052+0000", 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6193999999999998e-05 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1425 3.3a e71/23 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head v 71'5, mlcod=71'3)", 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.025493269999998, 2024-05-10T09:56:55.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019775094, 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055252+0000", 2024-05-10T09:56:55.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.055255+0000", 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6129999999999998e-06 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066229+0000", 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010974634 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066267+0000", 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7953000000000001e-05 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066283+0000", 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5993000000000001e-05 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066373+0000", 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9370999999999995e-05 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.066391+0000", 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8797999999999999e-05 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074966+0000", 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0085746869999999992 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.075027+0000", 2024-05-10T09:56:55.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1044999999999996e-05 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1428 3.32 3:4e529b56:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.002072070000001, 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016023631999999999, 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.119 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1428 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078673+0000", 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.078678+0000", 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6299999999999997e-06 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084738+0000", 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060599540000000002 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084791+0000", 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3476000000000001e-05 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084846+0000", 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5136000000000002e-05 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.084961+0000", 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114948 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.085137+0000", 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017568299999999999 2024-05-10T09:56:55.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.085325+0000", 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018774899999999999 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094095+0000", 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0087703 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094572+0000", 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047742699999999999 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094641+0000", 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8231000000000005e-05 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.094697+0000", 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6097999999999997e-05 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1432 3.6 3:63c25752:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.952281465999999, 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015410627, 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1432 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128464+0000", 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.128466+0000", 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6000000000000001e-06 2024-05-10T09:56:55.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130918+0000", 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0024514509999999999 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130959+0000", 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1465999999999999e-05 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.130984+0000", 2024-05-10T09:56:55.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5170000000000001e-05 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131078+0000", 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3546000000000002e-05 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131189+0000", 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000111019 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131293+0000", 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103532 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.137135+0000", 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058429440000000001 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143641+0000", 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0065052260000000002 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143783+0000", 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014180599999999999 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143874+0000", 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1867000000000007e-05 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.130 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1440 3.1f 3:f8aeb630:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.837273163999999, 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020526757, 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1440 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243472+0000", 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.243475+0000", 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9830000000000001e-06 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245852+0000", 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023767039999999999 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245878+0000", 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5867000000000002e-05 2024-05-10T09:56:55.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245889+0000", 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1226999999999999e-05 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.245960+0000", 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0693999999999998e-05 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.246103+0000", 2024-05-10T09:56:55.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014311400000000001 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.246193+0000", 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0216000000000005e-05 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.250671+0000", 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0044783089999999998 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.135 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263735+0000", 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013064045999999999 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263891+0000", 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015604099999999999 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.263999+0000", 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000107556 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.136 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1449 3.1b 3:d8b9774b:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.730600742, 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017268909999999998, 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.137 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1449 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350144+0000", 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.350146+0000", 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2160000000000001e-06 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352148+0000", 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020024819999999999 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352170+0000", 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.16e-05 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352179+0000", 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3470000000000005e-06 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352334+0000", 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015537799999999999 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.352777+0000", 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044212500000000003 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367306+0000", 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014529243000000001 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367355+0000", 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8834e-05 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.367413+0000", 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8684999999999998e-05 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1456 3.12 3:49fd254a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.318271922000001, 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.026305321999999999, 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.142 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1456 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762473+0000", 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.762477+0000", 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3569999999999998e-06 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766831+0000", 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0043540540000000004 2024-05-10T09:56:55.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766872+0000", 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1669999999999999e-05 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.766897+0000", 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767040+0000", 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014221899999999999 2024-05-10T09:56:55.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767300+0000", 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026063300000000002 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.767574+0000", 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027399 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788426+0000", 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020851634000000001 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788542+0000", 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116322 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788676+0000", 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013342200000000001 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.788779+0000", 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103012 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1457 3.12 3:48cf3986:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.307695196000001, 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018620484999999999, 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.148 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1457 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773050+0000", 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.773053+0000", 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0630000000000002e-06 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776037+0000", 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029840909999999999 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776070+0000", 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2966000000000003e-05 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.776090+0000", 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9652000000000001e-05 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.778860+0000", 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027701610000000002 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.779152+0000", 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029241599999999999 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.779439+0000", 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028643000000000001 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.789444+0000", 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010004822999999999 2024-05-10T09:56:55.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791535+0000", 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020911950000000001 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791613+0000", 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7945e-05 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.791671+0000", 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7742999999999999e-05 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1466 3.23 3:c6625ef2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.105075996, 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017247114000000001, 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.154 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1466 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975669+0000", 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.975673+0000", 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8260000000000003e-06 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978412+0000", 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027384610000000002 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978458+0000", 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6771999999999999e-05 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978487+0000", 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8597000000000001e-05 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978660+0000", 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017359400000000001 2024-05-10T09:56:55.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.978964+0000", 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00030344999999999998 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.979245+0000", 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00028105300000000002 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.986720+0000", 2024-05-10T09:56:55.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007474596 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992704+0000", 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.005984708 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992816+0000", 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000112025 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.992916+0000", 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010003199999999999 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1471 3.30 e72/23 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head v 72'5, mlcod=71'3)", 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 16.985453747000001, 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01989001, 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.160 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095291+0000", 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.095294+0000", 2024-05-10T09:56:55.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.847e-06 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100863+0000", 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055683529999999998 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100908+0000", 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5663e-05 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.100936+0000", 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7535999999999999e-05 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.101115+0000", 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179548 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.101182+0000", 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6262999999999999e-05 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.115085+0000", 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013903067999999999 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.115181+0000", 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6731999999999995e-05 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1872 3.2b 3:d72b79dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_._kyUpRWiSfEdsJW4YJl14_dAfxMYkn-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.100762+0000", 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.9799833849999997, 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.024701033000000001, 2024-05-10T09:56:55.164 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1872 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.100762+0000", 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.100762+0000", 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.100764+0000", 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6400000000000001e-06 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.102762+0000", 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001997291 2024-05-10T09:56:55.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.102791+0000", 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9578e-05 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.102803+0000", 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1841000000000001e-05 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.102890+0000", 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7262000000000006e-05 2024-05-10T09:56:55.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.103077+0000", 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018621999999999999 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.103249+0000", 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017271699999999999 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.108571+0000", 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053216189999999997 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.125329+0000", 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016757575 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.125404+0000", 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5028000000000001e-05 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.125463+0000", 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9262000000000003e-05 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1878 3.12 3:498399a7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.IorLTFkUppimHUwkeqi1iN_ZoWplKhv_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.202545+0000", 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.8782005699999997, 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019856743, 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.170 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1878 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.202545+0000", 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.202545+0000", 2024-05-10T09:56:55.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.202547+0000", 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4090000000000001e-06 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.203866+0000", 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001319167 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.203895+0000", 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.836e-05 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.203906+0000", 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1083e-05 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.203987+0000", 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1749999999999995e-05 2024-05-10T09:56:55.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.204108+0000", 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000120989 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.204213+0000", 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000104512 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.208508+0000", 2024-05-10T09:56:55.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0042946310000000001 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.222328+0000", 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013820412000000001 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.222372+0000", 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4464e-05 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.222401+0000", 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8966e-05 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1911 3.12 3:487aa37e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.21:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.869427+0000", 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.2113184810000002, 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.024950852999999999, 2024-05-10T09:56:55.176 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1911 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.869427+0000", 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.869427+0000", 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.869429+0000", 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3750000000000001e-06 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.871429+0000", 2024-05-10T09:56:55.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020001649999999999 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.871463+0000", 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3834000000000002e-05 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.871481+0000", 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7422999999999999e-05 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.871637+0000", 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015618000000000001 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.872066+0000", 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042970699999999998 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.873264+0000", 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011980389999999999 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.886943+0000", 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013678218000000001 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.894255+0000", 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0073126720000000001 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.894328+0000", 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3100000000000001e-05 2024-05-10T09:56:55.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.894378+0000", 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.914e-05 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1940 3.1f 3:fa459300:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.AKZ9XqckfSz32KwCHANqpJKEMOj0Qyq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.485513+0000", 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.5952318339999998, 2024-05-10T09:56:55.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020439643, 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1940 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.485513+0000", 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.485513+0000", 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.485516+0000", 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0730000000000001e-06 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.487274+0000", 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001757076 2024-05-10T09:56:55.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.487300+0000", 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6183e-05 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.487311+0000", 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1430999999999999e-05 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.487391+0000", 2024-05-10T09:56:55.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9781000000000001e-05 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.487537+0000", 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014578400000000001 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.487669+0000", 2024-05-10T09:56:55.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013185599999999999 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.494569+0000", 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069000679999999997 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.505799+0000", 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011230744000000001 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.505888+0000", 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.8442999999999993e-05 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.505953+0000", 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5203999999999994e-05 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1943 3.1f 3:fae1b2d2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.26:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.188 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.509716+0000", 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.5710295859999999, 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017357722999999999, 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1943 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.509716+0000", 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.509716+0000", 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.509717+0000", 2024-05-10T09:56:55.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0210000000000001e-06 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.511332+0000", 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016155620000000001 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.511355+0000", 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3108e-05 2024-05-10T09:56:55.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.511366+0000", 2024-05-10T09:56:55.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0185e-05 2024-05-10T09:56:55.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.511442+0000", 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.6570999999999996e-05 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.511616+0000", 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000174167 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.512188+0000", 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00057148300000000002 2024-05-10T09:56:55.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.517823+0000", 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0056355399999999996 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.526916+0000", 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0090927969999999997 2024-05-10T09:56:55.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.527012+0000", 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6230000000000005e-05 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.527073+0000", 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.1058999999999999e-05 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1971 3.12 3:4a701cd5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Qq3K6xfP5QCojisff7ShvnV05-qCdEI_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:52.059723+0000", 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.0210223580000002, 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014550858999999999, 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.196 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1971 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059723+0000", 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059723+0000", 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059725+0000", 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.48e-06 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.060853+0000", 2024-05-10T09:56:55.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0011280070000000001 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.060874+0000", 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.0985999999999999e-05 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.060885+0000", 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0597999999999999e-05 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.060971+0000", 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6303000000000004e-05 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.061098+0000", 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000126298 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.061200+0000", 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102225 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.063925+0000", 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027256200000000002 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.074148+0000", 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01022264 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.074219+0000", 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0766000000000007e-05 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.074274+0000", 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4935999999999997e-05 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.202 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:55.203 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:55.203 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:55.203 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128907 s, 813 MB/s 2024-05-10T09:56:55.205 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:55.205 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.54 2024-05-10T09:56:55.205 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:55.205 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 55 2024-05-10T09:56:55.205 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:55.202+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:55.216 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:55.216 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:55.216 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126604 s, 828 MB/s 2024-05-10T09:56:55.304 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:55.303+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:55.330 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.55 2024-05-10T09:56:55.330 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:55.330 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 56 2024-05-10T09:56:55.342 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:55.342 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:55.342 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104022 s, 1.0 GB/s 2024-05-10T09:56:55.347 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:55.347 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:55.347 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:55.347 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:55.361 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:55.408 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:55.406+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:55.456 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.56 2024-05-10T09:56:55.456 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:55.456 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 57 2024-05-10T09:56:55.466 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:55.466 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:55.466 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00877932 s, 1.2 GB/s 2024-05-10T09:56:55.492 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:55.493 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:55.493 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:55.493 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:55.493 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:55.507 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:55.507+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:55.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:55.520 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:56:55.607 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:55.607+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:55.612 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.57 2024-05-10T09:56:55.613 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:55.613 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 58 2024-05-10T09:56:55.626 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:55.627 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:55.627 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112199 s, 935 MB/s 2024-05-10T09:56:55.652 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:55.652 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:55.652 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:55.652 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:55.652 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.652 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:55.652 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 132.00283589899999, 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.653 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.654 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:55.655 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.656 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:55.657 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.658 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1274 3.8 e69/23 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.904307819, 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015717301999999999, 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.659 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745751+0000", 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8789999999999999e-06 2024-05-10T09:56:55.660 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748049+0000", 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022981820000000002 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748076+0000", 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6361999999999999e-05 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748093+0000", 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7329e-05 2024-05-10T09:56:55.661 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748193+0000", 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9562000000000007e-05 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748228+0000", 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4962999999999997e-05 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761399+0000", 2024-05-10T09:56:55.662 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013171173 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761467+0000", 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7852e-05 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1275 3.4 3:20482490:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.897600964999999, 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011423600000000001, 2024-05-10T09:56:55.663 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1275 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.664 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752458+0000", 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7039999999999999e-06 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754116+0000", 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016577129999999999 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.665 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754147+0000", 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1782999999999997e-05 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754161+0000", 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3715e-05 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754265+0000", 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103349 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.666 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754448+0000", 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018395900000000001 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754563+0000", 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114115 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763241+0000", 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086780859999999998 2024-05-10T09:56:55.667 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763738+0000", 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049755700000000003 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763816+0000", 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7987999999999999e-05 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.668 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763880+0000", 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3631000000000001e-05 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1286 3.25 3:a4ea653e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.778078888, 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010955397, 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.669 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1286 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.670 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871978+0000", 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.871981+0000", 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7410000000000001e-06 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874251+0000", 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022695770000000001 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.671 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874271+0000", 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9870000000000001e-05 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874280+0000", 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2779999999999999e-06 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874348+0000", 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8518999999999999e-05 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.672 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874512+0000", 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016358200000000001 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.874616+0000", 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103924 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.879896+0000", 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052805279999999996 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.673 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882804+0000", 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029073749999999998 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882877+0000", 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2788999999999997e-05 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.882934+0000", 2024-05-10T09:56:55.674 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.7213999999999998e-05 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1288 3.1a e69/23 3:5902eff1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_16:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.749857272, 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013345268, 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.675 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900205+0000", 2024-05-10T09:56:55.676 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1390000000000003e-06 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906219+0000", 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060138969999999998 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906247+0000", 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7881999999999998e-05 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.677 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906259+0000", 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2334000000000001e-05 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906321+0000", 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2045999999999995e-05 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906353+0000", 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622000000000003e-05 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.678 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913476+0000", 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071233490000000002 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913545+0000", 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8998999999999994e-05 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.679 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1303 3.6 e69/23 3:6092e388:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_3:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.224511707000001, 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015397114999999999, 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.680 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425547+0000", 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5889999999999999e-06 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428542+0000", 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029953570000000001 2024-05-10T09:56:55.681 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428568+0000", 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5621000000000001e-05 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428582+0000", 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3560999999999999e-05 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.682 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428719+0000", 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013757600000000001 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428764+0000", 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4425999999999998e-05 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.440889+0000", 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012125095000000001 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.683 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.440943+0000", 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3890000000000001e-05 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1403 3.25 3:a72e587a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.212678554, 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017687321999999998, 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.684 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1403 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.685 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437382+0000", 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2140000000000001e-06 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440350+0000", 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029685520000000002 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.686 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440386+0000", 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5781999999999997e-05 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440404+0000", 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7859e-05 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.687 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440495+0000", 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0847000000000006e-05 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440670+0000", 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017521099999999999 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440835+0000", 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000165098 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.688 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.450501+0000", 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0096655430000000004 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.454890+0000", 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0043887639999999999 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.454983+0000", 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3664000000000003e-05 2024-05-10T09:56:55.689 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.455066+0000", 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2787999999999994e-05 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1426 3.25 3:a4c8f94a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.592580282, 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017387981, 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.690 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1426 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.691 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057479+0000", 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4040000000000002e-06 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059118+0000", 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001638376 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.692 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059148+0000", 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0670000000000003e-05 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059164+0000", 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5916000000000001e-05 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059242+0000", 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8102000000000005e-05 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.693 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059368+0000", 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012511799999999999 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059479+0000", 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000111535 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.063977+0000", 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0044975090000000002 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.694 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074740+0000", 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010763503000000001 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074815+0000", 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4590000000000002e-05 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074865+0000", 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0257999999999999e-05 2024-05-10T09:56:55.695 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1427 3.31 3:8c9c1f42:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.581639026000001, 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018352572000000001, 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.696 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1427 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.697 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068421+0000", 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7590000000000002e-06 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071398+0000", 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002976762 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071421+0000", 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2949e-05 2024-05-10T09:56:55.698 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071432+0000", 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1265e-05 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071590+0000", 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015817300000000001 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.699 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.072017+0000", 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042705199999999998 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086604+0000", 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01458713 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086676+0000", 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1692000000000004e-05 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.700 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086771+0000", 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4790000000000006e-05 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1432 3.6 e71/23 3:63c25752:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_9:head v 71'6, mlcod=71'4)", 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.518645145000001, 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011963349, 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.701 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.702 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131414+0000", 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6959999999999999e-06 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133867+0000", 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0024533469999999998 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133893+0000", 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5511e-05 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.703 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133905+0000", 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2758999999999999e-05 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.134012+0000", 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106496 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.134048+0000", 2024-05-10T09:56:55.704 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6505999999999999e-05 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143310+0000", 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092617510000000004 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143375+0000", 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5283000000000005e-05 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.705 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1445 3.0 3:0255dc8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.331332948, 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011906963, 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1445 2024-05-10T09:56:55.706 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.707 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318727+0000", 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9629999999999998e-06 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320387+0000", 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016598749999999999 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320411+0000", 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3419999999999999e-05 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.708 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320421+0000", 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320492+0000", 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1569999999999994e-05 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320644+0000", 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015139099999999999 2024-05-10T09:56:55.709 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320805+0000", 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000161469 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.325790+0000", 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0049845879999999999 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.710 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330527+0000", 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047375519999999999 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330571+0000", 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3682e-05 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330631+0000", 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0359999999999998e-05 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.711 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1453 3.25 3:a7a3552c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.940565201999998, 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012007802, 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1453 2024-05-10T09:56:55.712 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.713 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709495+0000", 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0290000000000001e-06 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710835+0000", 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001339556 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710865+0000", 2024-05-10T09:56:55.714 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0808e-05 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710879+0000", 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4039999999999999e-05 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710961+0000", 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1358000000000003e-05 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.715 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.711086+0000", 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012547799999999999 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.711183+0000", 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6404999999999996e-05 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.715963+0000", 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047807889999999997 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.716 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721253+0000", 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052894650000000001 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721400+0000", 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014675300000000001 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721500+0000", 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000100121 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.717 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1455 3.21 e72/42 3:848162d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_4:head v 72'4, mlcod=69'2)", 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.910538018, 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011681792, 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.718 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9400000000000001e-07 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.719 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741481+0000", 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019617089999999998 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741520+0000", 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8506e-05 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741543+0000", 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3632999999999999e-05 2024-05-10T09:56:55.720 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741691+0000", 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014779999999999999 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741744+0000", 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3359000000000002e-05 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751059+0000", 2024-05-10T09:56:55.721 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093147860000000002 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751201+0000", 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000141705 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1460 3.21 e72/42 3:86cfe81c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_9:head v 72'5, mlcod=71'3)", 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.812900904999999, 2024-05-10T09:56:55.722 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012644017, 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.723 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837159+0000", 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5000000000000002e-06 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840513+0000", 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003354686 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840551+0000", 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7956e-05 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.724 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840569+0000", 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7934000000000001e-05 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840727+0000", 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015768100000000001 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840790+0000", 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3249000000000004e-05 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.725 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.849680+0000", 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088892490000000001 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.849800+0000", 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012076199999999999 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.726 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1469 3.8 e72/23 3:108a86fb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_18:head v 72'5, mlcod=69'3)", 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.604857224, 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012011735000000001, 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.727 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045204+0000", 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6430000000000001e-06 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.728 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048886+0000", 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003681915 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048927+0000", 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1566999999999997e-05 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048946+0000", 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9076000000000002e-05 2024-05-10T09:56:55.729 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.049107+0000", 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.049149+0000", 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2119000000000001e-05 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057149+0000", 2024-05-10T09:56:55.730 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079999349999999997 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057212+0000", 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3058000000000005e-05 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1474 3.8 e72/23 3:1087178a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_23:head v 72'6, mlcod=69'4)", 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 17.479736336999999, 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015885412000000002, 2024-05-10T09:56:55.731 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.732 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170324+0000", 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175618+0000", 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052940560000000001 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175659+0000", 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:56:55.733 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175677+0000", 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8519e-05 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175857+0000", 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018009800000000001 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175912+0000", 2024-05-10T09:56:55.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4373000000000003e-05 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186141+0000", 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010229591999999999 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186206+0000", 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5093999999999997e-05 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1891 3.19 3:9a43e86c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eLGRCzvAKn5Xe45EeKu1jRkfp7sri7Z_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1856340960000002, 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011028723000000001, 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1891 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.736 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464426+0000", 2024-05-10T09:56:55.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.27e-06 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466548+0000", 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021214620000000002 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466591+0000", 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3452999999999999e-05 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466611+0000", 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9986000000000001e-05 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466751+0000", 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013972600000000001 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.467017+0000", 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026603400000000001 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.739 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.467259+0000", 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024156000000000001 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.474806+0000", 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0075472509999999996 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475355+0000", 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054962000000000001 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475408+0000", 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2281999999999999e-05 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475452+0000", 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4079000000000003e-05 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.741 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1916 3.19 3:9bc12e34:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.F65ETUPaF-FOL5UgmtNLtq7r2nquRij_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.6804185780000003, 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012330288999999999, 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1916 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969641+0000", 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5579999999999999e-06 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971277+0000", 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016355090000000001 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971319+0000", 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1842999999999999e-05 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971338+0000", 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9449999999999998e-05 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971440+0000", 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102027 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.745 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971611+0000", 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017066100000000001 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971786+0000", 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000174928 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981651+0000", 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.009865614 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981884+0000", 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023318899999999999 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981929+0000", 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4601000000000002e-05 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981969+0000", 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9909e-05 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1922 3.21 e76/42 3:84b5b706:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.PBl2-twCS8ooY6U8CbDbsMdnzO_2t6r_1:head v 76'8, mlcod=72'6)", 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.5499965229999999, 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01401399, 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.748 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100062+0000", 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.437e-06 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102533+0000", 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002470486 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102571+0000", 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8393000000000003e-05 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102588+0000", 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6592999999999999e-05 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102784+0000", 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019662099999999999 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102823+0000", 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8509e-05 2024-05-10T09:56:55.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.113950+0000", 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011127386 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114075+0000", 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012456500000000001 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.752 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1931 3.0 3:0050c674:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.4016319690000003, 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019806678000000001, 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1931 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248427+0000", 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2170000000000001e-06 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250923+0000", 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002495588 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250957+0000", 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3994e-05 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250974+0000", 2024-05-10T09:56:55.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6595999999999998e-05 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.251151+0000", 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176995 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.251461+0000", 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031083 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.252422+0000", 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00096011600000000001 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.266082+0000", 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013660603 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.267953+0000", 2024-05-10T09:56:55.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018704290000000001 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.268108+0000", 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155394 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.268232+0000", 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012391600000000001 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.758 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.759 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:55.759 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:55.759 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:55.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:55.761 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.58 2024-05-10T09:56:55.761 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:55.761 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 59 2024-05-10T09:56:55.761 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:55.761 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:55.761 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121465 s, 863 MB/s 2024-05-10T09:56:55.762 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:55.758+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:55.861 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:55.859+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:55.890 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.59 2024-05-10T09:56:55.890 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:55.890 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 60 2024-05-10T09:56:55.903 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:55.904 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:55.904 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110952 s, 945 MB/s 2024-05-10T09:56:55.938 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:55.938 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:55.938 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:55.938 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:55.954 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:56.004 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:56.002+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:56.013 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.60 2024-05-10T09:56:56.013 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:56.013 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 61 2024-05-10T09:56:56.026 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:56.026 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:56.026 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.01055 s, 994 MB/s 2024-05-10T09:56:56.062 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:56.063+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:56.089 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:56.090 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:56.090 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:56.090 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:56.090 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:56.107 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:56:56.172 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.61 2024-05-10T09:56:56.172 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:56.172 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 62 2024-05-10T09:56:56.172 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:56.170+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:56.185 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:56.185 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:56.185 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113681 s, 922 MB/s 2024-05-10T09:56:56.264 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:56.263+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:56.290 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:56.290 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:56.290 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:56.290 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1273 3.2d e69/23 3:b59bb266:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_1:head v 69'1, mlcod=0'0)", 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.547423555000002, 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013030055, 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:56.291 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.35e-07 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.292 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744317+0000", 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060981630000000002 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744349+0000", 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:56:56.293 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744363+0000", 2024-05-10T09:56:56.294 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4742e-05 2024-05-10T09:56:56.294 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.294 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.294 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.294 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744467+0000", 2024-05-10T09:56:56.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103656 2024-05-10T09:56:56.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.295 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.295 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744487+0000", 2024-05-10T09:56:56.295 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9893000000000001e-05 2024-05-10T09:56:56.295 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.295 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751184+0000", 2024-05-10T09:56:56.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066971670000000004 2024-05-10T09:56:56.296 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.296 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.296 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.296 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751249+0000", 2024-05-10T09:56:56.296 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4789000000000006e-05 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1285 3.21 3:85614eff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.426062030000001, 2024-05-10T09:56:56.297 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014048458, 2024-05-10T09:56:56.298 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.298 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.298 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.298 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.298 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1285 2024-05-10T09:56:56.299 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.299 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.299 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.299 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.299 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:56.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.300 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.300 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:56:56.300 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.300 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.300 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859583+0000", 2024-05-10T09:56:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.932e-06 2024-05-10T09:56:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862407+0000", 2024-05-10T09:56:56.301 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028238030000000002 2024-05-10T09:56:56.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.302 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862436+0000", 2024-05-10T09:56:56.302 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9264999999999998e-05 2024-05-10T09:56:56.302 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.302 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.302 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862452+0000", 2024-05-10T09:56:56.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6161999999999999e-05 2024-05-10T09:56:56.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.303 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.303 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.303 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862553+0000", 2024-05-10T09:56:56.303 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001002 2024-05-10T09:56:56.303 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862721+0000", 2024-05-10T09:56:56.304 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016805100000000001 2024-05-10T09:56:56.304 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.304 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.304 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:56.304 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862850+0000", 2024-05-10T09:56:56.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012889600000000001 2024-05-10T09:56:56.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.305 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.305 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873327+0000", 2024-05-10T09:56:56.305 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010477288 2024-05-10T09:56:56.305 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.305 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873512+0000", 2024-05-10T09:56:56.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018525099999999999 2024-05-10T09:56:56.306 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.306 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.306 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.306 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873586+0000", 2024-05-10T09:56:56.306 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3559999999999994e-05 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873629+0000", 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3050000000000003e-05 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.307 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1396 3.3b e71/23 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head v 71'3, mlcod=68'1)", 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.922125722000001, 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020899485999999998, 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.308 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363519+0000", 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370796+0000", 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00727693 2024-05-10T09:56:56.309 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370839+0000", 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2802000000000001e-05 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370857+0000", 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8703e-05 2024-05-10T09:56:56.310 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371003+0000", 2024-05-10T09:56:56.311 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145668 2024-05-10T09:56:56.311 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.311 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.311 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.311 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371048+0000", 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4512999999999999e-05 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384144+0000", 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013096607 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384416+0000", 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000271883 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.312 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1398 3.2e 3:74667c03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.906903343, 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019068742, 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.313 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1398 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.314 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378742+0000", 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0299999999999998e-06 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380905+0000", 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021633329999999999 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380931+0000", 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5216e-05 2024-05-10T09:56:56.315 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380945+0000", 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4579999999999999e-05 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381044+0000", 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8981000000000007e-05 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381262+0000", 2024-05-10T09:56:56.316 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218221 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381455+0000", 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019242599999999999 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.389370+0000", 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079151280000000004 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.317 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397668+0000", 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.008297759 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397742+0000", 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3872e-05 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397808+0000", 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6196000000000001e-05 2024-05-10T09:56:56.318 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1413 3.36 e71/42 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head v 71'3, mlcod=69'1)", 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.705087857999999, 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019195001, 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.319 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.320 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580561+0000", 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6420000000000001e-06 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588455+0000", 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078937079999999993 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588485+0000", 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0411000000000001e-05 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.321 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588499+0000", 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3370000000000001e-05 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588602+0000", 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010296 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588630+0000", 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8904999999999999e-05 2024-05-10T09:56:56.322 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599682+0000", 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011051963999999999 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599749+0000", 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7040999999999997e-05 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.323 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1417 3.2e 3:75940b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.653283986000002, 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018750408999999999, 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1417 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.324 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632361+0000", 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1030000000000002e-06 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.325 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635167+0000", 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028054070000000002 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635203+0000", 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6476000000000001e-05 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635220+0000", 2024-05-10T09:56:56.326 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6393999999999999e-05 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635311+0000", 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1445000000000003e-05 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635439+0000", 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012746900000000001 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:56.327 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635545+0000", 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106335 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.640654+0000", 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051087379999999998 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651021+0000", 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01036726 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651068+0000", 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7182999999999999e-05 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651109+0000", 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0599000000000002e-05 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1435 3.3b e71/23 3:dd2501f8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_12:head v 71'4, mlcod=71'2)", 2024-05-10T09:56:56.329 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.108121529999998, 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011886904, 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.330 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177523+0000", 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.266e-06 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182873+0000", 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053496560000000004 2024-05-10T09:56:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182914+0000", 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1134999999999998e-05 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182934+0000", 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9922e-05 2024-05-10T09:56:56.332 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.183040+0000", 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010644799999999999 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.183073+0000", 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2756999999999998e-05 2024-05-10T09:56:56.333 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.189310+0000", 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0062369749999999996 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.189408+0000", 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7744999999999993e-05 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.334 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1455 3.21 3:848162d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.548863961999999, 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015185799, 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.335 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1455 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.336 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736781+0000", 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.773e-06 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738650+0000", 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018684820000000001 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738682+0000", 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2483000000000001e-05 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.337 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738697+0000", 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4831000000000001e-05 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738838+0000", 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014086599999999999 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739132+0000", 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029422999999999998 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.338 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739328+0000", 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019572 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751391+0000", 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012062969 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751830+0000", 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043945200000000001 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.339 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751908+0000", 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7391000000000005e-05 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751964+0000", 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6601999999999998e-05 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.340 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1460 3.21 3:86cfe81c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.451082808999999, 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015558268, 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1460 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.341 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.342 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834564+0000", 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9940000000000002e-06 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836403+0000", 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001839898 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836447+0000", 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3228e-05 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.343 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836471+0000", 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4074e-05 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836588+0000", 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117508 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836798+0000", 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000209934 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.344 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836980+0000", 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018196299999999999 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.842755+0000", 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0057745660000000001 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850035+0000", 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072807139999999998 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.345 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850078+0000", 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.303e-05 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850118+0000", 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9359e-05 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1462 3.2e 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:56.346 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.40520888, 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.025347350000000001, 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1462 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:56.347 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880438+0000", 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.9099999999999996e-06 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882457+0000", 2024-05-10T09:56:56.348 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020182120000000001 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882501+0000", 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4345999999999999e-05 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882526+0000", 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4890000000000001e-05 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.349 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882714+0000", 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018791500000000001 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.883115+0000", 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000401245 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.883513+0000", 2024-05-10T09:56:56.350 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039829500000000001 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.890718+0000", 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072049560000000002 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905553+0000", 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014834340999999999 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905659+0000", 2024-05-10T09:56:56.351 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010660800000000001 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905781+0000", 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121632 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1465 3.21 3:85e7ecaf:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.335869347999999, 2024-05-10T09:56:56.352 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015113694, 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1465 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.353 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949778+0000", 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6229999999999996e-06 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952377+0000", 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002599826 2024-05-10T09:56:56.354 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952419+0000", 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1854999999999998e-05 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952446+0000", 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6526999999999999e-05 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952608+0000", 2024-05-10T09:56:56.355 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016185799999999999 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952884+0000", 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027616499999999998 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.953125+0000", 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000241139 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.960413+0000", 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072875539999999999 2024-05-10T09:56:56.356 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964569+0000", 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041563540000000001 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964749+0000", 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018009800000000001 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964887+0000", 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013769499999999999 2024-05-10T09:56:56.357 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1472 3.2e 3:75ea7f72:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.169548883000001, 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015083343000000001, 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.358 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1472 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.359 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116097+0000", 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.817e-06 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119039+0000", 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029415370000000001 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.360 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119094+0000", 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5346000000000002e-05 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119116+0000", 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2010000000000001e-05 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119251+0000", 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135096 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.361 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119529+0000", 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027775800000000002 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119820+0000", 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029083499999999998 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.362 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.127004+0000", 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071846330000000002 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.130987+0000", 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0039825379999999999 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.131095+0000", 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001075 2024-05-10T09:56:56.363 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.131177+0000", 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2273000000000003e-05 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1899 3.39 3:9f007745:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.19:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.6673897029999996, 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013350934, 2024-05-10T09:56:56.364 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1899 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.365 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618255+0000", 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1229999999999998e-06 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620406+0000", 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002151207 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.366 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620440+0000", 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4514000000000002e-05 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620452+0000", 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1793999999999999e-05 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620528+0000", 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5919000000000003e-05 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.367 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620673+0000", 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000144909 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.621126+0000", 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045314800000000001 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631092+0000", 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0099662069999999995 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.368 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631491+0000", 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039829900000000002 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631555+0000", 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4424999999999994e-05 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631604+0000", 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8389e-05 2024-05-10T09:56:56.369 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1919 3.3b e76/23 3:dd39ec35:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.22:head v 76'6, mlcod=71'4)", 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.2908625630000001, 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012143592, 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.370 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:56:56.371 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.371 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.371 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.371 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.371 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994782+0000", 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8670000000000001e-06 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001902+0000", 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007120042 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.372 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001929+0000", 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7784e-05 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001941+0000", 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2002e-05 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.002027+0000", 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5606000000000007e-05 2024-05-10T09:56:56.373 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.002053+0000", 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5935000000000002e-05 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.006843+0000", 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047895389999999998 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.006923+0000", 2024-05-10T09:56:56.374 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0816999999999996e-05 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1922 3.21 3:84b5b706:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.PBl2-twCS8ooY6U8CbDbsMdnzO_2t6r_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.1880674129999997, 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016902717000000001, 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.375 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1922 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.376 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097579+0000", 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5360000000000003e-06 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099327+0000", 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001747551 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099369+0000", 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1842999999999999e-05 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.377 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099393+0000", 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3805999999999999e-05 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099496+0000", 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010288100000000001 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.378 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099682+0000", 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186801 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099867+0000", 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000184811 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.105304+0000", 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054372530000000004 2024-05-10T09:56:56.379 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114344+0000", 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0090392019999999997 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114419+0000", 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5476999999999996e-05 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.380 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114478+0000", 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8556e-05 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1961 3.2d e76/23 3:b4c474b1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.29:head v 76'6, mlcod=75'4)", 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.4251767590000002, 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011668352, 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.381 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860468+0000", 2024-05-10T09:56:56.382 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6199999999999999e-06 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866306+0000", 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058373210000000003 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866327+0000", 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1929999999999998e-05 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866342+0000", 2024-05-10T09:56:56.383 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4259e-05 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866434+0000", 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1799000000000007e-05 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866466+0000", 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2787999999999998e-05 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.384 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.872063+0000", 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055964889999999996 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.872134+0000", 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1970 3.3b e76/23 3:dcb16968:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Qq3K6xfP5QCojisff7ShvnV05-qCdEI_1:head v 76'8, mlcod=76'6)", 2024-05-10T09:56:56.385 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.2261261360000004, 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011621586, 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:56:56.386 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059527+0000", 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0621999999999999e-05 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066197+0000", 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066698180000000001 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066219+0000", 2024-05-10T09:56:56.387 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2691e-05 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066231+0000", 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1382e-05 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066311+0000", 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0203000000000004e-05 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.388 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066334+0000", 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2597000000000001e-05 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.071082+0000", 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004748932 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.071138+0000", 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5340999999999998e-05 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.389 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1986 3.21 3:86daa2fb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.33:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:52.326372+0000", 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.959270509, 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011385821000000001, 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1986 2024-05-10T09:56:56.390 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.326372+0000", 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.326372+0000", 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.391 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.326374+0000", 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.43e-06 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.328503+0000", 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021290720000000001 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.328525+0000", 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1605000000000001e-05 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.392 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.328536+0000", 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.117e-05 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.328605+0000", 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8417000000000006e-05 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.328747+0000", 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014247500000000001 2024-05-10T09:56:56.393 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.329193+0000", 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00044598000000000001 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.337186+0000", 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079927020000000008 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.337668+0000", 2024-05-10T09:56:56.394 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00048211700000000001 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.337722+0000", 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4153000000000001e-05 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.337758+0000", 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.57e-05 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.395 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2113 3.21 3:86dc3d5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.UACpZEZMOT4QnnYchquwGgVtzVU7_KJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.022151+0000", 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.2634917999999999, 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013509098000000001, 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2113 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.396 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.022151+0000", 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.022151+0000", 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.022154+0000", 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2650000000000001e-06 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.397 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.024944+0000", 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027901240000000002 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.024982+0000", 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8426000000000001e-05 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.024999+0000", 2024-05-10T09:56:56.398 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6682999999999999e-05 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.025093+0000", 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3555999999999997e-05 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.025276+0000", 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018377899999999999 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:56.399 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.025445+0000", 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016832199999999999 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.035058+0000", 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0096136069999999997 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.035520+0000", 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046162200000000002 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.400 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.035597+0000", 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7545000000000004e-05 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.035660+0000", 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2168999999999994e-05 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:2164 3.36 e78/42 3:6d000b3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.61:head v 78'5, mlcod=71'3)", 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:56.153483+0000", 2024-05-10T09:56:56.401 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.13215955800000001, 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016742610000000002, 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.153483+0000", 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.402 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.153483+0000", 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.153483+0000", 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8299999999999997e-07 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.403 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160539+0000", 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0070558490000000003 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160581+0000", 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2225999999999999e-05 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160600+0000", 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8346e-05 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.404 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160766+0000", 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000166692 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160810+0000", 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3423000000000001e-05 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.170136+0000", 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093265080000000007 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.405 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.406 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.170225+0000", 2024-05-10T09:56:56.406 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9083000000000001e-05 2024-05-10T09:56:56.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.406 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.406 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.406 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.406 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:56.407 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.62 2024-05-10T09:56:56.407 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:56.407 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 63 2024-05-10T09:56:56.408 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:56:56.409 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:56.409 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:56.409 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010701 s, 980 MB/s 2024-05-10T09:56:56.409 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:56.406+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:56.438 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.63 2024-05-10T09:56:56.438 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:56.438 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 64 2024-05-10T09:56:56.453 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:56.453 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:56.453 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125524 s, 835 MB/s 2024-05-10T09:56:56.508 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:56.506+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:56.569 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.64 2024-05-10T09:56:56.569 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:56.569 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 65 2024-05-10T09:56:56.574 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:56.574 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:56.575 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:56.575 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:56.582 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:56.582 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:56.582 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105047 s, 998 MB/s 2024-05-10T09:56:56.591 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:56:56.610 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:56.611+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:56.707 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.65 2024-05-10T09:56:56.707 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:56.708 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 66 2024-05-10T09:56:56.711 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:56.711+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:56.722 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:56.722 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:56.722 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116917 s, 897 MB/s 2024-05-10T09:56:56.780 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:56.780 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:56.780 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:56.780 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:56.780 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:56.796 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:56:56.812 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:56.811+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:56.820 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:56:56.850 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.66 2024-05-10T09:56:56.850 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:56.850 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 67 2024-05-10T09:56:56.861 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:56.862 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:56.862 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00992597 s, 1.1 GB/s 2024-05-10T09:56:56.913 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:56.910+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:56.932 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:56.932 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:56.932 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1274 3.8 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.187055347000001, 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019336196, 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.933 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.934 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.934 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.934 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.934 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1274 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.935 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742479+0000", 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8779999999999998e-06 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745161+0000", 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002682135 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745185+0000", 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3611000000000001e-05 2024-05-10T09:56:56.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745194+0000", 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2369999999999998e-06 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745266+0000", 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2008000000000006e-05 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.937 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745445+0000", 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179259 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745624+0000", 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017874300000000001 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756109+0000", 2024-05-10T09:56:56.938 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010485169000000001 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761680+0000", 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055706649999999998 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761755+0000", 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5171000000000002e-05 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761813+0000", 2024-05-10T09:56:56.939 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.732e-05 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1281 3.29 3:94644cd5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.112921819, 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021096073, 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.940 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1281 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816613+0000", 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.892e-06 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818489+0000", 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018760599999999999 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818531+0000", 2024-05-10T09:56:56.942 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2070000000000002e-05 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818554+0000", 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2776e-05 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818664+0000", 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011037899999999999 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818882+0000", 2024-05-10T09:56:56.943 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000217457 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.819053+0000", 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000171187 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.824533+0000", 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054798609999999999 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.944 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837622+0000", 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013089751 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837669+0000", 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6517000000000002e-05 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837706+0000", 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7122999999999997e-05 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.945 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1289 3.38 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 25.025287931000001, 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022792125999999999, 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.946 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1289 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:56:56.947 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904247+0000", 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1939999999999998e-06 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906042+0000", 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017947239999999999 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.948 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906083+0000", 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0948999999999997e-05 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906101+0000", 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8442999999999999e-05 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906204+0000", 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103359 2024-05-10T09:56:56.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906378+0000", 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000173435 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906536+0000", 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015819099999999999 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.950 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913717+0000", 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071811230000000002 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926882+0000", 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013164765 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926966+0000", 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3579999999999996e-05 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.951 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927036+0000", 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0363000000000004e-05 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1292 3.38 3:1ea9eee7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.992801496999999, 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01900717, 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.952 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1292 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.953 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936734+0000", 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4149999999999999e-06 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938852+0000", 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021187630000000001 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.954 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938883+0000", 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0494999999999999e-05 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938901+0000", 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7988000000000001e-05 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938993+0000", 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2383e-05 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.955 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939177+0000", 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018371699999999999 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939324+0000", 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014727499999999999 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.944680+0000", 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053554379999999997 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.956 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955600+0000", 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010920487 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955670+0000", 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0202000000000003e-05 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955737+0000", 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7007000000000004e-05 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.957 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1296 3.2 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.908713383999999, 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021264584, 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1296 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.958 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020821+0000", 2024-05-10T09:56:56.959 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3259999999999998e-06 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.021993+0000", 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001172071 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022024+0000", 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1222e-05 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.960 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022035+0000", 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1449e-05 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022149+0000", 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011391399999999999 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022369+0000", 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220079 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.961 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022596+0000", 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000226288 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.028699+0000", 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006103163 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042000+0000", 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013301006000000001 2024-05-10T09:56:56.962 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042047+0000", 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6990999999999998e-05 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042083+0000", 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6075000000000003e-05 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.963 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1298 3.29 3:979982e8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 24.88341175, 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018739767000000001, 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1298 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.964 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046121+0000", 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.508e-06 2024-05-10T09:56:56.965 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047357+0000", 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001235683 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047388+0000", 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0549000000000002e-05 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.966 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047404+0000", 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6676000000000001e-05 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047484+0000", 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9212e-05 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047618+0000", 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013448600000000001 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.967 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.048073+0000", 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045510599999999999 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.055269+0000", 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071963189999999996 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064647+0000", 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093774919999999994 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.968 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064781+0000", 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013422999999999999 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064860+0000", 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8505999999999997e-05 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1434 3.33 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:56.969 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.773740769, 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020822112, 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1434 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.970 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155794+0000", 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9100000000000001e-06 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.971 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157707+0000", 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001912757 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157746+0000", 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9848999999999997e-05 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157763+0000", 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6059999999999999e-05 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.972 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157837+0000", 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4952999999999999e-05 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157951+0000", 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011310400000000001 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.158086+0000", 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135122 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.973 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.164123+0000", 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060373429999999997 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176486+0000", 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012362556 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176558+0000", 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2453000000000006e-05 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.974 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176613+0000", 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5004999999999999e-05 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1438 3.1e 3:7ac7bc5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.717199536999999, 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017363922, 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.975 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1438 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:56:56.976 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212335+0000", 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.83e-06 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214003+0000", 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016675240000000001 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.977 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214028+0000", 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5939e-05 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214046+0000", 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7655999999999998e-05 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214129+0000", 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2793000000000005e-05 2024-05-10T09:56:56.978 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214293+0000", 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163616 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214409+0000", 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116944 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.219268+0000", 2024-05-10T09:56:56.979 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048583680000000001 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229606+0000", 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010338174 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229647+0000", 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1415999999999998e-05 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.980 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229696+0000", 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8662000000000003e-05 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1441 3.2 3:4091da54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.667392769999999, 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020721976999999999, 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.981 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1441 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:56:56.982 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262142+0000", 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9019999999999999e-06 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265147+0000", 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030048340000000001 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.983 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265183+0000", 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6233999999999999e-05 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265206+0000", 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2866000000000001e-05 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265319+0000", 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113183 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.984 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265430+0000", 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110772 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265532+0000", 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102746 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.269542+0000", 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040093459999999996 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.985 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282625+0000", 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013083252 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282761+0000", 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135446 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282861+0000", 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010039600000000001 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.986 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1443 3.2 3:41167866:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.637851078000001, 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016390715, 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1443 2024-05-10T09:56:56.987 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291681+0000", 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.291684+0000", 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.19e-06 2024-05-10T09:56:56.988 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293265+0000", 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015814449999999999 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293300+0000", 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4486000000000002e-05 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293314+0000", 2024-05-10T09:56:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4535999999999999e-05 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293443+0000", 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012858999999999999 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293707+0000", 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026414400000000001 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.990 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.293885+0000", 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017773800000000001 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.300013+0000", 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061277579999999996 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.307835+0000", 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078220289999999994 2024-05-10T09:56:56.991 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.307971+0000", 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013645500000000001 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.308071+0000", 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000100344 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.992 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1452 3.2 3:40af27f6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 19.234471159000002, 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01767817, 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1452 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.993 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695062+0000", 2024-05-10T09:56:56.994 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8250000000000001e-06 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.696976+0000", 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019137959999999999 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697003+0000", 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6937e-05 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.995 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697019+0000", 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5608e-05 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697122+0000", 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103108 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697318+0000", 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019647999999999999 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.996 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697507+0000", 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018832199999999999 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.706389+0000", 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088826519999999996 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712570+0000", 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061802460000000004 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.997 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712671+0000", 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101356 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712739+0000", 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7840000000000001e-05 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.998 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1469 3.8 3:108a86fb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.041382+0000", 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.888149258999999, 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016320839, 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1469 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:56.999 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.041382+0000", 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.041382+0000", 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.041386+0000", 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3330000000000001e-06 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.000 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044211+0000", 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028256100000000001 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044262+0000", 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0482000000000002e-05 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044282+0000", 2024-05-10T09:56:57.001 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9847000000000002e-05 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044416+0000", 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000134475 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044708+0000", 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029228000000000001 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.002 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.044974+0000", 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026518700000000001 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.054928+0000", 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0099545959999999996 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057531+0000", 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0026023520000000001 2024-05-10T09:56:57.003 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057628+0000", 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7788000000000006e-05 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057703+0000", 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4888999999999994e-05 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.004 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1474 3.8 3:1087178a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 18.763657133999999, 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020952432999999999, 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1474 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.005 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165879+0000", 2024-05-10T09:56:57.006 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9430000000000002e-06 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169159+0000", 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032809369999999998 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169219+0000", 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9076000000000002e-05 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169249+0000", 2024-05-10T09:56:57.007 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0263000000000001e-05 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169423+0000", 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017407800000000001 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169723+0000", 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029992300000000001 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:56:57.008 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170003+0000", 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000279833 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.177266+0000", 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072636020000000001 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186640+0000", 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093733570000000006 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.009 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186739+0000", 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9893000000000001e-05 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186827+0000", 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7528000000000006e-05 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1887 3.33 3:cd158614:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.17:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:56:57.010 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 6.592131985, 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019080344999999999, 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1887 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:56:57.011 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337403+0000", 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.174e-06 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341495+0000", 2024-05-10T09:56:57.012 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040916449999999997 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341541+0000", 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6479e-05 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341564+0000", 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.302e-05 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.013 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341681+0000", 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011671300000000001 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341815+0000", 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013395599999999999 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.342186+0000", 2024-05-10T09:56:57.014 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037082199999999998 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.351310+0000", 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0091247710000000003 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356148+0000", 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004837465 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.015 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356351+0000", 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000203501 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356480+0000", 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128799 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1893 3.33 3:cc422048:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.18:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 6.4496945620000004, 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018710225, 2024-05-10T09:56:57.016 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1893 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.017 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479841+0000", 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7740000000000002e-06 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482435+0000", 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0025941129999999999 2024-05-10T09:56:57.018 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482480+0000", 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5293000000000002e-05 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482499+0000", 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9097e-05 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482642+0000", 2024-05-10T09:56:57.019 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014218499999999999 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482916+0000", 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274107 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.483932+0000", 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00101651 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.494143+0000", 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01021072 2024-05-10T09:56:57.020 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498209+0000", 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040659700000000003 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498413+0000", 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020437100000000001 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498547+0000", 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013408499999999999 2024-05-10T09:56:57.021 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1902 3.33 3:cd3e2896:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.YRJG_byKm1EBKDGJOVEHATuhMVUz8v3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 6.230594913, 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017675436999999999, 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:57.022 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1902 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.023 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698940+0000", 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2959999999999999e-06 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700682+0000", 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00174215 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700729+0000", 2024-05-10T09:56:57.024 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6551999999999997e-05 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700748+0000", 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9300000000000002e-05 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700854+0000", 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106172 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.025 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.701026+0000", 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017183500000000001 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.701193+0000", 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016689499999999999 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.707156+0000", 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0059631969999999999 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.026 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716488+0000", 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093320360000000002 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716557+0000", 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8948999999999993e-05 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716612+0000", 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5055000000000001e-05 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.027 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1976 3.7 3:e24ca059:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.gklsL-XeFLqdEnn_xAtVod9MtYwPLDr_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.7357575609999998, 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022965886000000001, 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1976 2024-05-10T09:56:57.028 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.029 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193777+0000", 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3450000000000002e-06 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195955+0000", 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021779360000000001 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195985+0000", 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.915e-05 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.030 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195997+0000", 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2558000000000001e-05 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196099+0000", 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101986 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196294+0000", 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000195148 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:56:57.031 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196481+0000", 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018714299999999999 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.202962+0000", 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006480576 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216654+0000", 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013692315 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.032 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216701+0000", 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6674000000000001e-05 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216740+0000", 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9054999999999998e-05 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2122 3.2 3:42ce70a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.54:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:56:57.033 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.749170297, 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018798764999999999, 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2122 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:57.034 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180364+0000", 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.616e-06 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.035 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182719+0000", 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023545929999999999 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182763+0000", 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4697000000000003e-05 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182789+0000", 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5888999999999999e-05 2024-05-10T09:56:57.036 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182951+0000", 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000161385 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.183132+0000", 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001818 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.183815+0000", 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068285299999999998 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.037 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.190483+0000", 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066680910000000001 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199033+0000", 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0085499800000000004 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199109+0000", 2024-05-10T09:56:57.038 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5612999999999996e-05 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199160+0000", 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1248000000000001e-05 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2128 3.1e 3:7be118f4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.55:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.620317649, 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020046877000000001, 2024-05-10T09:56:57.039 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2128 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.040 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309217+0000", 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6400000000000001e-06 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310614+0000", 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013972380000000001 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.041 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310648+0000", 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3769999999999997e-05 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310663+0000", 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5736999999999999e-05 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310767+0000", 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103451 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.042 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.311001+0000", 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023419099999999999 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.311994+0000", 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099253800000000006 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.320683+0000", 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086895289999999997 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.043 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.328917+0000", 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082343520000000003 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.329120+0000", 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000202368 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.329261+0000", 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000141063 2024-05-10T09:56:57.044 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2140 3.b 3:d34911de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.57:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 1.3589414309999999, 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.040965604000000003, 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:57.045 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2140 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.046 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570593+0000", 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3779999999999999e-06 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572513+0000", 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001920242 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572541+0000", 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7620999999999999e-05 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.047 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572551+0000", 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0488e-05 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572638+0000", 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6921000000000003e-05 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572644+0000", 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3099999999999997e-06 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.048 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.601685+0000", 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.029040323999999999 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.601882+0000", 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019714299999999999 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.602550+0000", 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066813699999999996 2024-05-10T09:56:57.049 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.610893+0000", 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.008343306 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611451+0000", 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00055753900000000002 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611496+0000", 2024-05-10T09:56:57.050 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5633000000000002e-05 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611556+0000", 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9562000000000003e-05 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:57.051 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:57.053 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:56:57.053 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.67 2024-05-10T09:56:57.053 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:57.053 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 68 2024-05-10T09:56:57.054 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:57.054 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:57.054 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111114 s, 944 MB/s 2024-05-10T09:56:57.054 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:57.055 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:57.055 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:57.055 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:57.055 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:57.056 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:57.056 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:57.056 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:57.056 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:57.057 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:57.051+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:57.072 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:57.072 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:57.080 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.68 2024-05-10T09:56:57.080 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:57.080 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 69 2024-05-10T09:56:57.090 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:57.090 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:57.090 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00875993 s, 1.2 GB/s 2024-05-10T09:56:57.091 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:57.091 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:57.110 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:57.110 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:57.114 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:57.114 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:57.154 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:57.155+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:57.193 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:57.193 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:57.195 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.69 2024-05-10T09:56:57.195 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:57.195 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 70 2024-05-10T09:56:57.208 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:56:57.209 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:57.209 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:57.209 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108594 s, 966 MB/s 2024-05-10T09:56:57.294 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:57.295+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:57.349 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.70 2024-05-10T09:56:57.349 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:57.349 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 71 2024-05-10T09:56:57.355 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:57.355+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:57.363 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:57.363 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:57.363 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115019 s, 912 MB/s 2024-05-10T09:56:57.374 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:57.374 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:57.388 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:56:57.456 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:57.454+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:57.512 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.71 2024-05-10T09:56:57.512 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:57.512 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 72 2024-05-10T09:56:57.528 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:57.529 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:57.529 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0133954 s, 783 MB/s 2024-05-10T09:56:57.550 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:56:57.554 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:57.555 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:57.557 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:57.555+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:57.569 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:56:57.658 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:57.654+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:57.661 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.72 2024-05-10T09:56:57.661 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:57.661 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 73 2024-05-10T09:56:57.676 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:57.676 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:57.676 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118942 s, 882 MB/s 2024-05-10T09:56:57.737 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:57.738 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:57.752 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:56:57.759 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:57.754+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:57.779 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.73 2024-05-10T09:56:57.780 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:57.780 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 74 2024-05-10T09:56:57.790 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:57.790 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:57.790 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00881695 s, 1.2 GB/s 2024-05-10T09:56:57.860 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:56:57.858+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:56:57.879 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:57.879 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:57.893 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:56:57.929 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.74 2024-05-10T09:56:57.929 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:57.929 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 75 2024-05-10T09:56:57.943 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:57.943 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:57.943 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111103 s, 944 MB/s 2024-05-10T09:56:57.961 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:57.958+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:58.018 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:58.018 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:58.036 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:56:58.066 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.75 2024-05-10T09:56:58.066 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:58.066 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 76 2024-05-10T09:56:58.081 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:58.083+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:58.082 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:58.082 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:58.082 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128417 s, 817 MB/s 2024-05-10T09:56:58.157 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:58.157 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:58.162 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:58.158+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:58.171 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:56:58.202 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.76 2024-05-10T09:56:58.202 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:58.202 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 77 2024-05-10T09:56:58.217 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:58.217 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:58.217 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120306 s, 872 MB/s 2024-05-10T09:56:58.263 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:58.262+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:58.346 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:58.346 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:58.356 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.77 2024-05-10T09:56:58.356 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:58.356 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 78 2024-05-10T09:56:58.360 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:56:58.363 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:58.363+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:58.372 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:58.373 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:58.373 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130149 s, 806 MB/s 2024-05-10T09:56:58.464 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:58.463+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:58.487 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:58.487 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:58.499 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.78 2024-05-10T09:56:58.499 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:58.499 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 79 2024-05-10T09:56:58.502 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:56:58.516 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:58.516 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:58.516 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0135835 s, 772 MB/s 2024-05-10T09:56:58.539 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:56:58.565 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:58.563+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:58.652 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.79 2024-05-10T09:56:58.652 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:58.652 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 80 2024-05-10T09:56:58.654 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:58.654 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:58.665 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:56:58.662+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:56:58.666 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:58.666 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:58.666 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113885 s, 921 MB/s 2024-05-10T09:56:58.673 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:56:58.766 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:58.767+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:58.780 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.80 2024-05-10T09:56:58.780 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:58.780 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 81 2024-05-10T09:56:58.793 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:58.793 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:58.793 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011177 s, 938 MB/s 2024-05-10T09:56:58.847 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:58.847 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:58.862 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:56:58.867 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:58.867+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:58.928 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.81 2024-05-10T09:56:58.928 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:58.928 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 82 2024-05-10T09:56:58.942 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:58.942 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:58.942 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011164 s, 939 MB/s 2024-05-10T09:56:58.968 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:56:58.967+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:56:58.996 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:58.997 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:59.013 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:56:59.054 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.82 2024-05-10T09:56:59.054 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:59.054 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 83 2024-05-10T09:56:59.066 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:59.066 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:59.066 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101487 s, 1.0 GB/s 2024-05-10T09:56:59.069 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:59.067+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:59.115 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:56:59.154 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:56:59.154 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:56:59.169 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:59.166+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:59.172 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:56:59.185 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.83 2024-05-10T09:56:59.185 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:59.185 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 84 2024-05-10T09:56:59.196 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:59.196 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:59.196 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0091869 s, 1.1 GB/s 2024-05-10T09:56:59.269 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:59.266+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:59.294 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:56:59.295 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:56:59.295 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.84 2024-05-10T09:56:59.295 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:59.295 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 85 2024-05-10T09:56:59.305 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:59.306 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:59.306 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00879256 s, 1.2 GB/s 2024-05-10T09:56:59.327 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:56:59.328 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:56:59.339 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:59.339 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:59.339 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:59.339 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:59.339 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:59.356 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:56:59.360 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:56:59.360 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:56:59.383 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:56:59.383 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:56:59.383 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:56:59.378+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:56:59.383 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:56:59.404 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:56:59.405 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:56:59.410 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.85 2024-05-10T09:56:59.410 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:59.410 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 86 2024-05-10T09:56:59.420 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:59.420 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:59.420 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00888349 s, 1.2 GB/s 2024-05-10T09:56:59.426 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:56:59.427 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:56:59.447 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:56:59.448 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:56:59.451 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:56:59.452 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:56:59.470 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:59.471+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:59.489 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:56:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:56:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:56:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4452.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-10T09:56:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:59.489 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 135.840133463, 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.023795910999999999, 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "reached pg", 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4452", 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/570499288", 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:59.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647221+0000", 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647224+0000", 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0170000000000001e-06 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647238+0000", 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.324e-05 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647272+0000", 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4678999999999998e-05 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647297+0000", 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5173000000000001e-05 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647454+0000", 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015651599999999999 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.647468+0000", 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3713999999999999e-05 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654375+0000", 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0069069070000000003 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for peered", 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.654396+0000", 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1016e-05 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.670741+0000", 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016345074000000001 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:54:43.671017+0000", 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027657499999999999 2024-05-10T09:56:59.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1274 3.8 e69/23 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head v 69'3, mlcod=68'1)", 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 27.741605383, 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015717301999999999, 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.495 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745749+0000", 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745751+0000", 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8789999999999999e-06 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748049+0000", 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022981820000000002 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748076+0000", 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6361999999999999e-05 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748093+0000", 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7329e-05 2024-05-10T09:56:59.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748193+0000", 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9562000000000007e-05 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.748228+0000", 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4962999999999997e-05 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761399+0000", 2024-05-10T09:56:59.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013171173 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761467+0000", 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7852e-05 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1275 3.4 3:20482490:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:56:59.499 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 27.734898528999999, 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011423600000000001, 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1275 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752456+0000", 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.752458+0000", 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7039999999999999e-06 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.501 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754116+0000", 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016577129999999999 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754147+0000", 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1782999999999997e-05 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754161+0000", 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3715e-05 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754265+0000", 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103349 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754448+0000", 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018395900000000001 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.754563+0000", 2024-05-10T09:56:59.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000114115 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763241+0000", 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086780859999999998 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763738+0000", 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00049755700000000003 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763816+0000", 2024-05-10T09:56:59.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7987999999999999e-05 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.763880+0000", 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3631000000000001e-05 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1288 3.1a e69/23 3:5902eff1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_16:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:59.505 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 27.587154836, 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013345268, 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900200+0000", 2024-05-10T09:56:59.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.900205+0000", 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1390000000000003e-06 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906219+0000", 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060138969999999998 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906247+0000", 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7881999999999998e-05 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906259+0000", 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2334000000000001e-05 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.508 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906321+0000", 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2045999999999995e-05 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906353+0000", 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1622000000000003e-05 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913476+0000", 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071233490000000002 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913545+0000", 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8998999999999994e-05 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1303 3.6 e69/23 3:6092e388:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.33cIGfqzJAKn8T-a01Elsv2IzHhf8GZ_3:head v 69'2, mlcod=0'0)", 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 27.061809271000001, 2024-05-10T09:56:59.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015397114999999999, 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425546+0000", 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.425547+0000", 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5889999999999999e-06 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428542+0000", 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029953570000000001 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428568+0000", 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5621000000000001e-05 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428582+0000", 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3560999999999999e-05 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428719+0000", 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013757600000000001 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.428764+0000", 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4425999999999998e-05 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.440889+0000", 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012125095000000001 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.440943+0000", 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3890000000000001e-05 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1403 3.25 3:a72e587a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.049976118, 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017687321999999998, 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1403 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.515 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437379+0000", 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.437382+0000", 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2140000000000001e-06 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440350+0000", 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029685520000000002 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440386+0000", 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.5781999999999997e-05 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440404+0000", 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7859e-05 2024-05-10T09:56:59.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440495+0000", 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.0847000000000006e-05 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440670+0000", 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017521099999999999 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:59.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.440835+0000", 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000165098 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.450501+0000", 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0096655430000000004 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.454890+0000", 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0043887639999999999 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.454983+0000", 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3664000000000003e-05 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.455066+0000", 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2787999999999994e-05 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1426 3.25 3:a4c8f94a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:59.520 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.429877846, 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017387981, 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1426 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057477+0000", 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.057479+0000", 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4040000000000002e-06 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059118+0000", 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001638376 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059148+0000", 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0670000000000003e-05 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059164+0000", 2024-05-10T09:56:59.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5916000000000001e-05 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059242+0000", 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8102000000000005e-05 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059368+0000", 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012511799999999999 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.059479+0000", 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000111535 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.063977+0000", 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0044975090000000002 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074740+0000", 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010763503000000001 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074815+0000", 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4590000000000002e-05 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.074865+0000", 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.0257999999999999e-05 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.526 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1427 3.31 3:8c9c1f42:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.418936590000001, 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018352572000000001, 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1427 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068418+0000", 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.068421+0000", 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7590000000000002e-06 2024-05-10T09:56:59.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071398+0000", 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002976762 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071421+0000", 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2949e-05 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071432+0000", 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1265e-05 2024-05-10T09:56:59.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.071590+0000", 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015817300000000001 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.072017+0000", 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00042705199999999998 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.530 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086604+0000", 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01458713 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086676+0000", 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1692000000000004e-05 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.086771+0000", 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.4790000000000006e-05 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.531 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1432 3.6 e71/23 3:63c25752:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_9:head v 71'6, mlcod=71'4)", 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.355942709000001, 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011963349, 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131412+0000", 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.131414+0000", 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6959999999999999e-06 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133867+0000", 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0024533469999999998 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133893+0000", 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5511e-05 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.133905+0000", 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2758999999999999e-05 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.134012+0000", 2024-05-10T09:56:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106496 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.134048+0000", 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6505999999999999e-05 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143310+0000", 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0092617510000000004 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.143375+0000", 2024-05-10T09:56:59.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5283000000000005e-05 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1445 3.0 3:0255dc8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.168630512, 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011906963, 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.536 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1445 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318724+0000", 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.537 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.318727+0000", 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9629999999999998e-06 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320387+0000", 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016598749999999999 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320411+0000", 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3419999999999999e-05 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320421+0000", 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0093e-05 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320492+0000", 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1569999999999994e-05 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320644+0000", 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015139099999999999 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.320805+0000", 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000161469 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.325790+0000", 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0049845879999999999 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330527+0000", 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047375519999999999 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330571+0000", 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3682e-05 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.330631+0000", 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.0359999999999998e-05 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1453 3.25 3:a7a3552c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:59.541 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.777862765999998, 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012007802, 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1453 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709492+0000", 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.709495+0000", 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0290000000000001e-06 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710835+0000", 2024-05-10T09:56:59.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001339556 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710865+0000", 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0808e-05 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710879+0000", 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4039999999999999e-05 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.710961+0000", 2024-05-10T09:56:59.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.1358000000000003e-05 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.711086+0000", 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012547799999999999 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 3", 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.711183+0000", 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.6404999999999996e-05 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.715963+0000", 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047807889999999997 2024-05-10T09:56:59.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721253+0000", 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052894650000000001 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721400+0000", 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014675300000000001 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.721500+0000", 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000100121 2024-05-10T09:56:59.546 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1455 3.21 e72/42 3:848162d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_4:head v 72'4, mlcod=69'2)", 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.747835582, 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011681792, 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739519+0000", 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9400000000000001e-07 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741481+0000", 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019617089999999998 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741520+0000", 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8506e-05 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741543+0000", 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3632999999999999e-05 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741691+0000", 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014779999999999999 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.741744+0000", 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.3359000000000002e-05 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751059+0000", 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093147860000000002 2024-05-10T09:56:59.550 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751201+0000", 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000141705 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1460 3.21 e72/42 3:86cfe81c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_9:head v 72'5, mlcod=71'3)", 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.650198468999999, 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012644017, 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.551 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837156+0000", 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.837159+0000", 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5000000000000002e-06 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840513+0000", 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003354686 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840551+0000", 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7956e-05 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840569+0000", 2024-05-10T09:56:59.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7934000000000001e-05 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840727+0000", 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015768100000000001 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.840790+0000", 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3249000000000004e-05 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.849680+0000", 2024-05-10T09:56:59.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088892490000000001 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.849800+0000", 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012076199999999999 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1469 3.8 e72/23 3:108a86fb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_18:head v 72'5, mlcod=69'3)", 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.442154788, 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012011735000000001, 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.555 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.557 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.557 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.557 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.557 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:59.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045200+0000", 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.045204+0000", 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6430000000000001e-06 2024-05-10T09:56:59.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048886+0000", 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.003681915 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048927+0000", 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1566999999999997e-05 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.048946+0000", 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9076000000000002e-05 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.049107+0000", 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016042199999999999 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.049149+0000", 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2119000000000001e-05 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057149+0000", 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079999349999999997 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.057212+0000", 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3058000000000005e-05 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1474 3.8 e72/23 3:1087178a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_23:head v 72'6, mlcod=69'4)", 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.317033900999999, 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015885412000000002, 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170321+0000", 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170324+0000", 2024-05-10T09:56:59.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175618+0000", 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0052940560000000001 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175659+0000", 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0457000000000002e-05 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.564 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175677+0000", 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8519e-05 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175857+0000", 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018009800000000001 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.175912+0000", 2024-05-10T09:56:59.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.4373000000000003e-05 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186141+0000", 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010229591999999999 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186206+0000", 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.5093999999999997e-05 2024-05-10T09:56:59.566 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1891 3.19 3:9a43e86c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eLGRCzvAKn5Xe45EeKu1jRkfp7sri7Z_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.0229316599999994, 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011028723000000001, 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.567 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1891 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464423+0000", 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.464426+0000", 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.27e-06 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466548+0000", 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021214620000000002 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466591+0000", 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3452999999999999e-05 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466611+0000", 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9986000000000001e-05 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.466751+0000", 2024-05-10T09:56:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013972600000000001 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.467017+0000", 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026603400000000001 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.467259+0000", 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00024156000000000001 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.474806+0000", 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0075472509999999996 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475355+0000", 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00054962000000000001 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475408+0000", 2024-05-10T09:56:59.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.2281999999999999e-05 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.475452+0000", 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4079000000000003e-05 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1916 3.19 3:9bc12e34:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.F65ETUPaF-FOL5UgmtNLtq7r2nquRij_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:59.573 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.5177161419999994, 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012330288999999999, 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1916 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969639+0000", 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.969641+0000", 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5579999999999999e-06 2024-05-10T09:56:59.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971277+0000", 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016355090000000001 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971319+0000", 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1842999999999999e-05 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971338+0000", 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9449999999999998e-05 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971440+0000", 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102027 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971611+0000", 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017066100000000001 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.971786+0000", 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000174928 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981651+0000", 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.009865614 2024-05-10T09:56:59.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981884+0000", 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023318899999999999 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981929+0000", 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4601000000000002e-05 2024-05-10T09:56:59.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.981969+0000", 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9909e-05 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1922 3.21 e76/42 3:84b5b706:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.PBl2-twCS8ooY6U8CbDbsMdnzO_2t6r_1:head v 76'8, mlcod=72'6)", 2024-05-10T09:56:59.580 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.3872940870000008, 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01401399, 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100061+0000", 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.100062+0000", 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.437e-06 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102533+0000", 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002470486 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102571+0000", 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8393000000000003e-05 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102588+0000", 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6592999999999999e-05 2024-05-10T09:56:59.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102784+0000", 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019662099999999999 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.102823+0000", 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8509e-05 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.113950+0000", 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011127386 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114075+0000", 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012456500000000001 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1931 3.0 3:0050c674:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.24:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:56:59.585 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.2389295330000003, 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019806678000000001, 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1931 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.586 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248425+0000", 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.248427+0000", 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2170000000000001e-06 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250923+0000", 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002495588 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250957+0000", 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3994e-05 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.250974+0000", 2024-05-10T09:56:59.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6595999999999998e-05 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.251151+0000", 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000176995 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.251461+0000", 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00031083 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.252422+0000", 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00096011600000000001 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.266082+0000", 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013660603 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.267953+0000", 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018704290000000001 2024-05-10T09:56:59.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.268108+0000", 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000155394 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.268232+0000", 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012391600000000001 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.591 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2158 3.19 3:9937e590:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.60:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.997759+0000", 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.4895957769999999, 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013778871, 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:56:59.592 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2158 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.997759+0000", 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.997759+0000", 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.997761+0000", 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7600000000000001e-06 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.999558+0000", 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017969590000000001 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.999603+0000", 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5073e-05 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.999623+0000", 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.997e-05 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.999730+0000", 2024-05-10T09:56:59.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010687399999999999 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.999858+0000", 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012819 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 2", 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.000330+0000", 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00047185100000000002 2024-05-10T09:56:59.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.007523+0000", 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071929450000000001 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.011452+0000", 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0039296720000000004 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.011501+0000", 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8458999999999998e-05 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.011538+0000", 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7117999999999999e-05 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:56:59.598 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:56:59.599 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:59.600 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:56:59.601 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.86 2024-05-10T09:56:59.601 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:59.601 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 87 2024-05-10T09:56:59.601 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:59.601 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:59.601 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00906009 s, 1.2 GB/s 2024-05-10T09:56:59.602 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:59.599+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:59.622 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.87 2024-05-10T09:56:59.622 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:59.623 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 88 2024-05-10T09:56:59.633 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:59.633 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:59.633 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00917765 s, 1.1 GB/s 2024-05-10T09:56:59.701 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:56:59.699+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:56:59.754 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.88 2024-05-10T09:56:59.754 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:59.755 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 89 2024-05-10T09:56:59.758 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:59.758 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:59.759 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:56:59.759 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:59.767 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:59.767 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:59.767 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105887 s, 990 MB/s 2024-05-10T09:56:59.776 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:56:59.823 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:56:59.822+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:56:59.886 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.89 2024-05-10T09:56:59.886 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:56:59.886 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 90 2024-05-10T09:56:59.899 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:56:59.899 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:56:59.899 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109296 s, 959 MB/s 2024-05-10T09:56:59.902 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:56:59.903+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:56:59.953 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:56:59.954 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:56:59.954 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:56:59.954 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:56:59.954 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:56:59.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:57:00.011 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:00.010+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:00.023 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.90 2024-05-10T09:57:00.023 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:00.023 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 91 2024-05-10T09:57:00.033 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:00.034 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:00.034 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00891109 s, 1.2 GB/s 2024-05-10T09:57:00.100 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:00.100 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:57:00.100 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:57:00.100 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:57:00.100 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1273 3.2d e69/23 3:b59bb266:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_1:head v 69'1, mlcod=0'0)", 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.359223856, 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013030055, 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.101 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.738219+0000", 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.35e-07 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744317+0000", 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060981630000000002 2024-05-10T09:57:00.102 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744349+0000", 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1409999999999999e-05 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744363+0000", 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4742e-05 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744467+0000", 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103656 2024-05-10T09:57:00.103 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.744487+0000", 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9893000000000001e-05 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751184+0000", 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066971670000000004 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.751249+0000", 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4789000000000006e-05 2024-05-10T09:57:00.104 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1285 3.21 3:85614eff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.237862330999999, 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014048458, 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.105 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1285 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859580+0000", 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.106 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.859583+0000", 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.932e-06 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862407+0000", 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028238030000000002 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862436+0000", 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9264999999999998e-05 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.107 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862452+0000", 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6161999999999999e-05 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862553+0000", 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001002 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862721+0000", 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016805100000000001 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:00.108 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.862850+0000", 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012889600000000001 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873327+0000", 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010477288 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873512+0000", 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018525099999999999 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873586+0000", 2024-05-10T09:57:00.109 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3559999999999994e-05 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.873629+0000", 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3050000000000003e-05 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.110 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1396 3.3b e71/23 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head v 71'3, mlcod=68'1)", 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.733926022999999, 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020899485999999998, 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.111 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363517+0000", 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.363519+0000", 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370796+0000", 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00727693 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.112 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370839+0000", 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2802000000000001e-05 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.370857+0000", 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8703e-05 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371003+0000", 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000145668 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.113 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.371048+0000", 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4512999999999999e-05 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384144+0000", 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013096607 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.384416+0000", 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000271883 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.114 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1398 3.2e 3:74667c03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.718703644000001, 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019068742, 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1398 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.115 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378739+0000", 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.378742+0000", 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0299999999999998e-06 2024-05-10T09:57:00.116 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380905+0000", 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021633329999999999 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380931+0000", 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5216e-05 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.380945+0000", 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4579999999999999e-05 2024-05-10T09:57:00.117 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381044+0000", 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.8981000000000007e-05 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381262+0000", 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000218221 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.381455+0000", 2024-05-10T09:57:00.118 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019242599999999999 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.389370+0000", 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0079151280000000004 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397668+0000", 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.008297759 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397742+0000", 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.3872e-05 2024-05-10T09:57:00.119 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.397808+0000", 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6196000000000001e-05 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1413 3.36 e71/42 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head v 71'3, mlcod=69'1)", 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.516888159000001, 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019195001, 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.120 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580554+0000", 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.580561+0000", 2024-05-10T09:57:00.121 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.6420000000000001e-06 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588455+0000", 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078937079999999993 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588485+0000", 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0411000000000001e-05 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.122 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588499+0000", 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.3370000000000001e-05 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588602+0000", 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010296 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.588630+0000", 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8904999999999999e-05 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599682+0000", 2024-05-10T09:57:00.123 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011051963999999999 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.599749+0000", 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7040999999999997e-05 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1417 3.2e 3:75940b06:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.465084287, 2024-05-10T09:57:00.124 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018750408999999999, 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1417 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.125 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632358+0000", 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.632361+0000", 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1030000000000002e-06 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635167+0000", 2024-05-10T09:57:00.126 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0028054070000000002 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635203+0000", 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6476000000000001e-05 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635220+0000", 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6393999999999999e-05 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635311+0000", 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1445000000000003e-05 2024-05-10T09:57:00.127 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635439+0000", 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00012746900000000001 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.635545+0000", 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106335 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.640654+0000", 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0051087379999999998 2024-05-10T09:57:00.128 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651021+0000", 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01036726 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651068+0000", 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.7182999999999999e-05 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:36.651109+0000", 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0599000000000002e-05 2024-05-10T09:57:00.129 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1435 3.3b e71/23 3:dd2501f8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_12:head v 71'4, mlcod=71'2)", 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.919921831, 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011886904, 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.130 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177521+0000", 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.131 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.177523+0000", 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.266e-06 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182873+0000", 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053496560000000004 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182914+0000", 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1134999999999998e-05 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.132 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.182934+0000", 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9922e-05 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.183040+0000", 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010644799999999999 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.183073+0000", 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2756999999999998e-05 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.133 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.189310+0000", 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0062369749999999996 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.189408+0000", 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.7744999999999993e-05 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.134 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1455 3.21 3:848162d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.360664263, 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015185799, 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1455 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.135 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736778+0000", 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.736781+0000", 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.773e-06 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.136 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738650+0000", 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018684820000000001 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738682+0000", 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2483000000000001e-05 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.137 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738697+0000", 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4831000000000001e-05 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.738838+0000", 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014086599999999999 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739132+0000", 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029422999999999998 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.138 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.739328+0000", 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019572 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751391+0000", 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012062969 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751830+0000", 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00043945200000000001 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.139 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751908+0000", 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7391000000000005e-05 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.751964+0000", 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6601999999999998e-05 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.140 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1460 3.21 3:86cfe81c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.262883110000001, 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015558268, 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1460 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.141 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834560+0000", 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.834564+0000", 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9940000000000002e-06 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.142 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836403+0000", 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001839898 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836447+0000", 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3228e-05 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836471+0000", 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4074e-05 2024-05-10T09:57:00.143 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836588+0000", 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000117508 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836798+0000", 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000209934 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:00.144 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.836980+0000", 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018196299999999999 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.842755+0000", 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0057745660000000001 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850035+0000", 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072807139999999998 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.145 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850078+0000", 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.303e-05 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.850118+0000", 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9359e-05 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1462 3.2e 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:00.146 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.217009181000002, 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.025347350000000001, 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1462 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:57:00.147 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880433+0000", 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.880438+0000", 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.9099999999999996e-06 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.148 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882457+0000", 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0020182120000000001 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882501+0000", 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4345999999999999e-05 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882526+0000", 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.4890000000000001e-05 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.149 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.882714+0000", 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018791500000000001 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.883115+0000", 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000401245 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.883513+0000", 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039829500000000001 2024-05-10T09:57:00.150 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.890718+0000", 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072049560000000002 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905553+0000", 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.014834340999999999 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905659+0000", 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010660800000000001 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.151 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.905781+0000", 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000121632 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1465 3.21 3:85e7ecaf:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.147669649000001, 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015113694, 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.152 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1465 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949773+0000", 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.153 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.949778+0000", 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6229999999999996e-06 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952377+0000", 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002599826 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.154 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952419+0000", 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1854999999999998e-05 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952446+0000", 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6526999999999999e-05 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952608+0000", 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016185799999999999 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.155 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.952884+0000", 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027616499999999998 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.953125+0000", 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000241139 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.960413+0000", 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072875539999999999 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.156 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964569+0000", 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0041563540000000001 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964749+0000", 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018009800000000001 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.964887+0000", 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013769499999999999 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.157 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1472 3.2e 3:75ea7f72:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 21.981349183999999, 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.015083343000000001, 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1472 2024-05-10T09:57:00.158 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116093+0000", 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.116097+0000", 2024-05-10T09:57:00.159 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.817e-06 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119039+0000", 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0029415370000000001 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119094+0000", 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5346000000000002e-05 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119116+0000", 2024-05-10T09:57:00.160 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2010000000000001e-05 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119251+0000", 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135096 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119529+0000", 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00027775800000000002 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.119820+0000", 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029083499999999998 2024-05-10T09:57:00.161 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.127004+0000", 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071846330000000002 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.130987+0000", 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0039825379999999999 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.131095+0000", 2024-05-10T09:57:00.162 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001075 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.131177+0000", 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2273000000000003e-05 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1899 3.39 3:9f007745:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.19:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.4791900039999994, 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013350934, 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.163 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1899 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.164 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618253+0000", 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.618255+0000", 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1229999999999998e-06 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620406+0000", 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002151207 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620440+0000", 2024-05-10T09:57:00.165 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4514000000000002e-05 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620452+0000", 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1793999999999999e-05 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620528+0000", 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5919000000000003e-05 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.166 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.620673+0000", 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000144909 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.621126+0000", 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045314800000000001 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631092+0000", 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0099662069999999995 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.167 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631491+0000", 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00039829900000000002 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631555+0000", 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.4424999999999994e-05 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.631604+0000", 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8389e-05 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.168 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1919 3.3b e76/23 3:dd39ec35:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.22:head v 76'6, mlcod=71'4)", 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.1026628639999991, 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012143592, 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:57:00.169 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994780+0000", 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.994782+0000", 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8670000000000001e-06 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001902+0000", 2024-05-10T09:57:00.170 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.007120042 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001929+0000", 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7784e-05 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.001941+0000", 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2002e-05 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.002027+0000", 2024-05-10T09:57:00.171 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.5606000000000007e-05 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.002053+0000", 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5935000000000002e-05 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.006843+0000", 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0047895389999999998 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.006923+0000", 2024-05-10T09:57:00.172 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0816999999999996e-05 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1922 3.21 3:84b5b706:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.PBl2-twCS8ooY6U8CbDbsMdnzO_2t6r_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.9998677140000005, 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016902717000000001, 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.173 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1922 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097575+0000", 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.174 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.097579+0000", 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5360000000000003e-06 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099327+0000", 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001747551 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099369+0000", 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1842999999999999e-05 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.175 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099393+0000", 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3805999999999999e-05 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099496+0000", 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010288100000000001 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099682+0000", 2024-05-10T09:57:00.176 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000186801 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.099867+0000", 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000184811 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.105304+0000", 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054372530000000004 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.177 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114344+0000", 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0090392019999999997 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114419+0000", 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5476999999999996e-05 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.114478+0000", 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.8556e-05 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.178 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1961 3.2d e76/23 3:b4c474b1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.29:head v 76'6, mlcod=75'4)", 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.2369770599999992, 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011668352, 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.179 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860466+0000", 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.860468+0000", 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6199999999999999e-06 2024-05-10T09:57:00.180 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866306+0000", 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0058373210000000003 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866327+0000", 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.1929999999999998e-05 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866342+0000", 2024-05-10T09:57:00.181 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.4259e-05 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866434+0000", 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.1799000000000007e-05 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.866466+0000", 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2787999999999998e-05 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.182 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.872063+0000", 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055964889999999996 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:51.872134+0000", 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.1145999999999999e-05 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:1970 3.3b e76/23 3:dcb16968:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Qq3K6xfP5QCojisff7ShvnV05-qCdEI_1:head v 76'8, mlcod=76'6)", 2024-05-10T09:57:00.183 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.0379264369999994, 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.011621586, 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.184 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059516+0000", 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.059527+0000", 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0621999999999999e-05 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066197+0000", 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066698180000000001 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.185 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066219+0000", 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2691e-05 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066231+0000", 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1382e-05 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066311+0000", 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.0203000000000004e-05 2024-05-10T09:57:00.186 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.066334+0000", 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2597000000000001e-05 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.071082+0000", 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004748932 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.071138+0000", 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5340999999999998e-05 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.187 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2113 3.21 3:86dc3d5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.UACpZEZMOT4QnnYchquwGgVtzVU7_KJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.022151+0000", 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.0752921009999996, 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013509098000000001, 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2113 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.022151+0000", 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.022151+0000", 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.022154+0000", 2024-05-10T09:57:00.189 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2650000000000001e-06 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.024944+0000", 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0027901240000000002 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.024982+0000", 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.8426000000000001e-05 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.190 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.024999+0000", 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6682999999999999e-05 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.025093+0000", 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.3555999999999997e-05 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.025276+0000", 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018377899999999999 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:00.191 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.025445+0000", 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016832199999999999 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.035058+0000", 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0096136069999999997 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.035520+0000", 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00046162200000000002 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.035597+0000", 2024-05-10T09:57:00.192 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.7545000000000004e-05 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.035660+0000", 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.2168999999999994e-05 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:2164 3.36 e78/42 3:6d000b3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.61:head v 78'5, mlcod=71'3)", 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:56.153483+0000", 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.943959859, 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016742610000000002, 2024-05-10T09:57:00.193 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.153483+0000", 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.153483+0000", 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.194 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.153483+0000", 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8299999999999997e-07 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160539+0000", 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0070558490000000003 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160581+0000", 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2225999999999999e-05 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.195 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160600+0000", 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8346e-05 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160766+0000", 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000166692 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.160810+0000", 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.3423000000000001e-05 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.196 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.170136+0000", 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093265080000000007 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.170225+0000", 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.9083000000000001e-05 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.197 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_repop(client.4373.0:2188 3.2d e78/23 3:b5013f7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.65:head v 78'7, mlcod=76'5)", 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:56.689858+0000", 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 3.407585106, 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013410976, 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.689858+0000", 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.198 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.689858+0000", 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.689860+0000", 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2529999999999999e-06 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.694709+0000", 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048492609999999997 2024-05-10T09:57:00.199 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.694740+0000", 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0577000000000002e-05 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.694757+0000", 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.732e-05 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.694903+0000", 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014640399999999999 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.200 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.694942+0000", 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9128000000000002e-05 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.703173+0000", 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082302429999999999 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:56.703269+0000", 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.5790000000000003e-05 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.201 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.202 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.202 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.202 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:00.203 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:57:00.204 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.91 2024-05-10T09:57:00.204 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:00.204 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 92 2024-05-10T09:57:00.204 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:00.204 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:00.204 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00900625 s, 1.2 GB/s 2024-05-10T09:57:00.204 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:00.198+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:00.286 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.92 2024-05-10T09:57:00.286 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:00.286 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 93 2024-05-10T09:57:00.299 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:00.299 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:00.299 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113954 s, 920 MB/s 2024-05-10T09:57:00.304 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:00.303+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:00.390 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:00.390 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:57:00.390 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:57:00.390 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:00.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:57:00.406 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:00.403+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:00.416 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.93 2024-05-10T09:57:00.416 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:00.416 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 94 2024-05-10T09:57:00.427 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:00.427 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:00.427 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101792 s, 1.0 GB/s 2024-05-10T09:57:00.506 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:00.502+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:00.535 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.94 2024-05-10T09:57:00.535 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:00.535 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 95 2024-05-10T09:57:00.543 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:00.543 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:57:00.543 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:57:00.543 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:57:00.543 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:00.547 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:00.548 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:00.548 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101849 s, 1.0 GB/s 2024-05-10T09:57:00.563 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:57:00.565 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:57:00.648 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:00.646+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:00.666 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.95 2024-05-10T09:57:00.666 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:00.666 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 96 2024-05-10T09:57:00.679 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:00.679 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:00.679 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109725 s, 956 MB/s 2024-05-10T09:57:00.708 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:00.706+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:00.732 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:00.732 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1274 3.8 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.987595673000001, 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019336196, 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.733 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1274 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.734 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742479+0000", 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8779999999999998e-06 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745161+0000", 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002682135 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.735 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745185+0000", 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3611000000000001e-05 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745194+0000", 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2369999999999998e-06 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745266+0000", 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2008000000000006e-05 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.736 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745445+0000", 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179259 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745624+0000", 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017874300000000001 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756109+0000", 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010485169000000001 2024-05-10T09:57:00.737 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761680+0000", 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055706649999999998 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761755+0000", 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5171000000000002e-05 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761813+0000", 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.732e-05 2024-05-10T09:57:00.738 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1281 3.29 3:94644cd5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.913462145, 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021096073, 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.739 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1281 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.740 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816613+0000", 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.892e-06 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818489+0000", 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018760599999999999 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818531+0000", 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2070000000000002e-05 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.741 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818554+0000", 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2776e-05 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818664+0000", 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011037899999999999 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818882+0000", 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000217457 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.742 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.819053+0000", 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000171187 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.824533+0000", 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054798609999999999 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837622+0000", 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013089751 2024-05-10T09:57:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837669+0000", 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6517000000000002e-05 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837706+0000", 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7122999999999997e-05 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.744 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1289 3.38 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.825828257000001, 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022792125999999999, 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1289 2024-05-10T09:57:00.745 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904247+0000", 2024-05-10T09:57:00.746 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1939999999999998e-06 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906042+0000", 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017947239999999999 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906083+0000", 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0948999999999997e-05 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.747 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906101+0000", 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8442999999999999e-05 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906204+0000", 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103359 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906378+0000", 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000173435 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906536+0000", 2024-05-10T09:57:00.748 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015819099999999999 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913717+0000", 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071811230000000002 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926882+0000", 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013164765 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926966+0000", 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3579999999999996e-05 2024-05-10T09:57:00.749 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927036+0000", 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0363000000000004e-05 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1292 3.38 3:1ea9eee7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.793341822999999, 2024-05-10T09:57:00.750 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01900717, 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1292 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.751 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936734+0000", 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4149999999999999e-06 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938852+0000", 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021187630000000001 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.752 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938883+0000", 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0494999999999999e-05 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938901+0000", 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7988000000000001e-05 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938993+0000", 2024-05-10T09:57:00.753 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2383e-05 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939177+0000", 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018371699999999999 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939324+0000", 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014727499999999999 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.754 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.944680+0000", 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053554379999999997 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955600+0000", 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010920487 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955670+0000", 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0202000000000003e-05 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.755 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955737+0000", 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7007000000000004e-05 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1296 3.2 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.709253709999999, 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021264584, 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.756 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1296 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:57:00.757 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020821+0000", 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3259999999999998e-06 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.021993+0000", 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001172071 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022024+0000", 2024-05-10T09:57:00.758 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1222e-05 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022035+0000", 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1449e-05 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022149+0000", 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011391399999999999 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.759 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022369+0000", 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220079 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022596+0000", 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000226288 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.028699+0000", 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006103163 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.760 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042000+0000", 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013301006000000001 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042047+0000", 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6990999999999998e-05 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042083+0000", 2024-05-10T09:57:00.761 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6075000000000003e-05 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1298 3.29 3:979982e8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 28.683952076000001, 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018739767000000001, 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.762 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1298 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.763 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046121+0000", 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.508e-06 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047357+0000", 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001235683 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047388+0000", 2024-05-10T09:57:00.764 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0549000000000002e-05 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047404+0000", 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6676000000000001e-05 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047484+0000", 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9212e-05 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047618+0000", 2024-05-10T09:57:00.765 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013448600000000001 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.048073+0000", 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045510599999999999 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.055269+0000", 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071963189999999996 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.766 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064647+0000", 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093774919999999994 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064781+0000", 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013422999999999999 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.767 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064860+0000", 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8505999999999997e-05 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1434 3.33 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.574281095, 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020822112, 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.768 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1434 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.769 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155794+0000", 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9100000000000001e-06 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157707+0000", 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001912757 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157746+0000", 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9848999999999997e-05 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.770 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157763+0000", 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6059999999999999e-05 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157837+0000", 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4952999999999999e-05 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157951+0000", 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011310400000000001 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.771 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.158086+0000", 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135122 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.164123+0000", 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060373429999999997 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176486+0000", 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012362556 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176558+0000", 2024-05-10T09:57:00.772 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2453000000000006e-05 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176613+0000", 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5004999999999999e-05 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1438 3.1e 3:7ac7bc5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.517739862999999, 2024-05-10T09:57:00.773 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017363922, 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1438 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.774 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212335+0000", 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.83e-06 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214003+0000", 2024-05-10T09:57:00.775 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016675240000000001 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214028+0000", 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5939e-05 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214046+0000", 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7655999999999998e-05 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214129+0000", 2024-05-10T09:57:00.776 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2793000000000005e-05 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214293+0000", 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163616 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214409+0000", 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116944 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.219268+0000", 2024-05-10T09:57:00.777 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048583680000000001 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229606+0000", 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010338174 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229647+0000", 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1415999999999998e-05 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.778 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229696+0000", 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8662000000000003e-05 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1441 3.2 3:4091da54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.467933095999999, 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020721976999999999, 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.779 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1441 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.780 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262142+0000", 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9019999999999999e-06 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265147+0000", 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030048340000000001 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.781 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265183+0000", 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6233999999999999e-05 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265206+0000", 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2866000000000001e-05 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265319+0000", 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113183 2024-05-10T09:57:00.782 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265430+0000", 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110772 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265532+0000", 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102746 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.783 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.269542+0000", 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040093459999999996 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282625+0000", 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013083252 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282761+0000", 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135446 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.784 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282861+0000", 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010039600000000001 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1452 3.2 3:40af27f6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 23.035011484999998, 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01767817, 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.785 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1452 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.786 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695062+0000", 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8250000000000001e-06 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.696976+0000", 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019137959999999999 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.787 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697003+0000", 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6937e-05 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697019+0000", 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5608e-05 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697122+0000", 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103108 2024-05-10T09:57:00.788 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697318+0000", 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019647999999999999 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697507+0000", 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018832199999999999 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.706389+0000", 2024-05-10T09:57:00.789 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088826519999999996 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712570+0000", 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061802460000000004 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712671+0000", 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101356 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.790 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712739+0000", 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7840000000000001e-05 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1474 3.8 3:1087178a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 22.564197459999999, 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020952432999999999, 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.791 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1474 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.792 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165879+0000", 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9430000000000002e-06 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169159+0000", 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032809369999999998 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.793 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169219+0000", 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9076000000000002e-05 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169249+0000", 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0263000000000001e-05 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169423+0000", 2024-05-10T09:57:00.794 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017407800000000001 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169723+0000", 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029992300000000001 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170003+0000", 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000279833 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.177266+0000", 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072636020000000001 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186640+0000", 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093733570000000006 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186739+0000", 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9893000000000001e-05 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.796 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186827+0000", 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7528000000000006e-05 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1887 3.33 3:cd158614:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.17:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.392672311, 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019080344999999999, 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.797 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1887 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337403+0000", 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.174e-06 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341495+0000", 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040916449999999997 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.799 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341541+0000", 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6479e-05 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341564+0000", 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.302e-05 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341681+0000", 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011671300000000001 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.800 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341815+0000", 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013395599999999999 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.342186+0000", 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037082199999999998 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.351310+0000", 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0091247710000000003 2024-05-10T09:57:00.801 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356148+0000", 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004837465 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356351+0000", 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000203501 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.802 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356480+0000", 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128799 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1893 3.33 3:cc422048:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.18:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.250234888, 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018710225, 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.803 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1893 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:57:00.804 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479841+0000", 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7740000000000002e-06 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482435+0000", 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0025941129999999999 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.805 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482480+0000", 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5293000000000002e-05 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482499+0000", 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9097e-05 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482642+0000", 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014218499999999999 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.806 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482916+0000", 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274107 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.483932+0000", 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00101651 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.494143+0000", 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01021072 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.807 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498209+0000", 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040659700000000003 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498413+0000", 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020437100000000001 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498547+0000", 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013408499999999999 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.808 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1902 3.33 3:cd3e2896:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.YRJG_byKm1EBKDGJOVEHATuhMVUz8v3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 10.031135238999999, 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017675436999999999, 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1902 2024-05-10T09:57:00.809 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.810 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698940+0000", 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2959999999999999e-06 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700682+0000", 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00174215 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700729+0000", 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6551999999999997e-05 2024-05-10T09:57:00.811 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700748+0000", 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9300000000000002e-05 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700854+0000", 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106172 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.701026+0000", 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017183500000000001 2024-05-10T09:57:00.812 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.701193+0000", 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016689499999999999 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.707156+0000", 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0059631969999999999 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.813 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716488+0000", 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093320360000000002 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716557+0000", 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8948999999999993e-05 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716612+0000", 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5055000000000001e-05 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.814 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1976 3.7 3:e24ca059:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.gklsL-XeFLqdEnn_xAtVod9MtYwPLDr_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.5362978869999999, 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022965886000000001, 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1976 2024-05-10T09:57:00.815 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193777+0000", 2024-05-10T09:57:00.816 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3450000000000002e-06 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195955+0000", 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021779360000000001 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195985+0000", 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.915e-05 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195997+0000", 2024-05-10T09:57:00.817 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2558000000000001e-05 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196099+0000", 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101986 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196294+0000", 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000195148 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.818 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196481+0000", 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018714299999999999 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.202962+0000", 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006480576 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216654+0000", 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013692315 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.819 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216701+0000", 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6674000000000001e-05 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216740+0000", 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9054999999999998e-05 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2122 3.2 3:42ce70a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.54:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:57:00.820 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.5497106230000002, 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018798764999999999, 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2122 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.821 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180364+0000", 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.616e-06 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.822 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182719+0000", 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023545929999999999 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182763+0000", 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4697000000000003e-05 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182789+0000", 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5888999999999999e-05 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.823 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182951+0000", 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000161385 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.183132+0000", 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001818 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.183815+0000", 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068285299999999998 2024-05-10T09:57:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.190483+0000", 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066680910000000001 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199033+0000", 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0085499800000000004 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.825 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199109+0000", 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5612999999999996e-05 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199160+0000", 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1248000000000001e-05 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2128 3.1e 3:7be118f4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.55:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:00.826 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.4208579749999997, 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020046877000000001, 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2128 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.827 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309217+0000", 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6400000000000001e-06 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.828 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310614+0000", 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013972380000000001 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310648+0000", 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3769999999999997e-05 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310663+0000", 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5736999999999999e-05 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310767+0000", 2024-05-10T09:57:00.829 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103451 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.311001+0000", 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023419099999999999 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.311994+0000", 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099253800000000006 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.830 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.320683+0000", 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086895289999999997 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.328917+0000", 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082343520000000003 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.329120+0000", 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000202368 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.831 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.329261+0000", 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000141063 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2140 3.b 3:d34911de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.57:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 5.159481757, 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.040965604000000003, 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.832 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.833 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.833 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2140 2024-05-10T09:57:00.833 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.833 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.833 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.833 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:57:00.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.834 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.834 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.834 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:57:00.834 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.834 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570593+0000", 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3779999999999999e-06 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572513+0000", 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001920242 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.835 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572541+0000", 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7620999999999999e-05 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572551+0000", 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0488e-05 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572638+0000", 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6921000000000003e-05 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:57:00.836 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572644+0000", 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3099999999999997e-06 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.601685+0000", 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.029040323999999999 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.601882+0000", 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019714299999999999 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:00.837 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.602550+0000", 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066813699999999996 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.610893+0000", 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.008343306 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611451+0000", 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00055753900000000002 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.838 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611496+0000", 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5633000000000002e-05 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611556+0000", 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9562000000000003e-05 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.839 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.840 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2336 3.b 3:d13e4b02:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.88:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:00.840 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:59.736622+0000", 2024-05-10T09:57:00.840 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.99344991599999999, 2024-05-10T09:57:00.840 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016551976999999999, 2024-05-10T09:57:00.840 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.840 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2336 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.841 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.736622+0000", 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.736622+0000", 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.736626+0000", 2024-05-10T09:57:00.842 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4039999999999999e-06 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738219+0000", 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015937119999999999 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738266+0000", 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6288999999999997e-05 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.843 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738286+0000", 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9996999999999998e-05 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738393+0000", 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000107384 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.844 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738607+0000", 2024-05-10T09:57:00.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021451700000000001 2024-05-10T09:57:00.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.845 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.845 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:00.845 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.739119+0000", 2024-05-10T09:57:00.845 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051198200000000002 2024-05-10T09:57:00.845 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.745132+0000", 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00601244 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.753031+0000", 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078996489999999999 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.846 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.753118+0000", 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6558999999999996e-05 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.753174+0000", 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6044000000000001e-05 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.847 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2366 3.24 3:27812f03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.93:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:57:00.398278+0000", 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 0.33179436400000001, 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016415886000000001, 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2366 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.848 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.398278+0000", 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.398278+0000", 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.398280+0000", 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.204e-06 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.849 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.400528+0000", 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022485019999999999 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.400559+0000", 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0639000000000003e-05 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.400571+0000", 2024-05-10T09:57:00.850 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1857e-05 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.400769+0000", 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000197701 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.401029+0000", 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026064399999999998 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.414424+0000", 2024-05-10T09:57:00.851 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013394315 2024-05-10T09:57:00.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:00.852 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.414552+0000", 2024-05-10T09:57:00.852 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128109 2024-05-10T09:57:00.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:00.852 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:00.852 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:00.853 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.414694+0000", 2024-05-10T09:57:00.853 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000141915 2024-05-10T09:57:00.853 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.853 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.853 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.853 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:00.854 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:00.854 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:00.855 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:57:00.856 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.96 2024-05-10T09:57:00.856 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:00.856 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 97 2024-05-10T09:57:00.856 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:00.856 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:00.856 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00893346 s, 1.2 GB/s 2024-05-10T09:57:00.857 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:00.855+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:00.879 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.97 2024-05-10T09:57:00.879 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:00.879 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 98 2024-05-10T09:57:00.889 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:00.889 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:00.889 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00875394 s, 1.2 GB/s 2024-05-10T09:57:00.956 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:00.955+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:00.996 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:00.996 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:00.996 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:00.996 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:01.000 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.98 2024-05-10T09:57:01.000 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:01.000 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 99 2024-05-10T09:57:01.011 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:57:01.014 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:01.014 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:01.014 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113103 s, 927 MB/s 2024-05-10T09:57:01.057 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:01.054+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:01.135 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.99 2024-05-10T09:57:01.136 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:01.136 INFO:tasks.workunit.client.0.smithi042.stdout:uploading file - part 100 2024-05-10T09:57:01.151 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records in 2024-05-10T09:57:01.151 INFO:tasks.workunit.client.0.smithi042.stderr:1+0 records out 2024-05-10T09:57:01.151 INFO:tasks.workunit.client.0.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125192 s, 838 MB/s 2024-05-10T09:57:01.158 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:01.154+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:01.180 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:01.180 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:01.180 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:01.180 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:01.180 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:01.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:57:01.259 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:01.259+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:01.321 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:01.321 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:01.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:01.322 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:01.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.322 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1278 3.2f 3:f571631c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:01.322 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 29.534648815000001, 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024049979999999999, 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1278 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786219+0000", 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:57:01.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790848+0000", 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046288800000000001 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790903+0000", 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5396000000000003e-05 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790931+0000", 2024-05-10T09:57:01.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7852999999999999e-05 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791091+0000", 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000160085 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791356+0000", 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026496799999999997 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791614+0000", 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000258304 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.801355+0000", 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097402099999999991 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810050+0000", 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086953199999999994 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810149+0000", 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9086000000000006e-05 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810266+0000", 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116655 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1282 3.1d 3:bb239e62:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:01.328 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 29.491733993, 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032019191000000002, 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1282 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:01.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829134+0000", 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1700000000000001e-06 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.833983+0000", 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048496269999999996 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834016+0000", 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2459999999999998e-05 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834034+0000", 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8427000000000002e-05 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834157+0000", 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122502 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834453+0000", 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029603700000000003 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834694+0000", 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024105099999999999 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.857709+0000", 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023014703000000001 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.860974+0000", 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032658309999999999 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861076+0000", 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010209600000000001 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861150+0000", 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3287000000000005e-05 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1283 3.37 e69/23 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head v 69'2, mlcod=0'0)", 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 29.475812951999998, 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021592063000000002, 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.334 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845054+0000", 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7e-06 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848409+0000", 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003354938 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848451+0000", 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2259999999999999e-05 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848477+0000", 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5829e-05 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848600+0000", 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122516 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848685+0000", 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4759000000000006e-05 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866565+0000", 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017880391999999998 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866644+0000", 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8669000000000002e-05 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.338 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1290 3.1d 3:ba11a2de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 29.403229249999999, 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026748503999999999, 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1290 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917638+0000", 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0570000000000001e-06 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922152+0000", 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045138899999999996 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922203+0000", 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0649000000000002e-05 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922222+0000", 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9470000000000002e-05 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922397+0000", 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174575 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922662+0000", 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026555799999999999 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922907+0000", 2024-05-10T09:57:01.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024483699999999997 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.937015+0000", 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014107511 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944214+0000", 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071986680000000001 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944311+0000", 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7806000000000005e-05 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944384+0000", 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2483000000000004e-05 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1425 3.3a 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.274352965999999, 2024-05-10T09:57:01.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.031419395000000003, 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1425 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046517+0000", 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2639999999999999e-06 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055240+0000", 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.008723158 2024-05-10T09:57:01.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055281+0000", 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1344999999999998e-05 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055301+0000", 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9317000000000002e-05 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055513+0000", 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021243799999999999 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055925+0000", 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041220299999999998 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.056338+0000", 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041247899999999999 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.071484+0000", 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015146359 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077627+0000", 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0061428050000000003 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077805+0000", 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017845400000000001 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077931+0000", 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000125573 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1429 3.16 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 24.229556379000002, 2024-05-10T09:57:01.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029834811999999999, 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1429 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:01.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091311+0000", 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.914e-06 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095902+0000", 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045904589999999999 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095938+0000", 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6043e-05 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095955+0000", 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7096e-05 2024-05-10T09:57:01.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096104+0000", 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149555 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096348+0000", 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024343499999999999 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096601+0000", 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025365799999999998 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.104881+0000", 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082796310000000008 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120963+0000", 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016081813 2024-05-10T09:57:01.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121062+0000", 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9098999999999994e-05 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121143+0000", 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1108999999999999e-05 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1471 3.30 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 23.228668698, 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024868991999999999, 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1471 2024-05-10T09:57:01.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.358 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092198+0000", 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.125e-06 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096157+0000", 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039586839999999996 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096182+0000", 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096192+0000", 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0208e-05 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096269+0000", 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7440000000000004e-05 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096403+0000", 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013410700000000001 2024-05-10T09:57:01.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096528+0000", 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000124583 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.105347+0000", 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088185999999999994 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.116955+0000", 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011608408000000001 2024-05-10T09:57:01.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117015+0000", 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0024e-05 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117065+0000", 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9804e-05 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1905 3.2f 3:f5382682:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.20:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.596347441000001, 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028534713999999999, 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1905 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724520+0000", 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.18e-06 2024-05-10T09:57:01.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729154+0000", 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046339730000000004 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729189+0000", 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4592999999999999e-05 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729206+0000", 2024-05-10T09:57:01.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6776e-05 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729382+0000", 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017638500000000001 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729814+0000", 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043171600000000001 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731011+0000", 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011970920000000001 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752773+0000", 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021762020999999999 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752812+0000", 2024-05-10T09:57:01.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8745999999999998e-05 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752928+0000", 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116209 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.753052+0000", 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012402299999999999 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1937 3.2f 3:f6f6baab:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.25:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.9469071190000005, 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026117703999999999, 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1937 2024-05-10T09:57:01.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373960+0000", 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5670000000000002e-06 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379641+0000", 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056814070000000003 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379683+0000", 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2061999999999998e-05 2024-05-10T09:57:01.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379703+0000", 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9284e-05 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379865+0000", 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016189199999999999 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.380132+0000", 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026777000000000002 2024-05-10T09:57:01.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.381015+0000", 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088269599999999998 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399852+0000", 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018836617999999999 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399878+0000", 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6489999999999999e-05 2024-05-10T09:57:01.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399998+0000", 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119848 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.400075+0000", 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7070000000000006e-05 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1973 3.5 3:a1f16109:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.2415275549999993, 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028713439, 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1973 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.375 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079348+0000", 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0657e-05 2024-05-10T09:57:01.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086193+0000", 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068454780000000003 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086236+0000", 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3037000000000001e-05 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086255+0000", 2024-05-10T09:57:01.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9233e-05 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086456+0000", 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020071499999999999 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086733+0000", 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027707300000000002 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.087656+0000", 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092309200000000003 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.102599+0000", 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014942802 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.107828+0000", 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052284740000000003 2024-05-10T09:57:01.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.107964+0000", 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013623199999999999 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.108050+0000", 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6645999999999997e-05 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2107 3.16 3:6a82f1ca:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.aLkE1IIwI-rn4NM5LcNsVAHTPsdo775_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.4078785119999999, 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028119945, 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2107 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.381 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912989+0000", 2024-05-10T09:57:01.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.247e-06 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918424+0000", 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0054344689999999999 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918463+0000", 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9113000000000003e-05 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918482+0000", 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9133000000000001e-05 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918644+0000", 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162122 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918903+0000", 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025855399999999998 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:01.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919141+0000", 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023880400000000001 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940101+0000", 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020959489000000001 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940932+0000", 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083094899999999999 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.941029+0000", 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6818999999999996e-05 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.941106+0000", 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7245999999999999e-05 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2137 3.2f 3:f6ad2590:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.yGx-M_1fRYuiuQbEbInWygrGjnT5iDR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.7777025670000004, 2024-05-10T09:57:01.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022207608, 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2137 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543165+0000", 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.18e-06 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547129+0000", 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039639030000000004 2024-05-10T09:57:01.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547166+0000", 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6798999999999998e-05 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547186+0000", 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9930000000000001e-05 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547326+0000", 2024-05-10T09:57:01.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000139856 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547601+0000", 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000275784 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547841+0000", 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000239328 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.558095+0000", 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0102538 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565152+0000", 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0070571230000000002 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565257+0000", 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105609 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565370+0000", 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2146 3.1d 3:bb76e098:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.58:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.6069736590000003, 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021432795000000001, 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.392 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2146 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:01.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713895+0000", 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6330000000000002e-06 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718065+0000", 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041700779999999998 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718100+0000", 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5753000000000001e-05 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718119+0000", 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8822999999999999e-05 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718256+0000", 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013706499999999999 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718553+0000", 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029665699999999998 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735024+0000", 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016470752000000002 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735152+0000", 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012824599999999999 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735324+0000", 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000171788 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2167 3.3a 3:5ef9c6fa:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.bsQ4R-YmbxyKTsJlXW_D8e5jFgO7sdf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.0730313090000001, 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025214065000000001, 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.397 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2167 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247837+0000", 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8130000000000002e-06 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253565+0000", 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057278429999999998 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253606+0000", 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0833e-05 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253625+0000", 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253834+0000", 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020904499999999999 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.254089+0000", 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025492400000000001 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.254325+0000", 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000236135 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.267487+0000", 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013161599 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.272763+0000", 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052764830000000002 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.272931+0000", 2024-05-10T09:57:01.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167992 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.273047+0000", 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116155 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2194 3.3c 3:3f67e664:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.66:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:01.403 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.491170908, 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021265557000000001, 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2194 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:01.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829696+0000", 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8929999999999999e-06 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833704+0000", 2024-05-10T09:57:01.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004008752 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833740+0000", 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5654000000000001e-05 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833757+0000", 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6719e-05 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833885+0000", 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012875199999999999 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.834158+0000", 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027250799999999997 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.835048+0000", 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088997399999999997 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850116+0000", 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015068386 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850685+0000", 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000568941 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850828+0000", 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143022 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850959+0000", 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000130956 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2203 3.28 3:16fb63cd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.j_muk18MFUKbGsDVkAszcThPL-QGWVn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.2849244110000004, 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022345793999999999, 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.409 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2203 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:01.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035943+0000", 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3500000000000001e-06 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041480+0000", 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055363060000000004 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041521+0000", 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1389e-05 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041547+0000", 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5476000000000001e-05 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041727+0000", 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018054200000000001 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.042130+0000", 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040300999999999998 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.042556+0000", 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000425449 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.056051+0000", 2024-05-10T09:57:01.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013495316 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.057960+0000", 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001908732 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.058103+0000", 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143032 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.058286+0000", 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018319199999999999 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2321 3.16 3:69f47c7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.C5zaz_jZPpN7K1ZkpLeLlXZlOQ8ERKH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.8435252609999999, 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032499368000000001, 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.415 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2321 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477342+0000", 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8940000000000002e-06 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.482982+0000", 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056399060000000001 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483021+0000", 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9035999999999997e-05 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483040+0000", 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.931e-05 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483582+0000", 2024-05-10T09:57:01.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054127500000000002 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.484601+0000", 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001019308 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.484870+0000", 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026938400000000001 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509174+0000", 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024303347999999999 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509663+0000", 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00048905900000000002 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509758+0000", 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5025000000000006e-05 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509839+0000", 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0822999999999995e-05 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2352 3.2f 3:f4edcb95:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.2252464409999999, 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02589953, 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.421 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2352 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095622+0000", 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9990000000000002e-06 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099686+0000", 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040635690000000004 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099726+0000", 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0025999999999999e-05 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099750+0000", 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4726e-05 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099925+0000", 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017460899999999999 2024-05-10T09:57:01.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100301+0000", 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037587999999999999 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100684+0000", 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038319599999999998 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.119874+0000", 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019189601000000001 2024-05-10T09:57:01.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121342+0000", 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014683319999999999 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121442+0000", 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010002599999999999 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121518+0000", 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5566000000000001e-05 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2351 3.35 e79/23 3:af2cb2f3:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_1:head v 79'5, mlcod=76'3)", 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.2204609500000001, 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023516426999999999, 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.427 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100406+0000", 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2170000000000001e-06 2024-05-10T09:57:01.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104021+0000", 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036155039999999999 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104043+0000", 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1594999999999999e-05 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104053+0000", 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0097e-05 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104184+0000", 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013099800000000001 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104248+0000", 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3869999999999997e-05 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123837+0000", 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019589242999999999 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123920+0000", 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2903000000000002e-05 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2393 3.c 3:33d28053:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.oOdbEiZ85yVFHLJP5wjZrtebUNQ-W6m_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:01.431 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.37341157899999999, 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02373809, 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2393 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:01.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947458+0000", 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7360000000000001e-06 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953476+0000", 2024-05-10T09:57:01.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060187670000000004 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953521+0000", 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4833000000000003e-05 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953548+0000", 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.669e-05 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953764+0000", 2024-05-10T09:57:01.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021636800000000001 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.954027+0000", 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026231099999999999 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.954256+0000", 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022928400000000001 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.968494+0000", 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014237619 2024-05-10T09:57:01.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971002+0000", 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0025080739999999999 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971100+0000", 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7899000000000006e-05 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971191+0000", 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1508999999999994e-05 2024-05-10T09:57:01.436 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:01.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:01.437 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:01.438 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:57:01.439 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:01.434+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:01.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:57:01.538 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:01.539+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:01.543 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:57:01.617 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:01.618 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:01.621 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:57:01.621 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:57:01.632 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:57:01.640 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:57:01.641 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:57:01.657 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:57:01.657 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:57:01.674 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:57:01.674 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:57:01.674 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:57:01.674 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:01.675+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:01.693 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:57:01.693 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:57:01.712 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:57:01.713 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:57:01.730 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:57:01.730 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:57:01.734 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:57:01.734 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:57:01.739 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:01.738+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:01.798 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:01.798 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:01.812 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:57:01.840 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:01.838+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:01.929 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:01.929 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:01.942 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:01.938+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:01.943 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:57:02.042 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:02.038+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:02.069 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:02.069 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:02.086 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:57:02.144 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:02.142+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:02.204 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:02.204 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:02.220 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:57:02.244 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:02.242+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:02.343 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:02.343 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:02.345 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:02.347+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:02.357 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:57:02.446 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:02.442+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:02.497 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:02.497 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:02.505 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [4] live_osds: [0, 1, 2, 3, 5, 6, 7] 2024-05-10T09:57:02.505 INFO:tasks.thrashosds.thrasher:Reviving osd 4 2024-05-10T09:57:02.506 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T09:57:02.506 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T09:57:02.508 INFO:tasks.ceph.osd.4:Started 2024-05-10T09:57:02.508 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:57:02.514 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:57:02.553 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:02.555+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:02.639 INFO:teuthology.orchestra.run.smithi181.stderr:no valid command found; 10 closest matches: 2024-05-10T09:57:02.639 INFO:teuthology.orchestra.run.smithi181.stderr:0 2024-05-10T09:57:02.639 INFO:teuthology.orchestra.run.smithi181.stderr:1 2024-05-10T09:57:02.639 INFO:teuthology.orchestra.run.smithi181.stderr:2 2024-05-10T09:57:02.639 INFO:teuthology.orchestra.run.smithi181.stderr:abort 2024-05-10T09:57:02.640 INFO:teuthology.orchestra.run.smithi181.stderr:assert 2024-05-10T09:57:02.640 INFO:teuthology.orchestra.run.smithi181.stderr:config diff 2024-05-10T09:57:02.640 INFO:teuthology.orchestra.run.smithi181.stderr:config diff get 2024-05-10T09:57:02.640 INFO:teuthology.orchestra.run.smithi181.stderr:config get 2024-05-10T09:57:02.640 INFO:teuthology.orchestra.run.smithi181.stderr:config help [] 2024-05-10T09:57:02.641 INFO:teuthology.orchestra.run.smithi181.stderr:config set ... 2024-05-10T09:57:02.641 INFO:teuthology.orchestra.run.smithi181.stderr:admin_socket: invalid command 2024-05-10T09:57:02.642 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-10T09:57:02.642 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-4, ['dump_ops_in_flight'] 2024-05-10T09:57:02.676 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:02.676 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:02.685 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:02.687+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:02.691 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:57:02.748 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:02.746+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:02.849 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:02.849 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:02.849 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:02.846+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:02.864 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:57:02.951 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:02.950+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:03.037 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:03.037 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:03.051 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:03.046+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:03.052 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:57:03.135 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:03.135+0000 7f664be797c0 -1 Falling back to public interface 2024-05-10T09:57:03.152 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:03.151+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:03.222 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:03.222 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:03.236 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:57:03.253 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:03.251+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:03.354 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:03.355+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:03.371 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:03.371 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:03.386 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:57:03.455 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:03.450+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:03.544 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:03.544 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:03.555 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:03.554+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:03.559 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:57:03.570 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:57:03.656 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:03.654+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:03.730 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:03.730 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:03.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:57:03.745 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:57:03.787 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:03.786+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:03.858 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:03.854+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:03.906 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:57:03.907 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:57:03.912 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:03.912 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:03.924 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:57:03.924 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:57:03.928 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:57:03.945 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:57:03.945 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:57:03.959 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:03.959+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:03.962 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:57:03.962 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:57:03.962 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:57:03.983 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:57:03.983 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:57:04.006 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:57:04.007 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:57:04.043 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:57:04.044 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:57:04.047 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:57:04.047 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:57:04.077 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:04.077 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:57:04.077 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:57:04.077 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:04.078 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:04.074+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:04.096 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:57:04.160 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:04.159+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:04.261 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:04.258+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:04.269 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:04.269 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:57:04.269 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:57:04.269 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:57:04.270 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:04.288 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:57:04.375 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:04.374+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:04.462 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:04.458+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 20, 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 600, 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [ 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1274 3.8 3:11a60969:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 32.718150178999998, 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019336196, 2024-05-10T09:57:04.467 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1274 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:57:04.468 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742476+0000", 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.742479+0000", 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.8779999999999998e-06 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745161+0000", 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.002682135 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745185+0000", 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3611000000000001e-05 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.470 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745194+0000", 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2369999999999998e-06 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745266+0000", 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2008000000000006e-05 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745445+0000", 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000179259 2024-05-10T09:57:04.471 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.745624+0000", 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017874300000000001 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.756109+0000", 2024-05-10T09:57:04.472 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010485169000000001 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761680+0000", 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0055706649999999998 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761755+0000", 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5171000000000002e-05 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.473 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.761813+0000", 2024-05-10T09:57:04.474 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.732e-05 2024-05-10T09:57:04.474 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.474 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.474 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.474 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.474 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.474 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1281 3.29 3:94644cd5:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:04.474 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 32.644016651000001, 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021096073, 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1281 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.475 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816610+0000", 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.816613+0000", 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.892e-06 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.476 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.477 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818489+0000", 2024-05-10T09:57:04.477 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0018760599999999999 2024-05-10T09:57:04.477 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.477 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.477 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818531+0000", 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.2070000000000002e-05 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818554+0000", 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2776e-05 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818664+0000", 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011037899999999999 2024-05-10T09:57:04.478 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.818882+0000", 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000217457 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.819053+0000", 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000171187 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.479 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.824533+0000", 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0054798609999999999 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837622+0000", 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013089751 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837669+0000", 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6517000000000002e-05 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.480 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.837706+0000", 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7122999999999997e-05 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1289 3.38 3:1e6035dd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 32.556382763000002, 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022792125999999999, 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.481 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1289 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.482 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904244+0000", 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.904247+0000", 2024-05-10T09:57:04.483 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1939999999999998e-06 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906042+0000", 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0017947239999999999 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906083+0000", 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.0948999999999997e-05 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.484 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906101+0000", 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8442999999999999e-05 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906204+0000", 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103359 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906378+0000", 2024-05-10T09:57:04.485 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000173435 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.906536+0000", 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00015819099999999999 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.913717+0000", 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071811230000000002 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.486 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926882+0000", 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013164765 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.926966+0000", 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.3579999999999996e-05 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.927036+0000", 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0363000000000004e-05 2024-05-10T09:57:04.487 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1292 3.38 3:1ea9eee7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 32.523896329000003, 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01900717, 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1292 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936730+0000", 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.489 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.936734+0000", 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4149999999999999e-06 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938852+0000", 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021187630000000001 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938883+0000", 2024-05-10T09:57:04.490 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0494999999999999e-05 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938901+0000", 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7988000000000001e-05 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.938993+0000", 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.2383e-05 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.491 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939177+0000", 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018371699999999999 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.939324+0000", 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014727499999999999 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.944680+0000", 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0053554379999999997 2024-05-10T09:57:04.492 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955600+0000", 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010920487 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955670+0000", 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.0202000000000003e-05 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.493 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:31.955737+0000", 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7007000000000004e-05 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1296 3.2 3:421ba532:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 32.439808216000003, 2024-05-10T09:57:04.494 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.021264584, 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1296 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.495 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020818+0000", 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.020821+0000", 2024-05-10T09:57:04.496 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3259999999999998e-06 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.021993+0000", 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001172071 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022024+0000", 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.1222e-05 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.497 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022035+0000", 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1449e-05 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022149+0000", 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011391399999999999 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.498 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022369+0000", 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000220079 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.022596+0000", 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000226288 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.028699+0000", 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006103163 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.499 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042000+0000", 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013301006000000001 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042047+0000", 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6990999999999998e-05 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.500 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.042083+0000", 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6075000000000003e-05 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1298 3.29 3:979982e8:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 32.414506582000001, 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018739767000000001, 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.501 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1298 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.502 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046120+0000", 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.046121+0000", 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.508e-06 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.503 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047357+0000", 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001235683 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047388+0000", 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0549000000000002e-05 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047404+0000", 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6676000000000001e-05 2024-05-10T09:57:04.504 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047484+0000", 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.9212e-05 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.047618+0000", 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013448600000000001 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:04.505 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.048073+0000", 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00045510599999999999 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.055269+0000", 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0071963189999999996 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064647+0000", 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093774919999999994 2024-05-10T09:57:04.506 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064781+0000", 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013422999999999999 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:32.064860+0000", 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.8505999999999997e-05 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.507 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1434 3.33 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 27.304835601000001, 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020822112, 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.508 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1434 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155791+0000", 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.509 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.155794+0000", 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9100000000000001e-06 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157707+0000", 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001912757 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.510 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157746+0000", 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9848999999999997e-05 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157763+0000", 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.6059999999999999e-05 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157837+0000", 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.4952999999999999e-05 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.511 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.157951+0000", 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011310400000000001 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.158086+0000", 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135122 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.512 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.164123+0000", 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0060373429999999997 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176486+0000", 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.012362556 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176558+0000", 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.2453000000000006e-05 2024-05-10T09:57:04.513 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.176613+0000", 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5004999999999999e-05 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1438 3.1e 3:7ac7bc5c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:57:04.514 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 27.248294369, 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017363922, 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1438 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.515 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212332+0000", 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.516 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.212335+0000", 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.83e-06 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214003+0000", 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0016675240000000001 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214028+0000", 2024-05-10T09:57:04.517 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5939e-05 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214046+0000", 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.7655999999999998e-05 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214129+0000", 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.2793000000000005e-05 2024-05-10T09:57:04.518 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214293+0000", 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000163616 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.214409+0000", 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000116944 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.519 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.219268+0000", 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0048583680000000001 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229606+0000", 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.010338174 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229647+0000", 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.1415999999999998e-05 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.520 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.229696+0000", 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.8662000000000003e-05 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1441 3.2 3:4091da54:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 27.198487602, 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020721976999999999, 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.521 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1441 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:57:04.522 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262139+0000", 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.262142+0000", 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.9019999999999999e-06 2024-05-10T09:57:04.523 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265147+0000", 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0030048340000000001 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265183+0000", 2024-05-10T09:57:04.524 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.6233999999999999e-05 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265206+0000", 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.2866000000000001e-05 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265319+0000", 2024-05-10T09:57:04.525 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000113183 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265430+0000", 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000110772 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.265532+0000", 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000102746 2024-05-10T09:57:04.526 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.269542+0000", 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040093459999999996 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282625+0000", 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013083252 2024-05-10T09:57:04.527 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282761+0000", 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000135446 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.282861+0000", 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00010039600000000001 2024-05-10T09:57:04.528 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1452 3.2 3:40af27f6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 26.765565990999999, 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01767817, 2024-05-10T09:57:04.529 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1452 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.530 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695061+0000", 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.531 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.695062+0000", 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.8250000000000001e-06 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.696976+0000", 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0019137959999999999 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697003+0000", 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6937e-05 2024-05-10T09:57:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697019+0000", 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5608e-05 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697122+0000", 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103108 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.533 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697318+0000", 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019647999999999999 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.697507+0000", 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018832199999999999 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.534 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.706389+0000", 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0088826519999999996 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712570+0000", 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0061802460000000004 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712671+0000", 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101356 2024-05-10T09:57:04.535 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:37.712739+0000", 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.7840000000000001e-05 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1474 3.8 3:1087178a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:57:04.536 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 26.294751966, 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020952432999999999, 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1474 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.537 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165875+0000", 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.165879+0000", 2024-05-10T09:57:04.538 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9430000000000002e-06 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169159+0000", 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0032809369999999998 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169219+0000", 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9076000000000002e-05 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.539 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169249+0000", 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0263000000000001e-05 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169423+0000", 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017407800000000001 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.169723+0000", 2024-05-10T09:57:04.540 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00029992300000000001 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 1", 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.170003+0000", 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000279833 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.177266+0000", 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0072636020000000001 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.541 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186640+0000", 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093733570000000006 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186739+0000", 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 9.9893000000000001e-05 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:38.186827+0000", 2024-05-10T09:57:04.542 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.7528000000000006e-05 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1887 3.33 3:cd158614:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.17:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 14.123226817000001, 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.019080344999999999, 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.543 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1887 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.544 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337400+0000", 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.337403+0000", 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.174e-06 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341495+0000", 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040916449999999997 2024-05-10T09:57:04.545 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341541+0000", 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6479e-05 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341564+0000", 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.302e-05 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.546 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341681+0000", 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00011671300000000001 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.341815+0000", 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013395599999999999 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.342186+0000", 2024-05-10T09:57:04.547 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00037082199999999998 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.351310+0000", 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0091247710000000003 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356148+0000", 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.004837465 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.548 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356351+0000", 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000203501 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.356480+0000", 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128799 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.549 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1893 3.33 3:cc422048:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.18:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.980789394, 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018710225, 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.550 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1893 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479837+0000", 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.551 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.479841+0000", 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.7740000000000002e-06 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482435+0000", 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0025941129999999999 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.552 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482480+0000", 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5293000000000002e-05 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482499+0000", 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9097e-05 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482642+0000", 2024-05-10T09:57:04.553 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00014218499999999999 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.482916+0000", 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000274107 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.483932+0000", 2024-05-10T09:57:04.554 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00101651 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.494143+0000", 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.01021072 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498209+0000", 2024-05-10T09:57:04.555 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0040659700000000003 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498413+0000", 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00020437100000000001 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.498547+0000", 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00013408499999999999 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.556 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1902 3.33 3:cd3e2896:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.YRJG_byKm1EBKDGJOVEHATuhMVUz8v3_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 13.761689745, 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.017675436999999999, 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.557 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1902 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:57:04.558 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698937+0000", 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.698940+0000", 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.2959999999999999e-06 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.559 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700682+0000", 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00174215 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700729+0000", 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6551999999999997e-05 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700748+0000", 2024-05-10T09:57:04.560 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9300000000000002e-05 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.700854+0000", 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000106172 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.701026+0000", 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00017183500000000001 2024-05-10T09:57:04.561 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.701193+0000", 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00016689499999999999 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.707156+0000", 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0059631969999999999 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.562 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716488+0000", 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0093320360000000002 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716557+0000", 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.8948999999999993e-05 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:50.716612+0000", 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.5055000000000001e-05 2024-05-10T09:57:04.563 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:1976 3.7 3:e24ca059:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.gklsL-XeFLqdEnn_xAtVod9MtYwPLDr_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 12.266852393000001, 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.022965886000000001, 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.564 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 1976 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193774+0000", 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.565 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.193777+0000", 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3450000000000002e-06 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195955+0000", 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0021779360000000001 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.566 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195985+0000", 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.915e-05 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.195997+0000", 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.2558000000000001e-05 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196099+0000", 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000101986 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.567 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196294+0000", 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000195148 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.196481+0000", 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00018714299999999999 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.202962+0000", 2024-05-10T09:57:04.568 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.006480576 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216654+0000", 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013692315 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216701+0000", 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6674000000000001e-05 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.569 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:52.216740+0000", 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.9054999999999998e-05 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2122 3.2 3:42ce70a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.54:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.280265129, 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.018798764999999999, 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.570 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2122 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:57:04.571 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180361+0000", 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.572 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.180364+0000", 2024-05-10T09:57:04.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.616e-06 2024-05-10T09:57:04.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.573 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.573 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182719+0000", 2024-05-10T09:57:04.573 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0023545929999999999 2024-05-10T09:57:04.573 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.573 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182763+0000", 2024-05-10T09:57:04.574 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.4697000000000003e-05 2024-05-10T09:57:04.574 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.574 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.574 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.574 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182789+0000", 2024-05-10T09:57:04.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.5888999999999999e-05 2024-05-10T09:57:04.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.575 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.575 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.182951+0000", 2024-05-10T09:57:04.575 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000161385 2024-05-10T09:57:04.575 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.575 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.183132+0000", 2024-05-10T09:57:04.576 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0001818 2024-05-10T09:57:04.576 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.576 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.576 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:04.576 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.183815+0000", 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00068285299999999998 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.190483+0000", 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0066680910000000001 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.577 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199033+0000", 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0085499800000000004 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199109+0000", 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 7.5612999999999996e-05 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.199160+0000", 2024-05-10T09:57:04.578 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.1248000000000001e-05 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2128 3.1e 3:7be118f4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.55:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 9.1514124809999995, 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.020046877000000001, 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.579 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2128 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309214+0000", 2024-05-10T09:57:04.580 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.309217+0000", 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.6400000000000001e-06 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310614+0000", 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0013972380000000001 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.581 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310648+0000", 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.3769999999999997e-05 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310663+0000", 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.5736999999999999e-05 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.582 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.310767+0000", 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000103451 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.311001+0000", 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00023419099999999999 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.311994+0000", 2024-05-10T09:57:04.583 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00099253800000000006 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.320683+0000", 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0086895289999999997 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.328917+0000", 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0082343520000000003 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.584 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.329120+0000", 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000202368 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.329261+0000", 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000141063 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.585 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2140 3.b 3:d34911de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.57:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 8.8900362630000007, 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.040965604000000003, 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2140 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.586 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570590+0000", 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.570593+0000", 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.3779999999999999e-06 2024-05-10T09:57:04.587 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572513+0000", 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.001920242 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572541+0000", 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.7620999999999999e-05 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.588 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572551+0000", 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.0488e-05 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572638+0000", 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6921000000000003e-05 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op must wait for map", 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.572644+0000", 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 6.3099999999999997e-06 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.589 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.601685+0000", 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.029040323999999999 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.601882+0000", 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00019714299999999999 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.602550+0000", 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00066813699999999996 2024-05-10T09:57:04.590 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.610893+0000", 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.008343306 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611451+0000", 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00055753900000000002 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.591 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611496+0000", 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.5633000000000002e-05 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:55.611556+0000", 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.9562000000000003e-05 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2336 3.b 3:d13e4b02:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.88:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:56:59.736622+0000", 2024-05-10T09:57:04.592 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.7240044220000001, 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016551976999999999, 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2336 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.593 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.736622+0000", 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.736622+0000", 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.736626+0000", 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.4039999999999999e-06 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.594 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738219+0000", 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0015937119999999999 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738266+0000", 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 4.6288999999999997e-05 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738286+0000", 2024-05-10T09:57:04.595 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.9996999999999998e-05 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738393+0000", 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000107384 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.738607+0000", 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00021451700000000001 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:04.596 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.739119+0000", 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00051198200000000002 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.745132+0000", 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00601244 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.753031+0000", 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0078996489999999999 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.597 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.753118+0000", 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 8.6558999999999996e-05 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:56:59.753174+0000", 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 5.6044000000000001e-05 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.598 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "description": "osd_op(client.4373.0:2366 3.24 3:27812f03:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.93:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "initiated_at": "2024-05-10T09:57:00.398278+0000", 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "age": 4.0623488700000001, 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.016415886000000001, 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "continuous": false, 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "type_data": { 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "client_info": { 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "client": "client.4373", 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "tid": 2366 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.599 INFO:teuthology.orchestra.run.smithi042.stdout: "events": [ 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "initiated", 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.398278+0000", 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "header_read", 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.398278+0000", 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "throttled", 2024-05-10T09:57:04.600 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.398280+0000", 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 2.204e-06 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "all_read", 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.400528+0000", 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.0022485019999999999 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "dispatched", 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.400559+0000", 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 3.0639000000000003e-05 2024-05-10T09:57:04.601 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "queued_for_pg", 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.400571+0000", 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 1.1857e-05 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "reached_pg", 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.400769+0000", 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000197701 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "started", 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.401029+0000", 2024-05-10T09:57:04.602 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.00026064399999999998 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "op_commit", 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.414424+0000", 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.013394315 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "commit_sent", 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.414552+0000", 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000128109 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:04.603 INFO:teuthology.orchestra.run.smithi042.stdout: "event": "done", 2024-05-10T09:57:04.604 INFO:teuthology.orchestra.run.smithi042.stdout: "time": "2024-05-10T09:57:00.414694+0000", 2024-05-10T09:57:04.604 INFO:teuthology.orchestra.run.smithi042.stdout: "duration": 0.000141915 2024-05-10T09:57:04.604 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.604 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.604 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.604 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:04.604 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:04.604 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:04.606 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:57:04.607 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:57:04.607 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:04.602+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:04.707 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:04.702+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:04.738 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:04.738 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:04.739 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:04.739 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:04.752 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:57:04.807 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:04.807+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:04.877 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:04.877 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:04.877 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:04.878 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:04.878 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:04.892 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:57:04.908 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:04.906+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:05.009 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:05.011+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:05.066 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1278 3.2f 3:f571631c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.278001441999997, 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024049979999999999, 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.067 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1278 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786219+0000", 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790848+0000", 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046288800000000001 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790903+0000", 2024-05-10T09:57:05.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5396000000000003e-05 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790931+0000", 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7852999999999999e-05 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791091+0000", 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000160085 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791356+0000", 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026496799999999997 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791614+0000", 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000258304 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.801355+0000", 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097402099999999991 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810050+0000", 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086953199999999994 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810149+0000", 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9086000000000006e-05 2024-05-10T09:57:05.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810266+0000", 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116655 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1282 3.1d 3:bb239e62:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:05.073 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.235086619999997, 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032019191000000002, 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1282 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829134+0000", 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1700000000000001e-06 2024-05-10T09:57:05.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.833983+0000", 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048496269999999996 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834016+0000", 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2459999999999998e-05 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834034+0000", 2024-05-10T09:57:05.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8427000000000002e-05 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834157+0000", 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122502 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834453+0000", 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029603700000000003 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834694+0000", 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024105099999999999 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.857709+0000", 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023014703000000001 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.860974+0000", 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032658309999999999 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861076+0000", 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010209600000000001 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861150+0000", 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3287000000000005e-05 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.079 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1283 3.37 e69/23 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head v 69'2, mlcod=0'0)", 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.219165578999998, 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021592063000000002, 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.080 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.081 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845054+0000", 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7e-06 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848409+0000", 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003354938 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848451+0000", 2024-05-10T09:57:05.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2259999999999999e-05 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848477+0000", 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5829e-05 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848600+0000", 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122516 2024-05-10T09:57:05.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848685+0000", 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4759000000000006e-05 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866565+0000", 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017880391999999998 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866644+0000", 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8669000000000002e-05 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1290 3.1d 3:ba11a2de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.146581877000003, 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026748503999999999, 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.085 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1290 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917638+0000", 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0570000000000001e-06 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922152+0000", 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045138899999999996 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922203+0000", 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0649000000000002e-05 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922222+0000", 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9470000000000002e-05 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922397+0000", 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174575 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922662+0000", 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026555799999999999 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922907+0000", 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024483699999999997 2024-05-10T09:57:05.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.937015+0000", 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014107511 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944214+0000", 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071986680000000001 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944311+0000", 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7806000000000005e-05 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944384+0000", 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2483000000000004e-05 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1425 3.3a 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.017705592999999, 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.031419395000000003, 2024-05-10T09:57:05.091 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1425 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:05.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046517+0000", 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2639999999999999e-06 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055240+0000", 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.008723158 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055281+0000", 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1344999999999998e-05 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055301+0000", 2024-05-10T09:57:05.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9317000000000002e-05 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055513+0000", 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021243799999999999 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055925+0000", 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041220299999999998 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.056338+0000", 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041247899999999999 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.071484+0000", 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015146359 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077627+0000", 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0061428050000000003 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077805+0000", 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017845400000000001 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077931+0000", 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000125573 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.097 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1429 3.16 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 27.972909005999998, 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029834811999999999, 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1429 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.098 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091311+0000", 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.914e-06 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095902+0000", 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045904589999999999 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095938+0000", 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6043e-05 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095955+0000", 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7096e-05 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096104+0000", 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149555 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096348+0000", 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024343499999999999 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096601+0000", 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025365799999999998 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.104881+0000", 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082796310000000008 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.102 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120963+0000", 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016081813 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121062+0000", 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9098999999999994e-05 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121143+0000", 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1108999999999999e-05 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.103 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1471 3.30 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 26.972021325, 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024868991999999999, 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.104 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1471 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:05.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092198+0000", 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.125e-06 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096157+0000", 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039586839999999996 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096182+0000", 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096192+0000", 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0208e-05 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096269+0000", 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7440000000000004e-05 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096403+0000", 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013410700000000001 2024-05-10T09:57:05.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096528+0000", 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000124583 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.105347+0000", 2024-05-10T09:57:05.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088185999999999994 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.116955+0000", 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011608408000000001 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117015+0000", 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0024e-05 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117065+0000", 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9804e-05 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1905 3.2f 3:f5382682:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.20:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.339700068000001, 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028534713999999999, 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.112 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1905 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724520+0000", 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.18e-06 2024-05-10T09:57:05.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729154+0000", 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046339730000000004 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729189+0000", 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4592999999999999e-05 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729206+0000", 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6776e-05 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729382+0000", 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017638500000000001 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.116 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729814+0000", 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043171600000000001 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731011+0000", 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011970920000000001 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752773+0000", 2024-05-10T09:57:05.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021762020999999999 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752812+0000", 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8745999999999998e-05 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752928+0000", 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116209 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.753052+0000", 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012402299999999999 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1937 3.2f 3:f6f6baab:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.25:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.690259746000001, 2024-05-10T09:57:05.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026117703999999999, 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1937 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373960+0000", 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5670000000000002e-06 2024-05-10T09:57:05.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379641+0000", 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056814070000000003 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379683+0000", 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2061999999999998e-05 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379703+0000", 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9284e-05 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379865+0000", 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016189199999999999 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.380132+0000", 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026777000000000002 2024-05-10T09:57:05.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.381015+0000", 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088269599999999998 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399852+0000", 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018836617999999999 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399878+0000", 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6489999999999999e-05 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399998+0000", 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119848 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.400075+0000", 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7070000000000006e-05 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.125 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1973 3.5 3:a1f16109:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 12.984880181999999, 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028713439, 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.126 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1973 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079348+0000", 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0657e-05 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086193+0000", 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068454780000000003 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086236+0000", 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3037000000000001e-05 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086255+0000", 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9233e-05 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086456+0000", 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020071499999999999 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086733+0000", 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027707300000000002 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.087656+0000", 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092309200000000003 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.102599+0000", 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014942802 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.107828+0000", 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052284740000000003 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.107964+0000", 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013623199999999999 2024-05-10T09:57:05.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.108050+0000", 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6645999999999997e-05 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2107 3.16 3:6a82f1ca:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.aLkE1IIwI-rn4NM5LcNsVAHTPsdo775_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.151231139, 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028119945, 2024-05-10T09:57:05.132 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2107 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912989+0000", 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.247e-06 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918424+0000", 2024-05-10T09:57:05.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0054344689999999999 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918463+0000", 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9113000000000003e-05 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918482+0000", 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9133000000000001e-05 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.135 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918644+0000", 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162122 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918903+0000", 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025855399999999998 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919141+0000", 2024-05-10T09:57:05.136 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023880400000000001 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940101+0000", 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020959489000000001 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940932+0000", 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083094899999999999 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.137 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.941029+0000", 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6818999999999996e-05 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.941106+0000", 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7245999999999999e-05 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.138 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2137 3.2f 3:f6ad2590:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.yGx-M_1fRYuiuQbEbInWygrGjnT5iDR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.5210551940000006, 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022207608, 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2137 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.139 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543165+0000", 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.18e-06 2024-05-10T09:57:05.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547129+0000", 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039639030000000004 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547166+0000", 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6798999999999998e-05 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547186+0000", 2024-05-10T09:57:05.141 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9930000000000001e-05 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547326+0000", 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000139856 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547601+0000", 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000275784 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.142 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547841+0000", 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000239328 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.558095+0000", 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0102538 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.143 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565152+0000", 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0070571230000000002 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565257+0000", 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105609 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565370+0000", 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2024-05-10T09:57:05.144 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2146 3.1d 3:bb76e098:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.58:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.3503262859999996, 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021432795000000001, 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.145 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2146 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:05.146 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713895+0000", 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6330000000000002e-06 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718065+0000", 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041700779999999998 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.147 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718100+0000", 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5753000000000001e-05 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718119+0000", 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8822999999999999e-05 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718256+0000", 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013706499999999999 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.148 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718553+0000", 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029665699999999998 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735024+0000", 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016470752000000002 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735152+0000", 2024-05-10T09:57:05.149 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012824599999999999 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735324+0000", 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000171788 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2167 3.3a 3:5ef9c6fa:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.bsQ4R-YmbxyKTsJlXW_D8e5jFgO7sdf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:05.150 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.8163839359999994, 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025214065000000001, 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2167 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.151 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247837+0000", 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8130000000000002e-06 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253565+0000", 2024-05-10T09:57:05.152 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057278429999999998 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253606+0000", 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0833e-05 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253625+0000", 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.153 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253834+0000", 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020904499999999999 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.254089+0000", 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025492400000000001 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.254325+0000", 2024-05-10T09:57:05.154 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000236135 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.267487+0000", 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013161599 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.272763+0000", 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052764830000000002 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.155 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.272931+0000", 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167992 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.273047+0000", 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116155 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2194 3.3c 3:3f67e664:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.66:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:05.156 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.2345235349999992, 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021265557000000001, 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2194 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.157 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.158 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829696+0000", 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8929999999999999e-06 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833704+0000", 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004008752 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.159 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833740+0000", 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5654000000000001e-05 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833757+0000", 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6719e-05 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833885+0000", 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012875199999999999 2024-05-10T09:57:05.160 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.834158+0000", 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027250799999999997 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.835048+0000", 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088997399999999997 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.161 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850116+0000", 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015068386 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850685+0000", 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000568941 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850828+0000", 2024-05-10T09:57:05.162 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143022 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850959+0000", 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000130956 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2203 3.28 3:16fb63cd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.j_muk18MFUKbGsDVkAszcThPL-QGWVn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:05.163 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.0282770380000006, 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022345793999999999, 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2203 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:05.164 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035943+0000", 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3500000000000001e-06 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.165 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041480+0000", 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055363060000000004 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041521+0000", 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1389e-05 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041547+0000", 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5476000000000001e-05 2024-05-10T09:57:05.166 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041727+0000", 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018054200000000001 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.042130+0000", 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040300999999999998 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.167 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.042556+0000", 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000425449 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.056051+0000", 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013495316 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.057960+0000", 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001908732 2024-05-10T09:57:05.168 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.058103+0000", 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143032 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.058286+0000", 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018319199999999999 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.169 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2321 3.16 3:69f47c7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.C5zaz_jZPpN7K1ZkpLeLlXZlOQ8ERKH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.5868778880000001, 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032499368000000001, 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2321 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.170 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477342+0000", 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8940000000000002e-06 2024-05-10T09:57:05.171 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.482982+0000", 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056399060000000001 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483021+0000", 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9035999999999997e-05 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483040+0000", 2024-05-10T09:57:05.172 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.931e-05 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483582+0000", 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054127500000000002 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.484601+0000", 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001019308 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.173 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.484870+0000", 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026938400000000001 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509174+0000", 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024303347999999999 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509663+0000", 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00048905900000000002 2024-05-10T09:57:05.174 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509758+0000", 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5025000000000006e-05 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509839+0000", 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0822999999999995e-05 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.175 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2352 3.2f 3:f4edcb95:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.9685990679999996, 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02589953, 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2352 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.176 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095622+0000", 2024-05-10T09:57:05.177 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9990000000000002e-06 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099686+0000", 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040635690000000004 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099726+0000", 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0025999999999999e-05 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.178 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099750+0000", 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4726e-05 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099925+0000", 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017460899999999999 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100301+0000", 2024-05-10T09:57:05.179 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037587999999999999 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100684+0000", 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038319599999999998 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.119874+0000", 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019189601000000001 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.180 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121342+0000", 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014683319999999999 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121442+0000", 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010002599999999999 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121518+0000", 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5566000000000001e-05 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.181 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2351 3.35 e79/23 3:af2cb2f3:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_1:head v 79'5, mlcod=76'3)", 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.9638135769999998, 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023516426999999999, 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.182 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100406+0000", 2024-05-10T09:57:05.183 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2170000000000001e-06 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104021+0000", 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036155039999999999 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104043+0000", 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1594999999999999e-05 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.184 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104053+0000", 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0097e-05 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104184+0000", 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013099800000000001 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104248+0000", 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3869999999999997e-05 2024-05-10T09:57:05.185 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123837+0000", 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019589242999999999 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123920+0000", 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2903000000000002e-05 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.186 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2393 3.c 3:33d28053:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.oOdbEiZ85yVFHLJP5wjZrtebUNQ-W6m_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.116764206, 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02373809, 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.187 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2393 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.188 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947458+0000", 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7360000000000001e-06 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953476+0000", 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060187670000000004 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953521+0000", 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4833000000000003e-05 2024-05-10T09:57:05.189 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953548+0000", 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.669e-05 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953764+0000", 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021636800000000001 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.190 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.954027+0000", 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026231099999999999 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.954256+0000", 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022928400000000001 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.968494+0000", 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014237619 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.191 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971002+0000", 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0025080739999999999 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971100+0000", 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7899000000000006e-05 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971191+0000", 2024-05-10T09:57:05.192 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1508999999999994e-05 2024-05-10T09:57:05.193 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.193 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.193 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.193 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.193 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.193 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:05.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:57:05.195 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:05.190+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:05.296 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:05.295+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:05.367 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:05.367 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:05.367 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:05.367 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:05.382 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:57:05.396 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:05.394+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:05.497 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:05.494+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:05.550 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:05.550 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:05.550 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:05.550 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:05.551 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:05.564 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:57:05.613 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:05.615+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:05.685 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:05.686 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:05.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:05.686 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:05.686 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.686 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:57:05.686 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:05.686 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 137.99851321400001, 2024-05-10T09:57:05.686 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.687 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.688 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:57:05.689 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:57:05.690 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.691 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:57:05.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1279 3.a 3:51af0144:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:05.693 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.888989793999997, 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025099606, 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1279 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796337+0000", 2024-05-10T09:57:05.695 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5070000000000002e-06 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802095+0000", 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057576520000000003 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802133+0000", 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8349000000000002e-05 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.696 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802153+0000", 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9993e-05 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802280+0000", 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012646599999999999 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802566+0000", 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028610300000000001 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:05.697 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802791+0000", 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022570199999999999 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.816789+0000", 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013997486 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821159+0000", 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043700240000000001 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.698 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821316+0000", 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156735 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821432+0000", 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116589 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.699 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1284 3.36 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.834626944999997, 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02296221, 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1284 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.700 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.701 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850699+0000", 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1240000000000001e-06 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855070+0000", 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043709580000000003 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.702 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855111+0000", 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1310000000000003e-05 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855134+0000", 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2860000000000001e-05 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855272+0000", 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013803099999999999 2024-05-10T09:57:05.703 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855551+0000", 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027930799999999998 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855782+0000", 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000231361 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.704 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866830+0000", 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011047631 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873500+0000", 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066699089999999999 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873591+0000", 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1448999999999998e-05 2024-05-10T09:57:05.705 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873658+0000", 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6268999999999999e-05 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1287 3.2c 3:364c59b2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.800189465000003, 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024099597, 2024-05-10T09:57:05.706 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1287 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:05.707 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885136+0000", 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8040000000000002e-06 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.708 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889464+0000", 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043279219999999997 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889499+0000", 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5199e-05 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889515+0000", 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6422999999999998e-05 2024-05-10T09:57:05.709 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889643+0000", 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012816600000000001 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889903+0000", 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025949099999999999 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.890132+0000", 2024-05-10T09:57:05.710 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022953700000000001 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.902988+0000", 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012855171 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909041+0000", 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060532249999999998 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909155+0000", 2024-05-10T09:57:05.711 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011380200000000001 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909233+0000", 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7856999999999997e-05 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1413 3.36 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:05.712 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 29.108415997000002, 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024918131999999999, 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1413 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.713 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576908+0000", 2024-05-10T09:57:05.714 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581066+0000", 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004157244 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581103+0000", 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6973e-05 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.715 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581120+0000", 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7343e-05 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581261+0000", 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000140672 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581530+0000", 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026880099999999999 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.716 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581772+0000", 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000242754 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.590838+0000", 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090655300000000005 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601650+0000", 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010812307 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.717 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601751+0000", 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100766 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601825+0000", 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3635999999999998e-05 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.718 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1424 3.a 3:50b58fe7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.652139767000001, 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02028814, 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1424 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.719 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033186+0000", 2024-05-10T09:57:05.720 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3840000000000001e-06 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039575+0000", 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063893420000000001 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039613+0000", 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7518999999999998e-05 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.721 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039630+0000", 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.751e-05 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039808+0000", 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178025 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.040103+0000", 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000294531 2024-05-10T09:57:05.722 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053142+0000", 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013038696000000001 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053249+0000", 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107255 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.723 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053471+0000", 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022187800000000001 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1430 3.3f e71/23 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head v 71'3, mlcod=71'1)", 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.577189831999998, 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017678704999999999, 2024-05-10T09:57:05.724 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.725 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108135+0000", 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4269999999999998e-06 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111069+0000", 2024-05-10T09:57:05.726 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029336520000000001 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111113+0000", 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4193000000000002e-05 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111132+0000", 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9157e-05 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.727 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111305+0000", 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000172621 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111372+0000", 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6935999999999997e-05 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.125674+0000", 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014302199999999999 2024-05-10T09:57:05.728 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.125811+0000", 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013751900000000001 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1434 3.33 e71/23 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head v 71'1, mlcod=0'0)", 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.525494517999999, 2024-05-10T09:57:05.729 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017779593, 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.730 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159831+0000", 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.903e-06 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165818+0000", 2024-05-10T09:57:05.731 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005987643 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165855+0000", 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6866000000000002e-05 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165872+0000", 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6793e-05 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.166014+0000", 2024-05-10T09:57:05.732 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014216200000000001 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.166081+0000", 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.648e-05 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177476+0000", 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011395621 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177607+0000", 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131125 2024-05-10T09:57:05.733 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1444 3.26 3:66bf84d6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 28.381042096000002, 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020383655000000001, 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.734 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1444 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.735 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304284+0000", 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5300000000000001e-06 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309335+0000", 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050508920000000004 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309376+0000", 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1016000000000002e-05 2024-05-10T09:57:05.736 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309395+0000", 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8810000000000001e-05 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309534+0000", 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013921199999999999 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309788+0000", 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025465399999999999 2024-05-10T09:57:05.737 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.310003+0000", 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021485100000000001 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.317815+0000", 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0078115260000000001 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.738 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324488+0000", 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066737289999999998 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324589+0000", 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100726 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324664+0000", 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4709000000000006e-05 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.739 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1462 3.2e e72/23 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head v 72'8, mlcod=71'6)", 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 27.799963836, 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021282938000000001, 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.740 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885360+0000", 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9000000000000005e-07 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892622+0000", 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0072619779999999997 2024-05-10T09:57:05.741 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892660+0000", 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8633000000000001e-05 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892678+0000", 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7649999999999999e-05 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.742 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892846+0000", 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000168398 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892886+0000", 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9687000000000001e-05 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906436+0000", 2024-05-10T09:57:05.743 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013549913 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906641+0000", 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000205689 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.744 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1890 3.26 3:6441c4d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eLGRCzvAKn5Xe45EeKu1jRkfp7sri7Z_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.225116985, 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018756142, 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1890 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.745 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460208+0000", 2024-05-10T09:57:05.746 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464849+0000", 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046407949999999996 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464873+0000", 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4198000000000001e-05 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.747 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464885+0000", 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140999999999999e-05 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464984+0000", 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8554999999999994e-05 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.465187+0000", 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020308699999999999 2024-05-10T09:57:05.748 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.465374+0000", 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018783499999999999 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478453+0000", 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013078586999999999 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.749 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478854+0000", 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040133900000000001 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478909+0000", 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5043000000000001e-05 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478962+0000", 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2101999999999997e-05 2024-05-10T09:57:05.750 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1908 3.20 3:07202f49:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.mvxZi7wWQp_ksYLH8UPXA9st4FR8xsC_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.837658911, 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019735820000000001, 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.751 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1908 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:05.752 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847667+0000", 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0960000000000001e-06 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851785+0000", 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041181849999999999 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.753 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851824+0000", 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9093e-05 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851842+0000", 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8073000000000001e-05 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852022+0000", 2024-05-10T09:57:05.754 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018047500000000001 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852437+0000", 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000414473 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852846+0000", 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040883199999999998 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.755 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.865414+0000", 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012568025 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867026+0000", 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016125950000000001 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867241+0000", 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000214231 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.756 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867399+0000", 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015874199999999999 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1949 3.34 3:2cfd8964:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.27:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.056443479, 2024-05-10T09:57:05.757 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021673562, 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1949 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.758 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628884+0000", 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8829999999999997e-06 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.759 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634501+0000", 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056171010000000002 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634542+0000", 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1202000000000003e-05 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.760 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634561+0000", 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8810000000000001e-05 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634728+0000", 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167429 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.635037+0000", 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030903700000000002 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.761 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650188+0000", 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015150693999999999 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650319+0000", 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013108799999999999 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650552+0000", 2024-05-10T09:57:05.762 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023331799999999999 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2101 3.26 3:6736c732:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.l4HKo0CXzkRIBln1asb7Tsl7SBd3Xe4_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.885266381999999, 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024595580999999998, 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.763 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2101 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.764 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800059+0000", 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.804969+0000", 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004910101 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.765 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805006+0000", 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7552999999999998e-05 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805024+0000", 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7339000000000001e-05 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.766 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805231+0000", 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000207639 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805492+0000", 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026019699999999999 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805725+0000", 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233458 2024-05-10T09:57:05.767 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.818550+0000", 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012825431999999999 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824473+0000", 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059227009999999998 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.768 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824576+0000", 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102716 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824652+0000", 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5689e-05 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2164 3.36 3:6d000b3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.61:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:05.769 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.5385713590000005, 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025900486, 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2164 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146754+0000", 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.213e-06 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153344+0000", 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065897109999999998 2024-05-10T09:57:05.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153382+0000", 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8442999999999998e-05 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153400+0000", 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8102999999999999e-05 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153548+0000", 2024-05-10T09:57:05.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014760199999999999 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153843+0000", 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029450100000000002 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.154739+0000", 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089651100000000001 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.171823+0000", 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017083876000000001 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172309+0000", 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00048598499999999998 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172525+0000", 2024-05-10T09:57:05.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021564500000000001 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172652+0000", 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012689600000000001 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2179 3.10 3:0a70ef25:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.vqJ5AMnlx4wKf9S7A_dSxnf9MsffU8f_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:05.775 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.1542592630000001, 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018648569, 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2179 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531067+0000", 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4640000000000002e-06 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535287+0000", 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042203600000000003 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535329+0000", 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2166000000000003e-05 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535354+0000", 2024-05-10T09:57:05.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5103999999999999e-05 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535534+0000", 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017949400000000001 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535804+0000", 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000270568 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:05.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.536069+0000", 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000265204 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.547341+0000", 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011271934000000001 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549501+0000", 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021594000000000001 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549638+0000", 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000137591 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549712+0000", 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3283999999999998e-05 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2351 3.35 3:af2cb2f3:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.5939857059999998, 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.033203638000000001, 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2351 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091340+0000", 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5260000000000002e-06 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099153+0000", 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0078130360000000006 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099220+0000", 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6333000000000003e-05 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099249+0000", 2024-05-10T09:57:05.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9726e-05 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099467+0000", 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000218008 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099745+0000", 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027729799999999999 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100119+0000", 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037451999999999999 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123559+0000", 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02344011 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124250+0000", 2024-05-10T09:57:05.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00069104699999999997 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124419+0000", 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000169011 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124540+0000", 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121023 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2363 3.26 3:67c2ca38:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.8daeE6MCR3CM3-EPv7KojC_uJd-HRpg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.3144693509999996, 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026306637000000001, 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2363 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370857+0000", 2024-05-10T09:57:05.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5999999999999998e-06 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375256+0000", 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043994120000000001 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375293+0000", 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6542999999999999e-05 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375312+0000", 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9145999999999999e-05 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375485+0000", 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017345199999999999 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375750+0000", 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026506700000000002 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375992+0000", 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000241912 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.384943+0000", 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089512959999999992 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.396853+0000", 2024-05-10T09:57:05.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011909645 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.397036+0000", 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018318499999999999 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.397160+0000", 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012337900000000001 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.793 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2378 3.26 3:65ff8c9e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.95:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.0443470789999996, 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026020666000000001, 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.794 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2378 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640978+0000", 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645532+0000", 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045536969999999998 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645572+0000", 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9826999999999997e-05 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645589+0000", 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7767000000000001e-05 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645725+0000", 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135668 2024-05-10T09:57:05.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.646030+0000", 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000304994 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.646938+0000", 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00090776500000000005 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.665975+0000", 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019037338000000001 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666795+0000", 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00082009900000000002 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666915+0000", 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120226 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666996+0000", 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0529000000000001e-05 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2408 3.20 3:04776303:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.100:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.4176348839999999, 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022195091, 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:05.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2408 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:05.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267690+0000", 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.706e-06 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:05.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272756+0000", 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050657020000000001 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272795+0000", 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9390000000000001e-05 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272820+0000", 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.476e-05 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272913+0000", 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3443000000000006e-05 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.273051+0000", 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013709599999999999 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.273492+0000", 2024-05-10T09:57:05.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044165600000000001 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.285685+0000", 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012192958 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289781+0000", 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040954980000000004 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:05.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289842+0000", 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1544999999999994e-05 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289883+0000", 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0336999999999997e-05 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:05.806 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:05.808 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:57:05.808 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:05.806+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:05.908 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:05.906+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:05.974 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:05.974 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:05.974 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:05.974 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:05.988 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:57:06.009 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:06.006+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:06.048 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:57:06.110 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:06.106+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:06.111 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:06.111 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:06.111 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:06.111 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:06.111 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:06.125 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:57:06.204 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:57:06.205 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:57:06.210 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:06.211+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:06.237 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:57:06.237 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:57:06.253 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:57:06.254 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:57:06.259 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:06.259 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:06.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 158.72137105100001, 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.260 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.262 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:57:06.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:57:06.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:57:06.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:57:06.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.268 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 157.79722354, 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.269 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:57:06.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:57:06.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:57:06.275 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1277 3.2d 3:b6aa08bb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.481375587999999, 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020498677, 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.276 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1277 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776453+0000", 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.61e-06 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.278 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780453+0000", 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040001919999999996 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780490+0000", 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6887000000000001e-05 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780514+0000", 2024-05-10T09:57:06.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4206000000000002e-05 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780721+0000", 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020692799999999999 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780986+0000", 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026536099999999998 2024-05-10T09:57:06.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.781220+0000", 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023365699999999999 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790889+0000", 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0096689380000000002 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796601+0000", 2024-05-10T09:57:06.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005712778 2024-05-10T09:57:06.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796764+0000", 2024-05-10T09:57:06.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162922 2024-05-10T09:57:06.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796949+0000", 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184198 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1283 3.37 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:06.283 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 34.418134307000003, 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.027466540000000001, 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1283 2024-05-10T09:57:06.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839695+0000", 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7330000000000001e-06 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843941+0000", 2024-05-10T09:57:06.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042461169999999998 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843982+0000", 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1083e-05 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844002+0000", 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9525999999999999e-05 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844137+0000", 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013504500000000001 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844411+0000", 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027433399999999999 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844789+0000", 2024-05-10T09:57:06.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037824700000000001 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.859343+0000", 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014554197 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866992+0000", 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076486699999999998 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867082+0000", 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0229000000000006e-05 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867158+0000", 2024-05-10T09:57:06.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5358999999999995e-05 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1396 3.3b 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 29.897767065, 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026528719999999999, 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.291 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1396 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360061+0000", 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:57:06.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364016+0000", 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039552420000000003 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364051+0000", 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4603000000000001e-05 2024-05-10T09:57:06.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364069+0000", 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7737e-05 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364204+0000", 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135048 2024-05-10T09:57:06.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364468+0000", 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000264505 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364705+0000", 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000237004 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.375226+0000", 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010521076000000001 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386408+0000", 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011182133 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386511+0000", 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103226 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386587+0000", 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5685999999999993e-05 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1429 3.16 e71/23 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head v 71'2, mlcod=0'0)", 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:06.298 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 29.160930656000001, 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023672451000000001, 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096897+0000", 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.537e-06 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101828+0000", 2024-05-10T09:57:06.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049309260000000004 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101999+0000", 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170528 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102086+0000", 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7626000000000004e-05 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102334+0000", 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024782500000000002 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102407+0000", 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2595000000000005e-05 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120420+0000", 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018012986000000002 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120567+0000", 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014742800000000001 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1430 3.3f 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 29.156343700000001, 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024797998000000002, 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.304 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1430 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.305 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101486+0000", 2024-05-10T09:57:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.704e-06 2024-05-10T09:57:06.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107182+0000", 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056960689999999998 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107222+0000", 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0469999999999997e-05 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107242+0000", 2024-05-10T09:57:06.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9606000000000002e-05 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107368+0000", 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126375 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107635+0000", 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026656199999999997 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:06.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107848+0000", 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000213348 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.124755+0000", 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016906694 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126120+0000", 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001365078 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126213+0000", 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3392000000000003e-05 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126280+0000", 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6699999999999995e-05 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.310 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1896 3.d 3:b0b24c30:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_._ma-obcePPf33pO9_YysGtzoRZxwRw-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.665474357000001, 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024835817, 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1896 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592355+0000", 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0960000000000003e-06 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598842+0000", 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0064869619999999998 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598884+0000", 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1582000000000003e-05 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598903+0000", 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9179999999999999e-05 2024-05-10T09:57:06.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599050+0000", 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014717199999999999 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599289+0000", 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023910399999999999 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599537+0000", 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024756499999999999 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.616600+0000", 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017063595000000001 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.616939+0000", 2024-05-10T09:57:06.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000338611 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.617056+0000", 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117365 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.617187+0000", 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013058500000000001 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.316 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1905 3.2f e76/23 3:f5382682:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.20:head v 76'7, mlcod=75'5)", 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.526471431999999, 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021046721000000001, 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.317 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731356+0000", 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.318 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735737+0000", 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043807350000000002 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735787+0000", 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0025999999999998e-05 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735808+0000", 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0757000000000001e-05 2024-05-10T09:57:06.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735972+0000", 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000164458 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.736036+0000", 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3533000000000003e-05 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.320 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752295+0000", 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016258943000000001 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752401+0000", 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105889 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1961 3.2d 3:b4c474b1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:06.321 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.403073173999999, 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024598571, 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1961 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.322 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854772+0000", 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0109999999999999e-05 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.323 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859886+0000", 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051130749999999999 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859931+0000", 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5166000000000001e-05 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859952+0000", 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1416999999999998e-05 2024-05-10T09:57:06.324 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.860134+0000", 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000181748 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.860418+0000", 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028398099999999999 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.861704+0000", 2024-05-10T09:57:06.325 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001286124 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.874222+0000", 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012517662000000001 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879108+0000", 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048859899999999998 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.326 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879245+0000", 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013758600000000001 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879351+0000", 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010571199999999999 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1992 3.37 3:eca7958d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:06.327 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.825158951000001, 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022125657999999999, 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1992 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.328 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432670+0000", 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.329 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436654+0000", 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039841119999999997 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436702+0000", 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8214000000000003e-05 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.330 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436728+0000", 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5378999999999999e-05 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436882+0000", 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015447900000000001 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.331 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.437177+0000", 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029461999999999999 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.438094+0000", 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091693500000000002 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.453044+0000", 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014949986 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.332 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454601+0000", 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001557622 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454713+0000", 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111999 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454792+0000", 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9089000000000001e-05 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.333 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2107 3.16 e77/23 3:6a82f1ca:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.aLkE1IIwI-rn4NM5LcNsVAHTPsdo775_1:head v 77'5, mlcod=77'3)", 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.33834841, 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021082284999999999, 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.334 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919480+0000", 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0000000000000001e-06 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.335 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923913+0000", 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044326690000000002 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923956+0000", 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3433000000000002e-05 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923976+0000", 2024-05-10T09:57:06.336 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.924169+0000", 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019290799999999999 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.924244+0000", 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5203000000000005e-05 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.337 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940452+0000", 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016208237 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940559+0000", 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107089 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2116 3.37 3:edfc22f1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.53:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:06.338 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.212437646, 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026773854, 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2116 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:06.339 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045391+0000", 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8870000000000001e-06 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.340 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050687+0000", 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052965269999999997 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050734+0000", 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6922999999999998e-05 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050753+0000", 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8998999999999999e-05 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.341 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050897+0000", 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143979 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.051195+0000", 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029820399999999999 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:06.342 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.052113+0000", 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091760400000000003 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.071883+0000", 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019769917000000001 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.071926+0000", 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3476000000000002e-05 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.343 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.072071+0000", 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014494599999999999 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.072162+0000", 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0391999999999998e-05 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2134 3.3f 3:fc237258:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.56:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:06.344 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.823659786, 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022216153999999998, 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2134 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.345 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434168+0000", 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.723e-06 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.346 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438441+0000", 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042722230000000003 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438477+0000", 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6167000000000001e-05 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438494+0000", 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6869000000000001e-05 2024-05-10T09:57:06.347 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438651+0000", 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157102 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438926+0000", 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027485699999999999 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.439838+0000", 2024-05-10T09:57:06.348 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091224899999999996 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.449638+0000", 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097996699999999999 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456041+0000", 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0064035469999999999 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.349 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456253+0000", 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021152200000000001 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456382+0000", 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012922500000000001 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.350 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2161 3.d 3:b1031fda:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.K-5eLppTKEd7J-RGTIuBx20U0o8LjUL_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.137382549, 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023170817999999999, 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.351 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2161 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.352 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120446+0000", 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124555+0000", 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041096079999999998 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124593+0000", 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7759999999999998e-05 2024-05-10T09:57:06.353 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124621+0000", 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7892999999999999e-05 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124807+0000", 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018641799999999999 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.354 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.125053+0000", 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000245734 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.125293+0000", 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023967500000000001 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.142601+0000", 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017307759999999998 2024-05-10T09:57:06.355 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.356 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143449+0000", 2024-05-10T09:57:06.356 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00084868900000000002 2024-05-10T09:57:06.356 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.356 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.356 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143545+0000", 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5869e-05 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143614+0000", 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8656000000000001e-05 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.357 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2188 3.2d 3:b5013f7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.65:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.573370014, 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023191018000000001, 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.358 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2188 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.359 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684458+0000", 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689791+0000", 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053327269999999998 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.360 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689833+0000", 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2765999999999997e-05 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689864+0000", 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0113000000000001e-05 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.690015+0000", 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015094500000000001 2024-05-10T09:57:06.361 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.690289+0000", 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027439800000000002 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.691184+0000", 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089496400000000005 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.362 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.705596+0000", 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014412004000000001 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707408+0000", 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018121599999999999 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707558+0000", 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149882 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.363 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707647+0000", 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8609000000000005e-05 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2200 3.2d 3:b45272fd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.67:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.3206332829999994, 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029696365999999998, 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.364 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2200 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.365 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937195+0000", 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945152+0000", 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.007957904 2024-05-10T09:57:06.366 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945196+0000", 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3713e-05 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945215+0000", 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8706999999999999e-05 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.367 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945390+0000", 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000175415 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945661+0000", 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027069399999999998 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.946547+0000", 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000886381 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.368 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.962695+0000", 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016147551999999999 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966547+0000", 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038517500000000001 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966747+0000", 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020060499999999999 2024-05-10T09:57:06.369 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966889+0000", 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014131199999999999 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2321 3.16 e79/23 3:69f47c7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.C5zaz_jZPpN7K1ZkpLeLlXZlOQ8ERKH_1:head v 79'7, mlcod=77'5)", 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.7727090800000003, 2024-05-10T09:57:06.370 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024182319000000001, 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.371 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485119+0000", 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.52e-06 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491685+0000", 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065661440000000003 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491721+0000", 2024-05-10T09:57:06.372 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6334000000000001e-05 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491743+0000", 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1132999999999999e-05 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491909+0000", 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016627100000000001 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491978+0000", 2024-05-10T09:57:06.373 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8816e-05 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509202+0000", 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017224525000000001 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509299+0000", 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6576000000000005e-05 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.374 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2339 3.37 3:ecb6c252:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ytosizOa3TRfLCiIY7rMbaujVoBKRtf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.4162474139999999, 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021264600000000002, 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.375 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2339 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.376 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841582+0000", 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.41e-06 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846176+0000", 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045943909999999998 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846214+0000", 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8044999999999999e-05 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.377 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846237+0000", 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2904e-05 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846395+0000", 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015843199999999999 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846647+0000", 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000252107 2024-05-10T09:57:06.378 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846884+0000", 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023684500000000001 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.856729+0000", 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0098451330000000007 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:06.379 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862623+0000", 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058940590000000001 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862723+0000", 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9932000000000005e-05 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862843+0000", 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119342 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.380 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2396 3.e 3:7122cbf4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.98:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.2841939890000003, 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026406023000000001, 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:06.381 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2396 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.382 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973635+0000", 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0070000000000002e-06 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981572+0000", 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0079374649999999995 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981616+0000", 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3720000000000002e-05 2024-05-10T09:57:06.383 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981635+0000", 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8853000000000001e-05 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981789+0000", 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015427799999999999 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.982065+0000", 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000276035 2024-05-10T09:57:06.384 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.999455+0000", 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01738982 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.999700+0000", 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024511200000000002 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.000038+0000", 2024-05-10T09:57:06.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000337733 2024-05-10T09:57:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:06.386 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:06.386 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:06.387 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:57:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:57:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:Error ENXIO: problem getting command descriptions from osd.4 2024-05-10T09:57:06.388 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:57:06.389 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:57:06.389 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:57:06.390 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:57:06.390 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:57:06.390 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:57:06.391 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-10T09:57:06.391 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:57:06.392 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-10T09:57:06.392 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:06.386+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:06.488 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:06.487+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:06.553 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:06.553 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:06.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:57:06.589 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:06.586+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:06.609 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:57:06.690 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:06.690+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:06.697 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:06.697 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:06.715 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:57:06.790 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:06.786+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:06.833 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:06.833 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:06.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:57:06.892 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:06.890+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:06.993 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:06.990+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:07.007 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:07.007 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:07.021 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:57:07.029 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:07.026+0000 7f664be797c0 -1 osd.4 69 log_to_monitors true 2024-05-10T09:57:07.094 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:07.094+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:07.187 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:07.187 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:07.195 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:07.194+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:07.200 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:57:07.296 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:07.294+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:07.368 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:07.368 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:07.384 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:57:07.432 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:07.430+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:07.498 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:07.494+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:07.558 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:07.558 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:07.571 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:57:07.585 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:57:07.613 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:07.610+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:07.642 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:07.642+0000 7f663fc56640 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T09:57:07.643 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:57:07.701 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:07.698+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:07.712 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:07.713 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:07.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:57:07.776 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:07.776 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:07.776 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:07.776 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:07.789 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-10T09:57:07.835 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:07.834+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:07.840 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:07.840 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:07.854 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:57:07.939 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:07.938+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:08.002 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:08.002+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:08.030 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:08.030 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:08.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:57:08.131 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:08.130+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:08.204 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:08.202+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:08.216 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:08.216 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:08.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:57:08.319 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:08.318+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:08.393 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:57:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:08.407 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:08.407 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:08.406+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:08.424 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:57:08.505 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:08.506+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:08.532 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:57:08.532 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:57:08.555 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:08.555 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:08.556 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:57:08.556 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:57:08.570 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:57:08.586 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.0 to 1 (10000) 2024-05-10T09:57:08.588 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:57:08.589 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:57:08.613 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:08.614+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:08.615 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:57:08.615 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:57:08.618 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-10T09:57:08.633 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:57:08.634 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-05-10T09:57:08.650 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:57:08.650 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:57:08.668 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:57:08.669 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:57:08.685 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:57:08.686 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:57:08.706 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:08.706+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:08.742 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:08.742 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:08.742 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:08.742 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:08.742 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:08.759 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:57:08.845 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:08.846+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:08.908 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:08.906+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:08.921 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:08.921 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1278 3.2f 3:f571631c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.135211030000001, 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024049979999999999, 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.922 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1278 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.923 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786216+0000", 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.786219+0000", 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790848+0000", 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046288800000000001 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.924 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790903+0000", 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5396000000000003e-05 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790931+0000", 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7852999999999999e-05 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791091+0000", 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000160085 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.925 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791356+0000", 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026496799999999997 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.791614+0000", 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000258304 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.926 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.801355+0000", 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097402099999999991 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810050+0000", 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0086953199999999994 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.927 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810149+0000", 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9086000000000006e-05 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.810266+0000", 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116655 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1282 3.1d 3:bb239e62:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:08.928 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.092296208, 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032019191000000002, 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1282 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.929 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829131+0000", 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.829134+0000", 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1700000000000001e-06 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.930 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.833983+0000", 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048496269999999996 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834016+0000", 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2459999999999998e-05 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834034+0000", 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8427000000000002e-05 2024-05-10T09:57:08.931 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834157+0000", 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122502 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834453+0000", 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029603700000000003 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.834694+0000", 2024-05-10T09:57:08.932 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024105099999999999 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.857709+0000", 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023014703000000001 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.860974+0000", 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032658309999999999 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.933 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.934 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861076+0000", 2024-05-10T09:57:08.934 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010209600000000001 2024-05-10T09:57:08.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.934 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.934 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.861150+0000", 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3287000000000005e-05 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1283 3.37 e69/23 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head v 69'2, mlcod=0'0)", 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.076375167000002, 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021592063000000002, 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.935 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845052+0000", 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.936 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.845054+0000", 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7e-06 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848409+0000", 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003354938 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848451+0000", 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2259999999999999e-05 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.937 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848477+0000", 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5829e-05 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848600+0000", 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000122516 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.848685+0000", 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.4759000000000006e-05 2024-05-10T09:57:08.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866565+0000", 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017880391999999998 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866644+0000", 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8669000000000002e-05 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.939 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1290 3.1d 3:ba11a2de:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.003791464999999, 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026748503999999999, 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1290 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.940 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917635+0000", 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.917638+0000", 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0570000000000001e-06 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.941 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922152+0000", 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045138899999999996 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922203+0000", 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0649000000000002e-05 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922222+0000", 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9470000000000002e-05 2024-05-10T09:57:08.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922397+0000", 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174575 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922662+0000", 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026555799999999999 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.922907+0000", 2024-05-10T09:57:08.943 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024483699999999997 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.937015+0000", 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014107511 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944214+0000", 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0071986680000000001 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944311+0000", 2024-05-10T09:57:08.944 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7806000000000005e-05 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.944384+0000", 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2483000000000004e-05 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1425 3.3a 3:5d156c1d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 31.874915180999999, 2024-05-10T09:57:08.945 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.031419395000000003, 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1425 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.946 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046512+0000", 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.046517+0000", 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2639999999999999e-06 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055240+0000", 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.008723158 2024-05-10T09:57:08.947 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055281+0000", 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1344999999999998e-05 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055301+0000", 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9317000000000002e-05 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055513+0000", 2024-05-10T09:57:08.948 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021243799999999999 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.055925+0000", 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041220299999999998 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.056338+0000", 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00041247899999999999 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.949 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.071484+0000", 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015146359 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077627+0000", 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0061428050000000003 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077805+0000", 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017845400000000001 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.950 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.077931+0000", 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000125573 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1429 3.16 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 31.830118593999998, 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029834811999999999, 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.951 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1429 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.952 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091308+0000", 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.091311+0000", 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.914e-06 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095902+0000", 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045904589999999999 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.953 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095938+0000", 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6043e-05 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.095955+0000", 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7096e-05 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096104+0000", 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149555 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.954 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096348+0000", 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024343499999999999 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096601+0000", 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025365799999999998 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.104881+0000", 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082796310000000008 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.955 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120963+0000", 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016081813 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121062+0000", 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9098999999999994e-05 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.121143+0000", 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.1108999999999999e-05 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.956 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1471 3.30 3:0f2176b4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 30.829230913, 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024868991999999999, 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.957 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1471 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092196+0000", 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.958 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.092198+0000", 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.125e-06 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096157+0000", 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039586839999999996 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096182+0000", 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.959 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096192+0000", 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0208e-05 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096269+0000", 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7440000000000004e-05 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096403+0000", 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013410700000000001 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.960 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.096528+0000", 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000124583 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.105347+0000", 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0088185999999999994 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.116955+0000", 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011608408000000001 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.961 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117015+0000", 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.0024e-05 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:38.117065+0000", 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.9804e-05 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1905 3.2f 3:f5382682:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.20:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:08.962 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.196909655999999, 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028534713999999999, 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1905 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.963 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724517+0000", 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.724520+0000", 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.18e-06 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729154+0000", 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046339730000000004 2024-05-10T09:57:08.964 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729189+0000", 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4592999999999999e-05 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729206+0000", 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6776e-05 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729382+0000", 2024-05-10T09:57:08.965 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017638500000000001 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.729814+0000", 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043171600000000001 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731011+0000", 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011970920000000001 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.966 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752773+0000", 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021762020999999999 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752812+0000", 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8745999999999998e-05 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752928+0000", 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116209 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.967 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.753052+0000", 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012402299999999999 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1937 3.2f 3:f6f6baab:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.25:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.547469333999999, 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026117703999999999, 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.968 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1937 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373957+0000", 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.969 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.373960+0000", 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5670000000000002e-06 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379641+0000", 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056814070000000003 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379683+0000", 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2061999999999998e-05 2024-05-10T09:57:08.970 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379703+0000", 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9284e-05 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.379865+0000", 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016189199999999999 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.380132+0000", 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026777000000000002 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.971 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.381015+0000", 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088269599999999998 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399852+0000", 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018836617999999999 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399878+0000", 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6489999999999999e-05 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.972 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.399998+0000", 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119848 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.400075+0000", 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7070000000000006e-05 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.973 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1973 3.5 3:a1f16109:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 16.842089770000001, 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028713439, 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1973 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.974 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079337+0000", 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.079348+0000", 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0657e-05 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.975 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086193+0000", 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0068454780000000003 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086236+0000", 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3037000000000001e-05 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086255+0000", 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9233e-05 2024-05-10T09:57:08.976 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086456+0000", 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020071499999999999 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.086733+0000", 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027707300000000002 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.087656+0000", 2024-05-10T09:57:08.977 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00092309200000000003 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.102599+0000", 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014942802 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.107828+0000", 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052284740000000003 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.978 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.107964+0000", 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013623199999999999 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.108050+0000", 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.6645999999999997e-05 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2107 3.16 3:6a82f1ca:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.aLkE1IIwI-rn4NM5LcNsVAHTPsdo775_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:08.979 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.008440727, 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.028119945, 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2107 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.980 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912986+0000", 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.912989+0000", 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.247e-06 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.981 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918424+0000", 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0054344689999999999 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918463+0000", 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9113000000000003e-05 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918482+0000", 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9133000000000001e-05 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.982 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918644+0000", 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162122 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.918903+0000", 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025855399999999998 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919141+0000", 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023880400000000001 2024-05-10T09:57:08.983 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940101+0000", 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020959489000000001 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940932+0000", 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00083094899999999999 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.941029+0000", 2024-05-10T09:57:08.984 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6818999999999996e-05 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.941106+0000", 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7245999999999999e-05 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2137 3.2f 3:f6ad2590:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.yGx-M_1fRYuiuQbEbInWygrGjnT5iDR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.378264782, 2024-05-10T09:57:08.985 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022207608, 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2137 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.986 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543162+0000", 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.543165+0000", 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.18e-06 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547129+0000", 2024-05-10T09:57:08.987 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039639030000000004 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547166+0000", 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6798999999999998e-05 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547186+0000", 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9930000000000001e-05 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547326+0000", 2024-05-10T09:57:08.988 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000139856 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547601+0000", 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000275784 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.547841+0000", 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000239328 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.558095+0000", 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0102538 2024-05-10T09:57:08.989 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565152+0000", 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0070571230000000002 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565257+0000", 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105609 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.990 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.565370+0000", 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000112296 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2146 3.1d 3:bb76e098:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.58:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.207535874, 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021432795000000001, 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.991 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2146 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713891+0000", 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.992 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.713895+0000", 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6330000000000002e-06 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718065+0000", 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041700779999999998 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718100+0000", 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5753000000000001e-05 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.993 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718119+0000", 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8822999999999999e-05 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718256+0000", 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013706499999999999 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.718553+0000", 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029665699999999998 2024-05-10T09:57:08.994 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735024+0000", 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016470752000000002 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735152+0000", 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012824599999999999 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.735324+0000", 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000171788 2024-05-10T09:57:08.995 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2167 3.3a 3:5ef9c6fa:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.bsQ4R-YmbxyKTsJlXW_D8e5jFgO7sdf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 12.673593523999999, 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025214065000000001, 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2167 2024-05-10T09:57:08.996 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247833+0000", 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.247837+0000", 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8130000000000002e-06 2024-05-10T09:57:08.997 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253565+0000", 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057278429999999998 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253606+0000", 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0833e-05 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:08.998 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253625+0000", 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9242999999999999e-05 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.253834+0000", 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020904499999999999 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.254089+0000", 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025492400000000001 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:08.999 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.254325+0000", 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000236135 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.267487+0000", 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013161599 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.272763+0000", 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052764830000000002 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.000 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.272931+0000", 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167992 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.273047+0000", 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116155 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.001 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2194 3.3c 3:3f67e664:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.66:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 12.091733122999999, 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021265557000000001, 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2194 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.002 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829694+0000", 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.829696+0000", 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8929999999999999e-06 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.003 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833704+0000", 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004008752 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833740+0000", 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5654000000000001e-05 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833757+0000", 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6719e-05 2024-05-10T09:57:09.004 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.833885+0000", 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012875199999999999 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.834158+0000", 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027250799999999997 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.835048+0000", 2024-05-10T09:57:09.005 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00088997399999999997 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850116+0000", 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015068386 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850685+0000", 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000568941 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.006 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850828+0000", 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143022 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.850959+0000", 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000130956 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2203 3.28 3:16fb63cd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.j_muk18MFUKbGsDVkAszcThPL-QGWVn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:09.007 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 11.885486626, 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022345793999999999, 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2203 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:09.008 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035940+0000", 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.035943+0000", 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3500000000000001e-06 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.009 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041480+0000", 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0055363060000000004 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041521+0000", 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1389e-05 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041547+0000", 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5476000000000001e-05 2024-05-10T09:57:09.010 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.041727+0000", 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018054200000000001 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.042130+0000", 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040300999999999998 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.042556+0000", 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000425449 2024-05-10T09:57:09.011 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.056051+0000", 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013495316 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.057960+0000", 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001908732 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.058103+0000", 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143032 2024-05-10T09:57:09.012 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:57.058286+0000", 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018319199999999999 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2321 3.16 3:69f47c7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.C5zaz_jZPpN7K1ZkpLeLlXZlOQ8ERKH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.444087476, 2024-05-10T09:57:09.013 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.032499368000000001, 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2321 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.014 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477339+0000", 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.477342+0000", 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8940000000000002e-06 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.482982+0000", 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056399060000000001 2024-05-10T09:57:09.015 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483021+0000", 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9035999999999997e-05 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483040+0000", 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.931e-05 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.483582+0000", 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00054127500000000002 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.016 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.484601+0000", 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001019308 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.484870+0000", 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026938400000000001 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509174+0000", 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024303347999999999 2024-05-10T09:57:09.017 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509663+0000", 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00048905900000000002 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509758+0000", 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5025000000000006e-05 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509839+0000", 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0822999999999995e-05 2024-05-10T09:57:09.018 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2352 3.2f 3:f4edcb95:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.8258086559999995, 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02589953, 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.019 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2352 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095618+0000", 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.020 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.095622+0000", 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9990000000000002e-06 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099686+0000", 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040635690000000004 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099726+0000", 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0025999999999999e-05 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.021 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099750+0000", 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4726e-05 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099925+0000", 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017460899999999999 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100301+0000", 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037587999999999999 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.022 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100684+0000", 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00038319599999999998 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.119874+0000", 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019189601000000001 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121342+0000", 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014683319999999999 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.023 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121442+0000", 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010002599999999999 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.121518+0000", 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5566000000000001e-05 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.024 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2351 3.35 e79/23 3:af2cb2f3:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_1:head v 79'5, mlcod=76'3)", 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.8210231649999997, 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023516426999999999, 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.025 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100404+0000", 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100406+0000", 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2170000000000001e-06 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104021+0000", 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036155039999999999 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.026 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104043+0000", 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1594999999999999e-05 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104053+0000", 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0097e-05 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104184+0000", 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013099800000000001 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.027 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.104248+0000", 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3869999999999997e-05 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123837+0000", 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019589242999999999 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123920+0000", 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2903000000000002e-05 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.028 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2393 3.c 3:33d28053:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.oOdbEiZ85yVFHLJP5wjZrtebUNQ-W6m_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 7.9739737939999999, 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02373809, 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2393 2024-05-10T09:57:09.029 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947453+0000", 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.947458+0000", 2024-05-10T09:57:09.030 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.7360000000000001e-06 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953476+0000", 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060187670000000004 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953521+0000", 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4833000000000003e-05 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953548+0000", 2024-05-10T09:57:09.031 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.669e-05 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.953764+0000", 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021636800000000001 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.954027+0000", 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026231099999999999 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 3", 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.954256+0000", 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022928400000000001 2024-05-10T09:57:09.032 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.968494+0000", 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014237619 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971002+0000", 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0025080739999999999 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971100+0000", 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7899000000000006e-05 2024-05-10T09:57:09.033 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.971191+0000", 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1508999999999994e-05 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.034 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:09.036 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:57:09.036 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:09.034+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:09.136 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:09.134+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:09.207 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:09.207 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:09.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.207 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2661 7.1f 7.4322fa9f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-10T09:57:09.207 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:08.708396+0000", 2024-05-10T09:57:09.207 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.500412462, 2024-05-10T09:57:09.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.50045514199999996, 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "waiting for peered", 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2661 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708396+0000", 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708396+0000", 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708398+0000", 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9010000000000001e-06 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708407+0000", 2024-05-10T09:57:09.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2220000000000008e-06 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708426+0000", 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9269000000000001e-05 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708436+0000", 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9750000000000002e-06 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708515+0000", 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8794000000000005e-05 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708527+0000", 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1313e-05 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2676 7.1f 7.4322fa9f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-10T09:57:09.211 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:08.874077+0000", 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.33473197399999999, 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.33489928499999999, 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "waiting for peered", 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2676 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874077+0000", 2024-05-10T09:57:09.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874077+0000", 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874078+0000", 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0109999999999999e-06 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874085+0000", 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9820000000000002e-06 2024-05-10T09:57:09.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874094+0000", 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8349999999999999e-06 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874109+0000", 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4241e-05 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874255+0000", 2024-05-10T09:57:09.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000146186 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874267+0000", 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1904e-05 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 2 2024-05-10T09:57:09.215 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:09.221 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:57:09.265 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:09.266+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:09.337 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:09.334+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:09.389 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:09.389 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:09.389 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:09.389 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:09.389 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:09.403 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:57:09.438 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:09.434+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 141.84190867300001, 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.531 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:09.532 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.533 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.534 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.535 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.536 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1279 3.a 3:51af0144:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:09.537 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.732385252999997, 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025099606, 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1279 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.538 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796337+0000", 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5070000000000002e-06 2024-05-10T09:57:09.539 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802095+0000", 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057576520000000003 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802133+0000", 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8349000000000002e-05 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802153+0000", 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9993e-05 2024-05-10T09:57:09.540 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802280+0000", 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012646599999999999 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802566+0000", 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028610300000000001 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802791+0000", 2024-05-10T09:57:09.541 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022570199999999999 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.816789+0000", 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013997486 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821159+0000", 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043700240000000001 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.542 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821316+0000", 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156735 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821432+0000", 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116589 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1284 3.36 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:09.543 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.678022404000004, 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02296221, 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1284 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.544 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850699+0000", 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1240000000000001e-06 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.545 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855070+0000", 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043709580000000003 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855111+0000", 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1310000000000003e-05 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855134+0000", 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2860000000000001e-05 2024-05-10T09:57:09.546 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855272+0000", 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013803099999999999 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855551+0000", 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027930799999999998 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855782+0000", 2024-05-10T09:57:09.547 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000231361 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866830+0000", 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011047631 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873500+0000", 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066699089999999999 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.548 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873591+0000", 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1448999999999998e-05 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873658+0000", 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6268999999999999e-05 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1287 3.2c 3:364c59b2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.643584924000002, 2024-05-10T09:57:09.549 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024099597, 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1287 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:09.550 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885136+0000", 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8040000000000002e-06 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.551 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889464+0000", 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043279219999999997 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889499+0000", 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5199e-05 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889515+0000", 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6422999999999998e-05 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.552 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889643+0000", 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012816600000000001 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889903+0000", 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025949099999999999 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.890132+0000", 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022953700000000001 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.553 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.902988+0000", 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012855171 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909041+0000", 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060532249999999998 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909155+0000", 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011380200000000001 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.554 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909233+0000", 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7856999999999997e-05 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1413 3.36 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.951811456000001, 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024918131999999999, 2024-05-10T09:57:09.555 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1413 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.556 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576908+0000", 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581066+0000", 2024-05-10T09:57:09.557 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004157244 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581103+0000", 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6973e-05 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581120+0000", 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7343e-05 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.558 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581261+0000", 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000140672 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581530+0000", 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026880099999999999 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581772+0000", 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000242754 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.559 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.590838+0000", 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090655300000000005 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601650+0000", 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010812307 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601751+0000", 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100766 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.560 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601825+0000", 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3635999999999998e-05 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1424 3.a 3:50b58fe7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.495535226000001, 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02028814, 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.561 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1424 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.562 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033186+0000", 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3840000000000001e-06 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039575+0000", 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063893420000000001 2024-05-10T09:57:09.563 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039613+0000", 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7518999999999998e-05 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039630+0000", 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.751e-05 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039808+0000", 2024-05-10T09:57:09.564 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178025 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.040103+0000", 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000294531 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053142+0000", 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013038696000000001 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.565 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053249+0000", 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107255 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053471+0000", 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022187800000000001 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1430 3.3f e71/23 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head v 71'3, mlcod=71'1)", 2024-05-10T09:57:09.566 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.420585291000002, 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017678704999999999, 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.567 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108133+0000", 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.108135+0000", 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4269999999999998e-06 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111069+0000", 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029336520000000001 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.568 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111113+0000", 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4193000000000002e-05 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111132+0000", 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9157e-05 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111305+0000", 2024-05-10T09:57:09.569 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000172621 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.111372+0000", 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6935999999999997e-05 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.125674+0000", 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014302199999999999 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.570 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.125811+0000", 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013751900000000001 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1434 3.33 e71/23 3:ceb46b53:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_11:head v 71'1, mlcod=0'0)", 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.368889977000002, 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017779593, 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.571 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159828+0000", 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.159831+0000", 2024-05-10T09:57:09.572 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.903e-06 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165818+0000", 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005987643 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165855+0000", 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6866000000000002e-05 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.165872+0000", 2024-05-10T09:57:09.573 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6793e-05 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.166014+0000", 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014216200000000001 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.166081+0000", 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.648e-05 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.574 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177476+0000", 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011395621 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.177607+0000", 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000131125 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1444 3.26 3:66bf84d6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:09.575 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 32.224437555000002, 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020383655000000001, 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1444 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.576 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304284+0000", 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5300000000000001e-06 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.577 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309335+0000", 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050508920000000004 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309376+0000", 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1016000000000002e-05 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309395+0000", 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8810000000000001e-05 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.578 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309534+0000", 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013921199999999999 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309788+0000", 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025465399999999999 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.310003+0000", 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021485100000000001 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.579 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.317815+0000", 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0078115260000000001 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324488+0000", 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066737289999999998 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324589+0000", 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100726 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.580 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324664+0000", 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4709000000000006e-05 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1462 3.2e e72/23 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head v 72'8, mlcod=71'6)", 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 31.643359295, 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021282938000000001, 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.581 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.582 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885360+0000", 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9000000000000005e-07 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892622+0000", 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0072619779999999997 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892660+0000", 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8633000000000001e-05 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.583 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892678+0000", 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7649999999999999e-05 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892846+0000", 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000168398 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892886+0000", 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9687000000000001e-05 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.584 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906436+0000", 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013549913 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906641+0000", 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000205689 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.585 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1890 3.26 3:6441c4d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eLGRCzvAKn5Xe45EeKu1jRkfp7sri7Z_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 19.068512444, 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018756142, 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1890 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.586 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460208+0000", 2024-05-10T09:57:09.587 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464849+0000", 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046407949999999996 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464873+0000", 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4198000000000001e-05 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.588 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464885+0000", 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140999999999999e-05 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464984+0000", 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8554999999999994e-05 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.465187+0000", 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020308699999999999 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.589 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.465374+0000", 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018783499999999999 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478453+0000", 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013078586999999999 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478854+0000", 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040133900000000001 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.590 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478909+0000", 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5043000000000001e-05 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478962+0000", 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2101999999999997e-05 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1908 3.20 3:07202f49:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.mvxZi7wWQp_ksYLH8UPXA9st4FR8xsC_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:09.591 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.681054369999998, 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019735820000000001, 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1908 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.592 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847667+0000", 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0960000000000001e-06 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.593 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851785+0000", 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041181849999999999 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851824+0000", 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9093e-05 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851842+0000", 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8073000000000001e-05 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.594 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852022+0000", 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018047500000000001 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852437+0000", 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000414473 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852846+0000", 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040883199999999998 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.595 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.865414+0000", 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012568025 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867026+0000", 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016125950000000001 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867241+0000", 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000214231 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.596 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867399+0000", 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015874199999999999 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1949 3.34 3:2cfd8964:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.27:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.899838937999998, 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021673562, 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.597 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1949 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.598 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628884+0000", 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8829999999999997e-06 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634501+0000", 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056171010000000002 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.599 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634542+0000", 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1202000000000003e-05 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634561+0000", 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8810000000000001e-05 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634728+0000", 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167429 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.600 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.635037+0000", 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030903700000000002 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650188+0000", 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015150693999999999 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650319+0000", 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013108799999999999 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.601 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650552+0000", 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023331799999999999 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2101 3.26 3:6736c732:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.l4HKo0CXzkRIBln1asb7Tsl7SBd3Xe4_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.728661840999999, 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024595580999999998, 2024-05-10T09:57:09.602 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2101 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.603 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800059+0000", 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.804969+0000", 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004910101 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.604 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805006+0000", 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7552999999999998e-05 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805024+0000", 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7339000000000001e-05 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805231+0000", 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000207639 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.605 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805492+0000", 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026019699999999999 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805725+0000", 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233458 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.818550+0000", 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012825431999999999 2024-05-10T09:57:09.606 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824473+0000", 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059227009999999998 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824576+0000", 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102716 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824652+0000", 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5689e-05 2024-05-10T09:57:09.607 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2164 3.36 3:6d000b3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.61:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.381966818, 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025900486, 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.608 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2164 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.609 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146754+0000", 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.213e-06 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153344+0000", 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065897109999999998 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153382+0000", 2024-05-10T09:57:09.610 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8442999999999998e-05 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153400+0000", 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8102999999999999e-05 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153548+0000", 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014760199999999999 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153843+0000", 2024-05-10T09:57:09.611 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029450100000000002 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.154739+0000", 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089651100000000001 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.171823+0000", 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017083876000000001 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.612 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172309+0000", 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00048598499999999998 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172525+0000", 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021564500000000001 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172652+0000", 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012689600000000001 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.613 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2179 3.10 3:0a70ef25:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.vqJ5AMnlx4wKf9S7A_dSxnf9MsffU8f_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 12.997654722, 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018648569, 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2179 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.614 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531067+0000", 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4640000000000002e-06 2024-05-10T09:57:09.615 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535287+0000", 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042203600000000003 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535329+0000", 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2166000000000003e-05 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535354+0000", 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5103999999999999e-05 2024-05-10T09:57:09.616 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535534+0000", 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017949400000000001 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535804+0000", 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000270568 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.536069+0000", 2024-05-10T09:57:09.617 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000265204 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.547341+0000", 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011271934000000001 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549501+0000", 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021594000000000001 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.618 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549638+0000", 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000137591 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549712+0000", 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3283999999999998e-05 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2351 3.35 3:af2cb2f3:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:09.619 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.4373811649999997, 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.033203638000000001, 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2351 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.620 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091340+0000", 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5260000000000002e-06 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099153+0000", 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0078130360000000006 2024-05-10T09:57:09.621 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099220+0000", 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6333000000000003e-05 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099249+0000", 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9726e-05 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.622 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099467+0000", 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000218008 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099745+0000", 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027729799999999999 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100119+0000", 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037451999999999999 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.623 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123559+0000", 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02344011 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124250+0000", 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00069104699999999997 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124419+0000", 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000169011 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.624 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124540+0000", 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121023 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2363 3.26 3:67c2ca38:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.8daeE6MCR3CM3-EPv7KojC_uJd-HRpg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.1578648099999995, 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026306637000000001, 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.625 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2363 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.626 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370857+0000", 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5999999999999998e-06 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375256+0000", 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043994120000000001 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.627 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375293+0000", 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6542999999999999e-05 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375312+0000", 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9145999999999999e-05 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375485+0000", 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017345199999999999 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.628 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375750+0000", 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026506700000000002 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375992+0000", 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000241912 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.384943+0000", 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089512959999999992 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.629 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.396853+0000", 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011909645 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.397036+0000", 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018318499999999999 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.397160+0000", 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012337900000000001 2024-05-10T09:57:09.630 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2378 3.26 3:65ff8c9e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.95:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.8877425379999995, 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026020666000000001, 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2378 2024-05-10T09:57:09.631 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640978+0000", 2024-05-10T09:57:09.632 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645532+0000", 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045536969999999998 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645572+0000", 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9826999999999997e-05 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645589+0000", 2024-05-10T09:57:09.633 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7767000000000001e-05 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645725+0000", 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135668 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.646030+0000", 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000304994 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:09.634 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.646938+0000", 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00090776500000000005 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.665975+0000", 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019037338000000001 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666795+0000", 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00082009900000000002 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666915+0000", 2024-05-10T09:57:09.635 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120226 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666996+0000", 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0529000000000001e-05 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2408 3.20 3:04776303:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.100:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 8.2610303429999998, 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022195091, 2024-05-10T09:57:09.636 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2408 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:09.637 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267690+0000", 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.706e-06 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272756+0000", 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050657020000000001 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.638 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272795+0000", 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9390000000000001e-05 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272820+0000", 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.476e-05 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272913+0000", 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3443000000000006e-05 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:09.639 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.273051+0000", 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013709599999999999 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.273492+0000", 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044165600000000001 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.285685+0000", 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012192958 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289781+0000", 2024-05-10T09:57:09.640 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040954980000000004 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289842+0000", 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1544999999999994e-05 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289883+0000", 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0336999999999997e-05 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:09.641 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:09.642 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:09.642 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:57:09.644 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.1 to 1 (10000) 2024-05-10T09:57:09.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:57:09.645 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-10T09:57:09.645 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:09.638+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:09.743 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:09.742+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:09.790 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:09.790 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:09.791 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:09.791 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:09.809 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:57:09.853 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:09.854+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:09.945 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:09.942+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:09.996 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:09.997 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:09.997 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:09.997 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:09.997 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:10.018 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:57:10.061 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:10.062+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:10.146 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:10.142+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:10.206 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:10.206 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:10.206 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:10.206 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:10.206 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 162.66882507400001, 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.207 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:57:10.208 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:57:10.209 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:57:10.210 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.211 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:57:10.212 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 161.74467756300001, 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:57:10.213 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.214 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.215 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.216 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.217 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.218 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1277 3.2d 3:b6aa08bb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.428829610999998, 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020498677, 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1277 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.219 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776453+0000", 2024-05-10T09:57:10.220 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.61e-06 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780453+0000", 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040001919999999996 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780490+0000", 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6887000000000001e-05 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.221 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780514+0000", 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4206000000000002e-05 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780721+0000", 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020692799999999999 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780986+0000", 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026536099999999998 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.222 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.781220+0000", 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023365699999999999 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790889+0000", 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0096689380000000002 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796601+0000", 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005712778 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.223 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796764+0000", 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162922 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796949+0000", 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184198 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.224 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1283 3.37 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.365588330000001, 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.027466540000000001, 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1283 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.225 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839695+0000", 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7330000000000001e-06 2024-05-10T09:57:10.226 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843941+0000", 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042461169999999998 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843982+0000", 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1083e-05 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844002+0000", 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9525999999999999e-05 2024-05-10T09:57:10.227 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844137+0000", 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013504500000000001 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844411+0000", 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027433399999999999 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844789+0000", 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037824700000000001 2024-05-10T09:57:10.228 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.859343+0000", 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014554197 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866992+0000", 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076486699999999998 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867082+0000", 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0229000000000006e-05 2024-05-10T09:57:10.229 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867158+0000", 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5358999999999995e-05 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1396 3.3b 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.845221088000002, 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026528719999999999, 2024-05-10T09:57:10.230 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1396 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.231 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360061+0000", 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364016+0000", 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039552420000000003 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.232 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364051+0000", 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4603000000000001e-05 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364069+0000", 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7737e-05 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364204+0000", 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135048 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.233 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364468+0000", 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000264505 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364705+0000", 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000237004 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.375226+0000", 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010521076000000001 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.234 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386408+0000", 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011182133 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386511+0000", 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103226 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386587+0000", 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5685999999999993e-05 2024-05-10T09:57:10.235 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1429 3.16 e71/23 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head v 71'2, mlcod=0'0)", 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.108384678999997, 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023672451000000001, 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.236 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096897+0000", 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.537e-06 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.237 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101828+0000", 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049309260000000004 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101999+0000", 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170528 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102086+0000", 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7626000000000004e-05 2024-05-10T09:57:10.238 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102334+0000", 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024782500000000002 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102407+0000", 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2595000000000005e-05 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120420+0000", 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018012986000000002 2024-05-10T09:57:10.239 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120567+0000", 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014742800000000001 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1430 3.3f 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 33.103797723, 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024797998000000002, 2024-05-10T09:57:10.240 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1430 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.241 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101486+0000", 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.704e-06 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107182+0000", 2024-05-10T09:57:10.242 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056960689999999998 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107222+0000", 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0469999999999997e-05 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107242+0000", 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9606000000000002e-05 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.243 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107368+0000", 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126375 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107635+0000", 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026656199999999997 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107848+0000", 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000213348 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.244 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.124755+0000", 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016906694 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126120+0000", 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001365078 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126213+0000", 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3392000000000003e-05 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.245 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126280+0000", 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6699999999999995e-05 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1896 3.d 3:b0b24c30:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_._ma-obcePPf33pO9_YysGtzoRZxwRw-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 19.61292838, 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024835817, 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.246 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1896 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:10.247 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592355+0000", 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0960000000000003e-06 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598842+0000", 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0064869619999999998 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.248 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598884+0000", 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1582000000000003e-05 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598903+0000", 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9179999999999999e-05 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599050+0000", 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014717199999999999 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.249 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599289+0000", 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023910399999999999 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599537+0000", 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024756499999999999 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.616600+0000", 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017063595000000001 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.250 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.616939+0000", 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000338611 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.617056+0000", 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117365 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.617187+0000", 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013058500000000001 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.251 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1905 3.2f e76/23 3:f5382682:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.20:head v 76'7, mlcod=75'5)", 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 19.473925455, 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021046721000000001, 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.252 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731356+0000", 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735737+0000", 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043807350000000002 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.253 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735787+0000", 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0025999999999998e-05 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735808+0000", 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0757000000000001e-05 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735972+0000", 2024-05-10T09:57:10.254 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000164458 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.736036+0000", 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3533000000000003e-05 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752295+0000", 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016258943000000001 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.255 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752401+0000", 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105889 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1961 3.2d 3:b4c474b1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.350527197000002, 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024598571, 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.256 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1961 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.257 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854772+0000", 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0109999999999999e-05 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859886+0000", 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051130749999999999 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859931+0000", 2024-05-10T09:57:10.258 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5166000000000001e-05 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859952+0000", 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1416999999999998e-05 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.860134+0000", 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000181748 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.259 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.860418+0000", 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028398099999999999 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.861704+0000", 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001286124 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.874222+0000", 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012517662000000001 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.260 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879108+0000", 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048859899999999998 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879245+0000", 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013758600000000001 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879351+0000", 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010571199999999999 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.261 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1992 3.37 3:eca7958d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.772612974000001, 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022125657999999999, 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.262 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1992 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.263 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432670+0000", 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436654+0000", 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039841119999999997 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436702+0000", 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8214000000000003e-05 2024-05-10T09:57:10.264 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436728+0000", 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5378999999999999e-05 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436882+0000", 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015447900000000001 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.437177+0000", 2024-05-10T09:57:10.265 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029461999999999999 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.438094+0000", 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091693500000000002 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.453044+0000", 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014949986 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.266 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454601+0000", 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001557622 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454713+0000", 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111999 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454792+0000", 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9089000000000001e-05 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2107 3.16 e77/23 3:6a82f1ca:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.aLkE1IIwI-rn4NM5LcNsVAHTPsdo775_1:head v 77'5, mlcod=77'3)", 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.285802433000001, 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021082284999999999, 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:10.268 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919480+0000", 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0000000000000001e-06 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923913+0000", 2024-05-10T09:57:10.269 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044326690000000002 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923956+0000", 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3433000000000002e-05 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923976+0000", 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.270 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.924169+0000", 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019290799999999999 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.924244+0000", 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5203000000000005e-05 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940452+0000", 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016208237 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.271 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940559+0000", 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107089 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2116 3.37 3:edfc22f1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.53:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 15.159891669, 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026773854, 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.272 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2116 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.273 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045391+0000", 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8870000000000001e-06 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050687+0000", 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052965269999999997 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.274 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050734+0000", 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6922999999999998e-05 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050753+0000", 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8998999999999999e-05 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050897+0000", 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143979 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.275 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.051195+0000", 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029820399999999999 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.052113+0000", 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091760400000000003 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.071883+0000", 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019769917000000001 2024-05-10T09:57:10.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.071926+0000", 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3476000000000002e-05 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.072071+0000", 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014494599999999999 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.072162+0000", 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0391999999999998e-05 2024-05-10T09:57:10.277 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2134 3.3f 3:fc237258:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.56:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.771113808999999, 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022216153999999998, 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.278 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2134 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434168+0000", 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.723e-06 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438441+0000", 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042722230000000003 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438477+0000", 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6167000000000001e-05 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.280 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438494+0000", 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6869000000000001e-05 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438651+0000", 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157102 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438926+0000", 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027485699999999999 2024-05-10T09:57:10.281 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.439838+0000", 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091224899999999996 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.449638+0000", 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097996699999999999 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.282 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456041+0000", 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0064035469999999999 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456253+0000", 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021152200000000001 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456382+0000", 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012922500000000001 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.283 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2161 3.d 3:b1031fda:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.K-5eLppTKEd7J-RGTIuBx20U0o8LjUL_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.084836572, 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023170817999999999, 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2161 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.284 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120446+0000", 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:10.285 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124555+0000", 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041096079999999998 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124593+0000", 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7759999999999998e-05 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124621+0000", 2024-05-10T09:57:10.286 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7892999999999999e-05 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124807+0000", 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018641799999999999 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.125053+0000", 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000245734 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.125293+0000", 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023967500000000001 2024-05-10T09:57:10.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.142601+0000", 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017307759999999998 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143449+0000", 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00084868900000000002 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143545+0000", 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5869e-05 2024-05-10T09:57:10.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143614+0000", 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8656000000000001e-05 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2188 3.2d 3:b5013f7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.65:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.520824037000001, 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023191018000000001, 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.289 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2188 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.290 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684458+0000", 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689791+0000", 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053327269999999998 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.291 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689833+0000", 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2765999999999997e-05 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689864+0000", 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0113000000000001e-05 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.690015+0000", 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015094500000000001 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.292 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.690289+0000", 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027439800000000002 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.691184+0000", 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089496400000000005 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.705596+0000", 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014412004000000001 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.293 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707408+0000", 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018121599999999999 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707558+0000", 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149882 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707647+0000", 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8609000000000005e-05 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2200 3.2d 3:b45272fd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.67:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.268087306, 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029696365999999998, 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2200 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.295 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937195+0000", 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:57:10.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945152+0000", 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.007957904 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945196+0000", 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3713e-05 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945215+0000", 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8706999999999999e-05 2024-05-10T09:57:10.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945390+0000", 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000175415 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945661+0000", 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027069399999999998 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:10.298 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.946547+0000", 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000886381 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.962695+0000", 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016147551999999999 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966547+0000", 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038517500000000001 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.299 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966747+0000", 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020060499999999999 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966889+0000", 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014131199999999999 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2321 3.16 e79/23 3:69f47c7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.C5zaz_jZPpN7K1ZkpLeLlXZlOQ8ERKH_1:head v 79'7, mlcod=77'5)", 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.720163103000001, 2024-05-10T09:57:10.300 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024182319000000001, 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485119+0000", 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.52e-06 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491685+0000", 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065661440000000003 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.302 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491721+0000", 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6334000000000001e-05 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491743+0000", 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1132999999999999e-05 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491909+0000", 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016627100000000001 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.303 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491978+0000", 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8816e-05 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509202+0000", 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017224525000000001 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509299+0000", 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6576000000000005e-05 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.304 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2339 3.37 3:ecb6c252:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ytosizOa3TRfLCiIY7rMbaujVoBKRtf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 10.363701437, 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021264600000000002, 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2339 2024-05-10T09:57:10.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.306 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841582+0000", 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.41e-06 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846176+0000", 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045943909999999998 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846214+0000", 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8044999999999999e-05 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.307 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846237+0000", 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2904e-05 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846395+0000", 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015843199999999999 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846647+0000", 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000252107 2024-05-10T09:57:10.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846884+0000", 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023684500000000001 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.856729+0000", 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0098451330000000007 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862623+0000", 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058940590000000001 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.309 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862723+0000", 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9932000000000005e-05 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862843+0000", 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119342 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.310 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2396 3.e 3:7122cbf4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.98:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 9.2316480120000008, 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026406023000000001, 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2396 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.311 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973635+0000", 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0070000000000002e-06 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.312 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981572+0000", 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0079374649999999995 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981616+0000", 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3720000000000002e-05 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981635+0000", 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8853000000000001e-05 2024-05-10T09:57:10.313 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981789+0000", 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015427799999999999 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.982065+0000", 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000276035 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.999455+0000", 2024-05-10T09:57:10.314 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01738982 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.999700+0000", 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024511200000000002 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.000038+0000", 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000337733 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.315 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:10.317 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:57:10.317 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:10.314+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:10.418 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:10.418+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:10.458 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:10.458 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:10.458 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:10.473 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:57:10.519 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:10.518+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:10.594 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.2 to 1 (10000) 2024-05-10T09:57:10.603 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:57:10.619 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:10.618+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:10.625 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-10T09:57:10.647 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:10.647 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:10.647 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:10.647 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:10.647 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:10.661 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:57:10.703 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:57:10.755 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:10.754+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2668 3.14 3:2a011de0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eHk4eMrRJM3cS-Q48W2BsKLN_D69iK7_1:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e83)", 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:08.855995+0000", 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.9424151379999999, 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.84593486600000001, 2024-05-10T09:57:10.799 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2668 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.855995+0000", 2024-05-10T09:57:10.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.855995+0000", 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.855998+0000", 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4830000000000002e-06 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856009+0000", 2024-05-10T09:57:10.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.133e-05 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856031+0000", 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1798999999999999e-05 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856049+0000", 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7686999999999999e-05 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856153+0000", 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104644 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856169+0000", 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5826000000000001e-05 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.662083+0000", 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.805913565 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for missing object", 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.662333+0000", 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000250117 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.696297+0000", 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.033964466999999998 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.696438+0000", 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014065900000000001 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.701930+0000", 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005492289 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e5b7b639:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.Cf74aV4InIcSv68WXg_axwGYn27BuJi_12:head, version: 71'3, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:e5b7b639:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.Cf74aV4InIcSv68WXg_axwGYn27BuJi_12:head@71'3, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.654956+0000", 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.1434542400000001, 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082345070000000003, 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.805 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.654956+0000", 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.654956+0000", 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.806 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.654957+0000", 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6000000000000004e-07 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660063+0000", 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051057689999999996 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660109+0000", 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6598999999999999e-05 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660167+0000", 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7831000000000002e-05 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660388+0000", 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022065 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660436+0000", 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8000000000000001e-05 2024-05-10T09:57:10.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.663191+0000", 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027550980000000001 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.14 84/83 [PushOp(3:2a011de0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eHk4eMrRJM3cS-Q48W2BsKLN_D69iK7_1:head, version: 79'7, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2a011de0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eHk4eMrRJM3cS-Q48W2BsKLN_D69iK7_1:head@79'7, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.668790+0000", 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.129620184, 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036876449999999998, 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.809 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.668790+0000", 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.668790+0000", 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.668791+0000", 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6599999999999995e-07 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669892+0000", 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001100855 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669927+0000", 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5417999999999999e-05 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669955+0000", 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7810999999999999e-05 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.670164+0000", 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020927000000000001 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.670205+0000", 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0231999999999997e-05 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.672478+0000", 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002273293 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c3536bdc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_17:head, version: 72'1, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c3536bdc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_17:head@72'1, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.673791+0000", 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.1246198569999999, 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048843819999999996, 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.813 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.673791+0000", 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.673791+0000", 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.673792+0000", 2024-05-10T09:57:10.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9999999999999995e-07 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.676971+0000", 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031795809999999999 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.677014+0000", 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2796000000000002e-05 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.677039+0000", 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5338999999999999e-05 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.677187+0000", 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147441 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.677207+0000", 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0142000000000001e-05 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678675+0000", 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001468083 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e5b7b639:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.Cf74aV4InIcSv68WXg_axwGYn27BuJi_12:head, version: 71'3, data_included: [2097152~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:e5b7b639:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.Cf74aV4InIcSv68WXg_axwGYn27BuJi_12:head@71'3, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.676097+0000", 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.1223137169999999, 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034061830000000001, 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.817 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.676097+0000", 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.676097+0000", 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.676098+0000", 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:57:10.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678159+0000", 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020605549999999999 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678200+0000", 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0992999999999999e-05 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678239+0000", 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8642e-05 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678351+0000", 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011210299999999999 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678360+0000", 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0629999999999995e-06 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.679503+0000", 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001143217 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head, version: 76'4, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 12, recovery_info: ObjectRecoveryInfo(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head@76'4, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.728333+0000", 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.0700777749999999, 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037500609999999998, 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.821 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.728333+0000", 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.728333+0000", 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.728334+0000", 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3799999999999996e-07 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730381+0000", 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020475860000000001 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730406+0000", 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:57:10.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730420+0000", 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3842000000000001e-05 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730578+0000", 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157832 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730593+0000", 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5486e-05 2024-05-10T09:57:10.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.732083+0000", 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001489368 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head, version: 76'4, data_included: [2097152~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head@76'4, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.740428+0000", 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.0579825549999999, 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003423021, 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.825 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.740428+0000", 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.740428+0000", 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.740429+0000", 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0800000000000004e-07 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.741762+0000", 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001333339 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.741785+0000", 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3074e-05 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.741806+0000", 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0877e-05 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.742011+0000", 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020509 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.742045+0000", 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3722e-05 2024-05-10T09:57:10.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.743851+0000", 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001806111 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e60fc7d4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Omlyut8jvwA6WAkdcBKdF9zMxMa5fC0_2:head, version: 75'6, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:e60fc7d4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Omlyut8jvwA6WAkdcBKdF9zMxMa5fC0_2:head@75'6, size: 2097152, copy_subset: [(0, 2097152)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.746045+0000", 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.052366001, 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003946064, 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.829 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746045+0000", 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746045+0000", 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746048+0000", 2024-05-10T09:57:10.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.523e-06 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748412+0000", 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002364054 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748442+0000", 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0215000000000001e-05 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748466+0000", 2024-05-10T09:57:10.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3706999999999999e-05 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748589+0000", 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012292600000000001 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748608+0000", 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9301999999999999e-05 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.749991+0000", 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001382337 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head, version: 76'4, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head@76'4, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.746272+0000", 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.0521387369999999, 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036164220000000002, 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.833 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746272+0000", 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746272+0000", 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.834 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746273+0000", 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2130000000000001e-06 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748033+0000", 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001760445 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748071+0000", 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7682000000000003e-05 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748096+0000", 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4994000000000002e-05 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748229+0000", 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013254 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748247+0000", 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8544000000000001e-05 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.749888+0000", 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016410039999999999 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c3bbce48:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.30:head, version: 76'5, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:c3bbce48:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.30:head@76'5, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.770372+0000", 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 1.028038834, 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046826439999999997, 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.770372+0000", 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.770372+0000", 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.770373+0000", 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9300000000000006e-07 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772354+0000", 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001981741 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772381+0000", 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6582999999999999e-05 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772401+0000", 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9572000000000002e-05 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772537+0000", 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013605 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772553+0000", 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6762999999999999e-05 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.775054+0000", 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0025009419999999999 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.840 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e460a835:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.M1M7MFCTr3g93zoJrubSQcDZQ3YMhn-_1:head, version: 77'9, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:e460a835:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.M1M7MFCTr3g93zoJrubSQcDZQ3YMhn-_1:head@77'9, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.812231+0000", 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.986179213, 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003452587, 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.812231+0000", 2024-05-10T09:57:10.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.812231+0000", 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.812232+0000", 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3e-07 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814423+0000", 2024-05-10T09:57:10.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002190727 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814440+0000", 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7312999999999998e-05 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814453+0000", 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2768999999999999e-05 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814563+0000", 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110547 2024-05-10T09:57:10.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814577+0000", 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3217000000000001e-05 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.815684+0000", 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011073840000000001 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.844 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e426105c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.1xtBWPEQj7lfaNHJTw2Ua0-4RJwPN0I_1:head, version: 79'10, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:e426105c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.1xtBWPEQj7lfaNHJTw2Ua0-4RJwPN0I_1:head@79'10, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.836860+0000", 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.96155041900000005, 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044046509999999999, 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.836860+0000", 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.836860+0000", 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.836861+0000", 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1900000000000002e-07 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838653+0000", 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017922190000000001 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838701+0000", 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8389e-05 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838746+0000", 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4236000000000001e-05 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838949+0000", 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020313899999999999 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838966+0000", 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7702000000000001e-05 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.841265+0000", 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022983470000000001 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:d912c5a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.lU0B2GRK3M0J0eVU9ODNBL6kcOFOokP_7:head, version: 71'2, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:d912c5a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.lU0B2GRK3M0J0eVU9ODNBL6kcOFOokP_7:head@71'2, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.845642+0000", 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.95276888900000001, 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033689850000000001, 2024-05-10T09:57:10.848 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.845642+0000", 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.845642+0000", 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.845643+0000", 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.342e-06 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847525+0000", 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018823780000000001 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847581+0000", 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.588e-05 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847626+0000", 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4489e-05 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847741+0000", 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115666 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847753+0000", 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1844e-05 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.849011+0000", 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012573860000000001 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:dab81e27:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.lU0B2GRK3M0J0eVU9ODNBL6kcOFOokP_24:head, version: 71'3, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:dab81e27:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.lU0B2GRK3M0J0eVU9ODNBL6kcOFOokP_24:head@71'3, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.874156+0000", 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.92425403800000006, 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035715510000000001, 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.852 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874156+0000", 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874156+0000", 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874158+0000", 2024-05-10T09:57:10.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.029e-06 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876093+0000", 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019353599999999999 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876124+0000", 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-05 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876149+0000", 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5409999999999999e-05 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876296+0000", 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000146766 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876315+0000", 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8921000000000001e-05 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.877728+0000", 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014128649999999999 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.9 84/83 [PushOp(3:90c99b3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.6Jw7eZ7UxkIOL6sMYoTmgWuc8pwm15G_1:head, version: 78'3, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:90c99b3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.6Jw7eZ7UxkIOL6sMYoTmgWuc8pwm15G_1:head@78'3, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.874176+0000", 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.92423428100000005, 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003302906, 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.856 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874176+0000", 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874176+0000", 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874177+0000", 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5999999999999999e-07 2024-05-10T09:57:10.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876110+0000", 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019334479999999999 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876128+0000", 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7787000000000001e-05 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876150+0000", 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2334e-05 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876264+0000", 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000113983 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876277+0000", 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2286999999999999e-05 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.877479+0000", 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012026070000000001 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:d9e10157:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Gj_nOJUTfvmNUaFHqwKUnpu-slR5bMR_1:head, version: 79'10, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:d9e10157:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Gj_nOJUTfvmNUaFHqwKUnpu-slR5bMR_1:head@79'10, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.977759+0000", 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.82065136400000005, 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036965890000000001, 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.860 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.977759+0000", 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.977759+0000", 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.977760+0000", 2024-05-10T09:57:10.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-07 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.978907+0000", 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001147368 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.978937+0000", 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9090000000000001e-05 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.978969+0000", 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2085000000000002e-05 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.979087+0000", 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117998 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.979096+0000", 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9020000000000005e-06 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.863 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.981456+0000", 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023601830000000001 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:d88d1550:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.DyDtw8JTcOFNdkwz3Cq-KneJ_TyzpIU_1:head, version: 79'11, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:d88d1550:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.DyDtw8JTcOFNdkwz3Cq-KneJ_TyzpIU_1:head@79'11, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.997700+0000", 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.80071042999999997, 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035740149999999998, 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.864 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.997700+0000", 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.997700+0000", 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.997701+0000", 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.012e-06 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998696+0000", 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000994614 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998724+0000", 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8714e-05 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998747+0000", 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2495999999999999e-05 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998868+0000", 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121483 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998884+0000", 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5381000000000001e-05 2024-05-10T09:57:10.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.001274+0000", 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023903150000000001 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:d88d1550:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.DyDtw8JTcOFNdkwz3Cq-KneJ_TyzpIU_1:head, version: 79'11, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:d88d1550:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.DyDtw8JTcOFNdkwz3Cq-KneJ_TyzpIU_1:head@79'11, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:10.003342+0000", 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.79506886700000001, 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042588189999999996, 2024-05-10T09:57:10.868 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.003342+0000", 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.003342+0000", 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.003343+0000", 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.268e-06 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006707+0000", 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033641190000000001 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006746+0000", 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8943000000000003e-05 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006785+0000", 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8658000000000002e-05 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006893+0000", 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010863599999999999 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006904+0000", 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0299000000000001e-05 2024-05-10T09:57:10.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.007600+0000", 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00069689600000000002 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2706 3.3 3:c2d658ff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.PdLsDTA95CrN9ooWkOj_3U6wf3IE3zY_2:head [read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:10.373711+0000", 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.424699932, 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003332968, 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.872 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2706 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373711+0000", 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373711+0000", 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373713+0000", 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0710000000000002e-06 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373720+0000", 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7559999999999999e-06 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373804+0000", 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3329000000000001e-05 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373869+0000", 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5054000000000004e-05 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373962+0000", 2024-05-10T09:57:10.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2974999999999997e-05 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.374055+0000", 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.377044+0000", 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029884600000000001 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.29 85/83 [PushOp(3:9452d492:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.96ic2g2SllWPMUNYDs3BnxUi73zdNqX_1:head, version: 78'12, data_included: [2097152~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:9452d492:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.96ic2g2SllWPMUNYDs3BnxUi73zdNqX_1:head@78'12, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:10.617650+0000", 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.18076014300000001, 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039030929999999998, 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.617650+0000", 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.617650+0000", 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.617651+0000", 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3200000000000004e-07 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618729+0000", 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010777619999999999 2024-05-10T09:57:10.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618746+0000", 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6952999999999998e-05 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618757+0000", 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1195999999999999e-05 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618830+0000", 2024-05-10T09:57:10.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2793000000000006e-05 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618840+0000", 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0052e-05 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.621553+0000", 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027135050000000002 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:10.880 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:10.881 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:10.881 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:57:10.882 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:57:10.882 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:57:10.883 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:57:10.883 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:10.878+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:10.883 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:57:10.894 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:57:10.894 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:57:10.926 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:57:10.927 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:57:10.962 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:57:10.962 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:57:10.982 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:10.982+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:10.998 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:57:10.998 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:57:11.032 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:57:11.032 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:57:11.036 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:11.036 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:11.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:57:11.060 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:57:11.060 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:57:11.119 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:11.118+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:11.174 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:11.174 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:11.184 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:11.182+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:11.187 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:57:11.285 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:11.286+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:11.354 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:11.354 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:11.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:57:11.386 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:11.386+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:11.484 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:11.484 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:11.486 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:11.482+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:11.497 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:57:11.587 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:11.582+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:11.611 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.3 to 1 (10000) 2024-05-10T09:57:11.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-10T09:57:11.675 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:11.675 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:11.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:57:11.690 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:11.686+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:11.788 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:11.786+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:11.852 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:11.852 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:11.866 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:57:11.889 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:11.890+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:11.990 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:11.986+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:12.024 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:12.024 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:12.039 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:57:12.123 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:12.122+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:12.192 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:12.190+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:12.193 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:12.193 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:12.206 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:57:12.293 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:12.290+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:12.367 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:12.367 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:12.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:57:12.394 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:12.394+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:12.494 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:12.490+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:12.499 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:12.499 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:12.512 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:57:12.595 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-05-10T09:57:12.594+0000 7f3474fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25243) UID: 0 2024-05-10T09:57:12.619 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.4 to 1 (10000) 2024-05-10T09:57:12.626 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-10T09:57:12.645 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-10T09:57:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:12.697 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:57:12.697 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:12.694+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:12.797 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:12.794+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:12.856 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:12.857 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:12.870 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:57:12.897 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:12.894+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:12.998 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:12.994+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:13.002 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:13.002 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:13.016 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:57:13.077 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-10T09:57:13.123 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:13.122+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:13.133 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:13.133 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:13.147 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:57:13.199 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:13.198+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:13.223 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:57:13.223 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:57:13.239 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:57:13.240 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:57:13.257 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:57:13.257 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:57:13.272 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:13.272 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:13.273 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:57:13.274 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:57:13.287 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:57:13.294 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:57:13.294 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:57:13.300 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:13.298+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:13.312 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:57:13.312 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:57:13.331 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:57:13.331 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:57:13.349 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:57:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:57:13.407 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:13.406+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:13.453 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:13.454 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:13.454 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:13.468 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:57:13.513 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:13.514+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:13.585 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:13.585 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:13.585 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:13.585 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:13.585 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:13.599 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:57:13.636 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.5 to 1 (10000) 2024-05-10T09:57:13.641 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:13.642+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:13.643 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is set 2024-05-10T09:57:13.664 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-10T09:57:13.708 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:13.706+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:13.768 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:13.768 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 146.07929024399999, 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026798326000000001, 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.769 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 46 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.770 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686809+0000", 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686813+0000", 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3869999999999999e-06 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686827+0000", 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4202999999999999e-05 2024-05-10T09:57:13.771 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686861+0000", 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4573000000000003e-05 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.686887+0000", 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5389999999999999e-05 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.772 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688858+0000", 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019710880000000002 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.688879+0000", 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.101e-05 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703604+0000", 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014725102 2024-05-10T09:57:13.773 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.703887+0000", 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000283155 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.704190+0000", 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030311500000000001 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.774 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713345+0000", 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0091544720000000003 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713441+0000", 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5926000000000003e-05 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713520+0000", 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9555999999999995e-05 2024-05-10T09:57:13.775 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:47.713607+0000", 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7348999999999993e-05 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1279 3.a 3:51af0144:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.969766823999997, 2024-05-10T09:57:13.776 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025099606, 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1279 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:13.777 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796333+0000", 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796337+0000", 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5070000000000002e-06 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.778 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802095+0000", 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0057576520000000003 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802133+0000", 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8349000000000002e-05 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802153+0000", 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9993e-05 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.779 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802280+0000", 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012646599999999999 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802566+0000", 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028610300000000001 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.802791+0000", 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022570199999999999 2024-05-10T09:57:13.780 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.816789+0000", 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013997486 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821159+0000", 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043700240000000001 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.781 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821316+0000", 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000156735 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.821432+0000", 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116589 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1284 3.36 3:6dea7185:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:13.782 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.915403974999997, 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02296221, 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1284 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.783 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850695+0000", 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.850699+0000", 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1240000000000001e-06 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.784 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855070+0000", 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043709580000000003 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855111+0000", 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1310000000000003e-05 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855134+0000", 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2860000000000001e-05 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.785 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855272+0000", 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013803099999999999 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855551+0000", 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027930799999999998 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:13.786 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.855782+0000", 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000231361 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866830+0000", 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011047631 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873500+0000", 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066699089999999999 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.787 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873591+0000", 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1448999999999998e-05 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.873658+0000", 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6268999999999999e-05 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.788 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1287 3.2c 3:364c59b2:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 41.880966495000003, 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024099597, 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1287 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.789 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885133+0000", 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.885136+0000", 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8040000000000002e-06 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.790 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889464+0000", 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043279219999999997 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889499+0000", 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5199e-05 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889515+0000", 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6422999999999998e-05 2024-05-10T09:57:13.791 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889643+0000", 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012816600000000001 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.889903+0000", 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025949099999999999 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 4", 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.890132+0000", 2024-05-10T09:57:13.792 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022953700000000001 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.902988+0000", 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012855171 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909041+0000", 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0060532249999999998 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.793 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909155+0000", 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011380200000000001 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.909233+0000", 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7856999999999997e-05 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.794 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1413 3.36 3:6e9d983e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.189193027000002, 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024918131999999999, 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1413 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.795 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576906+0000", 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.576908+0000", 2024-05-10T09:57:13.796 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1059999999999998e-06 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581066+0000", 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004157244 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581103+0000", 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6973e-05 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.797 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581120+0000", 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7343e-05 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581261+0000", 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000140672 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581530+0000", 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026880099999999999 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.798 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.581772+0000", 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000242754 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.590838+0000", 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0090655300000000005 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601650+0000", 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010812307 2024-05-10T09:57:13.799 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601751+0000", 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100766 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.601825+0000", 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3635999999999998e-05 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.800 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1424 3.a 3:50b58fe7:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 36.732916797000001, 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02028814, 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1424 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.801 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033183+0000", 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.033186+0000", 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3840000000000001e-06 2024-05-10T09:57:13.802 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039575+0000", 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0063893420000000001 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039613+0000", 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7518999999999998e-05 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.803 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039630+0000", 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.751e-05 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.039808+0000", 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000178025 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.040103+0000", 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000294531 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.804 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053142+0000", 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013038696000000001 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053249+0000", 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107255 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.053471+0000", 2024-05-10T09:57:13.805 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022187800000000001 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1444 3.26 3:66bf84d6:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 36.461819126000002, 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020383655000000001, 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.806 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1444 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304280+0000", 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.304284+0000", 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5300000000000001e-06 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309335+0000", 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050508920000000004 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309376+0000", 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1016000000000002e-05 2024-05-10T09:57:13.808 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309395+0000", 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8810000000000001e-05 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309534+0000", 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013921199999999999 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.309788+0000", 2024-05-10T09:57:13.809 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00025465399999999999 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.310003+0000", 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021485100000000001 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.317815+0000", 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0078115260000000001 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.810 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324488+0000", 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0066737289999999998 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324589+0000", 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100726 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.324664+0000", 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.4709000000000006e-05 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.811 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1462 3.2e e72/23 3:7600eb8f:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_11:head v 72'8, mlcod=71'6)", 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 35.880740865999996, 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021282938000000001, 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:13.812 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885359+0000", 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.885360+0000", 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9000000000000005e-07 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.813 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892622+0000", 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0072619779999999997 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892660+0000", 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8633000000000001e-05 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892678+0000", 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7649999999999999e-05 2024-05-10T09:57:13.814 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892846+0000", 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000168398 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.892886+0000", 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9687000000000001e-05 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906436+0000", 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013549913 2024-05-10T09:57:13.815 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.906641+0000", 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000205689 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1890 3.26 3:6441c4d1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eLGRCzvAKn5Xe45EeKu1jRkfp7sri7Z_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 23.305894015, 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018756142, 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.816 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1890 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.817 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460205+0000", 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.460208+0000", 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464849+0000", 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046407949999999996 2024-05-10T09:57:13.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464873+0000", 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4198000000000001e-05 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464885+0000", 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2140999999999999e-05 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.464984+0000", 2024-05-10T09:57:13.819 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8554999999999994e-05 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.465187+0000", 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020308699999999999 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.465374+0000", 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018783499999999999 2024-05-10T09:57:13.820 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478453+0000", 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.013078586999999999 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478854+0000", 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040133900000000001 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.821 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478909+0000", 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.5043000000000001e-05 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.478962+0000", 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.2101999999999997e-05 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.822 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1908 3.20 3:07202f49:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.mvxZi7wWQp_ksYLH8UPXA9st4FR8xsC_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 22.918435940999998, 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019735820000000001, 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1908 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.823 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847663+0000", 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.847667+0000", 2024-05-10T09:57:13.824 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0960000000000001e-06 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851785+0000", 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041181849999999999 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851824+0000", 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9093e-05 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.825 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.851842+0000", 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8073000000000001e-05 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852022+0000", 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018047500000000001 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852437+0000", 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000414473 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.826 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.852846+0000", 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00040883199999999998 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.865414+0000", 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012568025 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867026+0000", 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016125950000000001 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.827 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867241+0000", 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000214231 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.867399+0000", 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015874199999999999 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1949 3.34 3:2cfd8964:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.27:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:13.828 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 22.137220508999999, 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021673562, 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1949 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.829 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628879+0000", 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.628884+0000", 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8829999999999997e-06 2024-05-10T09:57:13.830 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634501+0000", 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056171010000000002 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634542+0000", 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1202000000000003e-05 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634561+0000", 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8810000000000001e-05 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.831 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.634728+0000", 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000167429 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.635037+0000", 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00030903700000000002 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650188+0000", 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.015150693999999999 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.832 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650319+0000", 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013108799999999999 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.650552+0000", 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023331799999999999 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.833 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2101 3.26 3:6736c732:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.l4HKo0CXzkRIBln1asb7Tsl7SBd3Xe4_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.966043412000001, 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024595580999999998, 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2101 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.834 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800056+0000", 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.800059+0000", 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.835 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.804969+0000", 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.004910101 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805006+0000", 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7552999999999998e-05 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805024+0000", 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7339000000000001e-05 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.836 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805231+0000", 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000207639 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805492+0000", 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026019699999999999 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.805725+0000", 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000233458 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.837 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.818550+0000", 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012825431999999999 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824473+0000", 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0059227009999999998 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824576+0000", 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000102716 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.838 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.824652+0000", 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5689e-05 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2164 3.36 3:6d000b3d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.61:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.619348388999999, 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.025900486, 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.839 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2164 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.840 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146751+0000", 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.146754+0000", 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.213e-06 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.841 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153344+0000", 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065897109999999998 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153382+0000", 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8442999999999998e-05 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153400+0000", 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8102999999999999e-05 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.842 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153548+0000", 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014760199999999999 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.153843+0000", 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029450100000000002 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.154739+0000", 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089651100000000001 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.843 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.171823+0000", 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017083876000000001 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172309+0000", 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00048598499999999998 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172525+0000", 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021564500000000001 2024-05-10T09:57:13.844 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.172652+0000", 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012689600000000001 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2179 3.10 3:0a70ef25:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.vqJ5AMnlx4wKf9S7A_dSxnf9MsffU8f_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:13.845 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.235036293, 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018648569, 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2179 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.846 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531063+0000", 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.531067+0000", 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4640000000000002e-06 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.847 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535287+0000", 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042203600000000003 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535329+0000", 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2166000000000003e-05 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535354+0000", 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5103999999999999e-05 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.848 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535534+0000", 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017949400000000001 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.535804+0000", 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000270568 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.536069+0000", 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000265204 2024-05-10T09:57:13.849 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.547341+0000", 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011271934000000001 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549501+0000", 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0021594000000000001 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.850 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549638+0000", 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000137591 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.549712+0000", 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3283999999999998e-05 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2351 3.35 3:af2cb2f3:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ERvMPbyGbxTK3yZf8d-eos4cAJCS1nt_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:13.851 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.674762736, 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.033203638000000001, 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2351 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.852 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091337+0000", 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.091340+0000", 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5260000000000002e-06 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099153+0000", 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0078130360000000006 2024-05-10T09:57:13.853 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099220+0000", 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6333000000000003e-05 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099249+0000", 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9726e-05 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099467+0000", 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000218008 2024-05-10T09:57:13.854 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.099745+0000", 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027729799999999999 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.100119+0000", 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037451999999999999 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.123559+0000", 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.02344011 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.855 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124250+0000", 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00069104699999999997 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124419+0000", 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000169011 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.124540+0000", 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121023 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.856 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2363 3.26 3:67c2ca38:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.8daeE6MCR3CM3-EPv7KojC_uJd-HRpg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.395246381, 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026306637000000001, 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2363 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.857 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370853+0000", 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.370857+0000", 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5999999999999998e-06 2024-05-10T09:57:13.858 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375256+0000", 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043994120000000001 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375293+0000", 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6542999999999999e-05 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.859 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375312+0000", 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9145999999999999e-05 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375485+0000", 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00017345199999999999 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375750+0000", 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026506700000000002 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:13.860 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.375992+0000", 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000241912 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.384943+0000", 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0089512959999999992 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.396853+0000", 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011909645 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.861 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.397036+0000", 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018318499999999999 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.397160+0000", 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012337900000000001 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2378 3.26 3:65ff8c9e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.95:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:13.862 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.125124109, 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026020666000000001, 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2378 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.863 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640975+0000", 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.640978+0000", 2024-05-10T09:57:13.864 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645532+0000", 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045536969999999998 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645572+0000", 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9826999999999997e-05 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.865 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645589+0000", 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7767000000000001e-05 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.645725+0000", 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135668 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.646030+0000", 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000304994 2024-05-10T09:57:13.866 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 7", 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.646938+0000", 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00090776500000000005 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.665975+0000", 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019037338000000001 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.867 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666795+0000", 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00082009900000000002 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666915+0000", 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000120226 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.666996+0000", 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0529000000000001e-05 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.868 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2408 3.20 3:04776303:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.100:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 12.498411914, 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022195091, 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.869 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2408 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267687+0000", 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.870 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.267690+0000", 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.706e-06 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272756+0000", 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0050657020000000001 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272795+0000", 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.9390000000000001e-05 2024-05-10T09:57:13.871 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272820+0000", 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.476e-05 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.272913+0000", 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3443000000000006e-05 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.273051+0000", 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013709599999999999 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.872 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.273492+0000", 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00044165600000000001 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.285685+0000", 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012192958 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289781+0000", 2024-05-10T09:57:13.873 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040954980000000004 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289842+0000", 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1544999999999994e-05 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.289883+0000", 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0336999999999997e-05 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.874 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2661 7.1f 7:f95f44c2:::notify.0:head [watch reconnect cookie 94491083449344 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:08.708396+0000", 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.0577033050000004, 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.96628057000000001, 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.875 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2661 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708396+0000", 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708396+0000", 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.876 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708398+0000", 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9010000000000001e-06 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708407+0000", 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2220000000000008e-06 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708426+0000", 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9269000000000001e-05 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.877 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708436+0000", 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9750000000000002e-06 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708515+0000", 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.8794000000000005e-05 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:13.878 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.708527+0000", 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1313e-05 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669049+0000", 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.960522506 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for degraded object", 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669482+0000", 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00043253399999999999 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.879 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.672311+0000", 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0028289249999999999 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.672411+0000", 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000100542 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.674677+0000", 2024-05-10T09:57:13.880 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022655890000000001 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2676 7.1f 7:f95f44c2:::notify.0:head [watch ping cookie 94491083449344 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:08.874077+0000", 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.892022817, 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.79933460700000003, 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:13.881 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2676 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874077+0000", 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.882 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874077+0000", 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874078+0000", 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0109999999999999e-06 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874085+0000", 2024-05-10T09:57:13.883 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9820000000000002e-06 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874094+0000", 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.8349999999999999e-06 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874109+0000", 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4241e-05 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.884 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874255+0000", 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000146186 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.874267+0000", 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1904e-05 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669538+0000", 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.79527115800000003 2024-05-10T09:57:13.885 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for degraded object", 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669606+0000", 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.7843999999999996e-05 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.672886+0000", 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0032801409999999999 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.886 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.673060+0000", 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000174465 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.673411+0000", 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035084 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:13.887 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:13.888 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:13.889 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:57:13.889 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:13.886+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:13.989 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:13.990+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:14.065 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:14.065 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:14.065 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 0 2024-05-10T09:57:14.065 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:14.079 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:57:14.121 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:14.122+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:14.190 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:14.186+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:14.246 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:14.246 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:14.246 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:14.246 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:14.247 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:14.261 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:57:14.291 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:14.286+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:14.384 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:14.384 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:14.384 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:14.384 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 166.845248881, 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.77147938900000002, 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1 2024-05-10T09:57:14.385 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536454+0000", 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.386 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536457+0000", 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2730000000000001e-06 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536471+0000", 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.4207e-05 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536493+0000", 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1806000000000001e-05 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.387 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536510+0000", 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7516999999999998e-05 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536699+0000", 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018853500000000001 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:27.536717+0000", 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8306000000000001e-05 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.388 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.304645+0000", 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.76792780400000005 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305114+0000", 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00046916299999999998 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.305635+0000", 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00052121600000000002 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.389 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307412+0000", 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017771760000000001 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307766+0000", 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00035397500000000003 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307864+0000", 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.7269000000000007e-05 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.390 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.307934+0000", 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.0141999999999994e-05 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4198.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 165.92110137, 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022163496000000001, 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.391 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4198", 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.181:0/3102128542", 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 52 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460602+0000", 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.392 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460603+0000", 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.9299999999999997e-07 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460608+0000", 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7939999999999999e-06 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460618+0000", 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2329999999999995e-06 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.393 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.460638+0000", 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0506999999999999e-05 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.478949+0000", 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018311251000000001 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479120+0000", 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170686 2024-05-10T09:57:14.394 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 0", 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.479315+0000", 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000194914 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.480657+0000", 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001341697 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482570+0000", 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019130390000000001 2024-05-10T09:57:14.395 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482650+0000", 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0443000000000002e-05 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:54:28.482765+0000", 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115239 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.396 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1277 3.2d 3:b6aa08bb:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.605253417999997, 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.020498677, 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1277 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.397 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776450+0000", 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.776453+0000", 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.61e-06 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.398 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780453+0000", 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0040001919999999996 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780490+0000", 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6887000000000001e-05 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780514+0000", 2024-05-10T09:57:14.399 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4206000000000002e-05 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780721+0000", 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020692799999999999 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.780986+0000", 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026536099999999998 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.400 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.781220+0000", 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023365699999999999 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.790889+0000", 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0096689380000000002 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796601+0000", 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005712778 2024-05-10T09:57:14.401 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796764+0000", 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000162922 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.796949+0000", 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000184198 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.402 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1283 3.37 3:efdd006e:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.xgHQxUI6u7xqQV0tiS8OrFYHHwAk78j_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 42.542012137, 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.027466540000000001, 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.403 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1283 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.404 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839691+0000", 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.839695+0000", 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7330000000000001e-06 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843941+0000", 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042461169999999998 2024-05-10T09:57:14.405 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.843982+0000", 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1083e-05 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844002+0000", 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9525999999999999e-05 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.406 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844137+0000", 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013504500000000001 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844411+0000", 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027433399999999999 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.844789+0000", 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00037824700000000001 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.407 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.859343+0000", 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014554197 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.866992+0000", 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0076486699999999998 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867082+0000", 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0229000000000006e-05 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.408 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:31.867158+0000", 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5358999999999995e-05 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1396 3.3b 3:dc07e632:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.2eXgq85NNpRKF9kNm7OiVX0ZIj_Zz_z_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 38.021644895000001, 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026528719999999999, 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.409 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1396 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.410 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360058+0000", 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.360061+0000", 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4600000000000002e-06 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.411 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364016+0000", 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039552420000000003 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364051+0000", 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.4603000000000001e-05 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364069+0000", 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7737e-05 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.412 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364204+0000", 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000135048 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364468+0000", 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000264505 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:14.413 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.364705+0000", 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000237004 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.375226+0000", 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.010521076000000001 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386408+0000", 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.011182133 2024-05-10T09:57:14.414 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386511+0000", 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000103226 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:36.386587+0000", 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5685999999999993e-05 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.415 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1429 3.16 e71/23 3:6a89a2ea:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_6:head v 71'2, mlcod=0'0)", 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.284808486000003, 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023672451000000001, 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.416 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096895+0000", 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.096897+0000", 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.537e-06 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101828+0000", 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0049309260000000004 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.417 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101999+0000", 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000170528 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102086+0000", 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.7626000000000004e-05 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.418 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102334+0000", 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024782500000000002 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.102407+0000", 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2595000000000005e-05 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120420+0000", 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.018012986000000002 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.419 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.120567+0000", 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014742800000000001 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1430 3.3f 3:fdde3335:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.uZiBTgpIBkS7iGGdJ7zDLHIqu2HBGYK_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 37.280221529999999, 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024797998000000002, 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.420 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1430 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101482+0000", 2024-05-10T09:57:14.421 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.101486+0000", 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.704e-06 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107182+0000", 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0056960689999999998 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.422 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107222+0000", 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0469999999999997e-05 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107242+0000", 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9606000000000002e-05 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107368+0000", 2024-05-10T09:57:14.423 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000126375 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107635+0000", 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00026656199999999997 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.107848+0000", 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000213348 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.424 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.124755+0000", 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016906694 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126120+0000", 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001365078 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126213+0000", 2024-05-10T09:57:14.425 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3392000000000003e-05 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:37.126280+0000", 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.6699999999999995e-05 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1896 3.d 3:b0b24c30:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_._ma-obcePPf33pO9_YysGtzoRZxwRw-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:14.426 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 23.789352186999999, 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024835817, 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1896 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:14.427 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592351+0000", 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.592355+0000", 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0960000000000003e-06 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.428 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598842+0000", 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0064869619999999998 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598884+0000", 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.1582000000000003e-05 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.598903+0000", 2024-05-10T09:57:14.429 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9179999999999999e-05 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599050+0000", 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014717199999999999 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599289+0000", 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023910399999999999 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.430 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.599537+0000", 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024756499999999999 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.616600+0000", 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017063595000000001 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.616939+0000", 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000338611 2024-05-10T09:57:14.431 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.617056+0000", 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117365 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.617187+0000", 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013058500000000001 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.432 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:1905 3.2f e76/23 3:f5382682:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.20:head v 76'7, mlcod=75'5)", 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 23.650349261999999, 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021046721000000001, 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:14.433 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731354+0000", 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.731356+0000", 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3800000000000001e-06 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.434 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735737+0000", 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0043807350000000002 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735787+0000", 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.0025999999999998e-05 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735808+0000", 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0757000000000001e-05 2024-05-10T09:57:14.435 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.735972+0000", 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000164458 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.736036+0000", 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3533000000000003e-05 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752295+0000", 2024-05-10T09:57:14.436 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016258943000000001 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:50.752401+0000", 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000105889 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1961 3.2d 3:b4c474b1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 22.526951004000001, 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024598571, 2024-05-10T09:57:14.437 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1961 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.438 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854752+0000", 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.854772+0000", 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0109999999999999e-05 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859886+0000", 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051130749999999999 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.439 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859931+0000", 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.5166000000000001e-05 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.859952+0000", 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1416999999999998e-05 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.860134+0000", 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000181748 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.440 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.860418+0000", 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00028398099999999999 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.861704+0000", 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001286124 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.874222+0000", 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.012517662000000001 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.441 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879108+0000", 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048859899999999998 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879245+0000", 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013758600000000001 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.442 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:51.879351+0000", 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010571199999999999 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:1992 3.37 3:eca7958d:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.34:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 21.949036781, 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022125657999999999, 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.443 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 1992 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.444 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432667+0000", 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.432670+0000", 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2229999999999999e-06 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436654+0000", 2024-05-10T09:57:14.445 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039841119999999997 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436702+0000", 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8214000000000003e-05 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436728+0000", 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5378999999999999e-05 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.446 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.436882+0000", 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015447900000000001 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.437177+0000", 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029461999999999999 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.438094+0000", 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091693500000000002 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.447 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.453044+0000", 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014949986 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454601+0000", 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001557622 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454713+0000", 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000111999 2024-05-10T09:57:14.448 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:52.454792+0000", 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.9089000000000001e-05 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2107 3.16 e77/23 3:6a82f1ca:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.aLkE1IIwI-rn4NM5LcNsVAHTPsdo775_1:head v 77'5, mlcod=77'3)", 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:14.449 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 19.46222624, 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021082284999999999, 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.450 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919477+0000", 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.919480+0000", 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0000000000000001e-06 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923913+0000", 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044326690000000002 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.451 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923956+0000", 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3433000000000002e-05 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.923976+0000", 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9746e-05 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.924169+0000", 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00019290799999999999 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.452 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.924244+0000", 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.5203000000000005e-05 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940452+0000", 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016208237 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:54.940559+0000", 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000107089 2024-05-10T09:57:14.453 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2116 3.37 3:edfc22f1:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.53:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 19.336315475999999, 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026773854, 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.454 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2116 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.455 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045388+0000", 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.045391+0000", 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8870000000000001e-06 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050687+0000", 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0052965269999999997 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.456 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050734+0000", 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6922999999999998e-05 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050753+0000", 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8998999999999999e-05 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.050897+0000", 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000143979 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.457 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.051195+0000", 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00029820399999999999 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.052113+0000", 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091760400000000003 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.071883+0000", 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.019769917000000001 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.458 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.071926+0000", 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3476000000000002e-05 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.072071+0000", 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014494599999999999 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.072162+0000", 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0391999999999998e-05 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.459 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2134 3.3f 3:fc237258:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.56:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e77)", 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.947537615999998, 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.022216153999999998, 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2134 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.460 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434166+0000", 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.461 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.434168+0000", 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.723e-06 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438441+0000", 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042722230000000003 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438477+0000", 2024-05-10T09:57:14.462 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6167000000000001e-05 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438494+0000", 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6869000000000001e-05 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438651+0000", 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157102 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.463 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.438926+0000", 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027485699999999999 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 6", 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.439838+0000", 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00091224899999999996 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.449638+0000", 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0097996699999999999 2024-05-10T09:57:14.464 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456041+0000", 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0064035469999999999 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456253+0000", 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00021152200000000001 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.465 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:55.456382+0000", 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012922500000000001 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2161 3.d 3:b1031fda:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.K-5eLppTKEd7J-RGTIuBx20U0o8LjUL_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 18.261260378999999, 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023170817999999999, 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.466 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2161 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.467 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120443+0000", 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.120446+0000", 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.756e-06 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124555+0000", 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0041096079999999998 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.468 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124593+0000", 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7759999999999998e-05 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124621+0000", 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7892999999999999e-05 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.124807+0000", 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00018641799999999999 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.469 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.125053+0000", 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000245734 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.125293+0000", 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023967500000000001 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.142601+0000", 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017307759999999998 2024-05-10T09:57:14.470 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143449+0000", 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00084868900000000002 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143545+0000", 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.5869e-05 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.143614+0000", 2024-05-10T09:57:14.471 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8656000000000001e-05 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2188 3.2d 3:b5013f7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.65:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.697247844, 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.023191018000000001, 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.472 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2188 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.473 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684456+0000", 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.684458+0000", 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4499999999999998e-06 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689791+0000", 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0053327269999999998 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.474 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689833+0000", 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2765999999999997e-05 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.689864+0000", 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0113000000000001e-05 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.690015+0000", 2024-05-10T09:57:14.475 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015094500000000001 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.690289+0000", 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027439800000000002 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.691184+0000", 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00089496400000000005 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.476 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.705596+0000", 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.014412004000000001 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707408+0000", 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018121599999999999 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707558+0000", 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000149882 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.477 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.707647+0000", 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.8609000000000005e-05 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2200 3.2d 3:b45272fd:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.67:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 17.444511113000001, 2024-05-10T09:57:14.478 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.029696365999999998, 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2200 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.479 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937192+0000", 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.937195+0000", 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3329999999999999e-06 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945152+0000", 2024-05-10T09:57:14.480 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.007957904 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945196+0000", 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3713e-05 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945215+0000", 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8706999999999999e-05 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.481 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945390+0000", 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000175415 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.945661+0000", 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00027069399999999998 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 2", 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.946547+0000", 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000886381 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.482 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.962695+0000", 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.016147551999999999 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966547+0000", 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0038517500000000001 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966747+0000", 2024-05-10T09:57:14.483 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020060499999999999 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:56.966889+0000", 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014131199999999999 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_repop(client.4373.0:2321 3.16 e79/23 3:69f47c7a:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.C5zaz_jZPpN7K1ZkpLeLlXZlOQ8ERKH_1:head v 79'7, mlcod=77'5)", 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.89658691, 2024-05-10T09:57:14.484 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.024182319000000001, 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485116+0000", 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.485 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.485119+0000", 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.52e-06 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491685+0000", 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0065661440000000003 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491721+0000", 2024-05-10T09:57:14.486 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.6334000000000001e-05 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491743+0000", 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1132999999999999e-05 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491909+0000", 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00016627100000000001 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.487 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.491978+0000", 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.8816e-05 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509202+0000", 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.017224525000000001 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.509299+0000", 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6576000000000005e-05 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.488 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2339 3.37 3:ecb6c252:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.ytosizOa3TRfLCiIY7rMbaujVoBKRtf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 14.540125244, 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.021264600000000002, 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2339 2024-05-10T09:57:14.489 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841578+0000", 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.490 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.841582+0000", 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.41e-06 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846176+0000", 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0045943909999999998 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846214+0000", 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8044999999999999e-05 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.491 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846237+0000", 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2904e-05 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846395+0000", 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015843199999999999 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846647+0000", 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000252107 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.492 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for subops from 5", 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.846884+0000", 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00023684500000000001 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.856729+0000", 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0098451330000000007 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "sub_op_commit_rec", 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862623+0000", 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0058940590000000001 2024-05-10T09:57:14.493 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862723+0000", 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9932000000000005e-05 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:56:59.862843+0000", 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000119342 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.494 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.495 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.497 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2396 3.e 3:7122cbf4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.98:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e79)", 2024-05-10T09:57:14.497 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 13.408071819, 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.026406023000000001, 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2396 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.498 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973632+0000", 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.973635+0000", 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0070000000000002e-06 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.499 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981572+0000", 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0079374649999999995 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981616+0000", 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.3720000000000002e-05 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981635+0000", 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8853000000000001e-05 2024-05-10T09:57:14.500 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.981789+0000", 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00015427799999999999 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.982065+0000", 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000276035 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "op_commit", 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.999455+0000", 2024-05-10T09:57:14.501 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.01738982 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "commit_sent", 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:00.999700+0000", 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00024511200000000002 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:01.000038+0000", 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000337733 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.502 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.503 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.503 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:14.505 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:57:14.505 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:14.502+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:adding file to bucket buck_2024_04_10_09_56_48: 10Mb.100 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:upload file successful 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.1 from bucket to /tmp/downloadfile.1 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.2 from bucket to /tmp/downloadfile.2 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.3 from bucket to /tmp/downloadfile.3 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.4 from bucket to /tmp/downloadfile.4 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.5 from bucket to /tmp/downloadfile.5 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.6 from bucket to /tmp/downloadfile.6 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.7 from bucket to /tmp/downloadfile.7 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.8 from bucket to /tmp/downloadfile.8 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.9 from bucket to /tmp/downloadfile.9 2024-05-10T09:57:14.516 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.10 from bucket to /tmp/downloadfile.10 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.11 from bucket to /tmp/downloadfile.11 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.12 from bucket to /tmp/downloadfile.12 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.13 from bucket to /tmp/downloadfile.13 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.14 from bucket to /tmp/downloadfile.14 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.15 from bucket to /tmp/downloadfile.15 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.16 from bucket to /tmp/downloadfile.16 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.17 from bucket to /tmp/downloadfile.17 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.18 from bucket to /tmp/downloadfile.18 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.19 from bucket to /tmp/downloadfile.19 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.20 from bucket to /tmp/downloadfile.20 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.21 from bucket to /tmp/downloadfile.21 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.22 from bucket to /tmp/downloadfile.22 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.23 from bucket to /tmp/downloadfile.23 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.24 from bucket to /tmp/downloadfile.24 2024-05-10T09:57:14.517 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.25 from bucket to /tmp/downloadfile.25 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.26 from bucket to /tmp/downloadfile.26 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.27 from bucket to /tmp/downloadfile.27 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.28 from bucket to /tmp/downloadfile.28 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.29 from bucket to /tmp/downloadfile.29 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.30 from bucket to /tmp/downloadfile.30 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.31 from bucket to /tmp/downloadfile.31 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.32 from bucket to /tmp/downloadfile.32 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.33 from bucket to /tmp/downloadfile.33 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.34 from bucket to /tmp/downloadfile.34 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.35 from bucket to /tmp/downloadfile.35 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.36 from bucket to /tmp/downloadfile.36 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.37 from bucket to /tmp/downloadfile.37 2024-05-10T09:57:14.518 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.38 from bucket to /tmp/downloadfile.38 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.39 from bucket to /tmp/downloadfile.39 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.40 from bucket to /tmp/downloadfile.40 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.41 from bucket to /tmp/downloadfile.41 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.42 from bucket to /tmp/downloadfile.42 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.43 from bucket to /tmp/downloadfile.43 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.44 from bucket to /tmp/downloadfile.44 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.45 from bucket to /tmp/downloadfile.45 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.46 from bucket to /tmp/downloadfile.46 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.47 from bucket to /tmp/downloadfile.47 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.48 from bucket to /tmp/downloadfile.48 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.49 from bucket to /tmp/downloadfile.49 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.50 from bucket to /tmp/downloadfile.50 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.51 from bucket to /tmp/downloadfile.51 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.52 from bucket to /tmp/downloadfile.52 2024-05-10T09:57:14.519 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.53 from bucket to /tmp/downloadfile.53 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.54 from bucket to /tmp/downloadfile.54 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.55 from bucket to /tmp/downloadfile.55 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.56 from bucket to /tmp/downloadfile.56 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.57 from bucket to /tmp/downloadfile.57 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.58 from bucket to /tmp/downloadfile.58 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.59 from bucket to /tmp/downloadfile.59 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.60 from bucket to /tmp/downloadfile.60 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.61 from bucket to /tmp/downloadfile.61 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.62 from bucket to /tmp/downloadfile.62 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.63 from bucket to /tmp/downloadfile.63 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.64 from bucket to /tmp/downloadfile.64 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.65 from bucket to /tmp/downloadfile.65 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.66 from bucket to /tmp/downloadfile.66 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.67 from bucket to /tmp/downloadfile.67 2024-05-10T09:57:14.520 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.68 from bucket to /tmp/downloadfile.68 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.69 from bucket to /tmp/downloadfile.69 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.70 from bucket to /tmp/downloadfile.70 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.71 from bucket to /tmp/downloadfile.71 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.72 from bucket to /tmp/downloadfile.72 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.73 from bucket to /tmp/downloadfile.73 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.74 from bucket to /tmp/downloadfile.74 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.75 from bucket to /tmp/downloadfile.75 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.76 from bucket to /tmp/downloadfile.76 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.77 from bucket to /tmp/downloadfile.77 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.78 from bucket to /tmp/downloadfile.78 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.79 from bucket to /tmp/downloadfile.79 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.80 from bucket to /tmp/downloadfile.80 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.81 from bucket to /tmp/downloadfile.81 2024-05-10T09:57:14.521 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.82 from bucket to /tmp/downloadfile.82 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.83 from bucket to /tmp/downloadfile.83 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.84 from bucket to /tmp/downloadfile.84 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.85 from bucket to /tmp/downloadfile.85 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.86 from bucket to /tmp/downloadfile.86 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.87 from bucket to /tmp/downloadfile.87 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.88 from bucket to /tmp/downloadfile.88 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.89 from bucket to /tmp/downloadfile.89 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.90 from bucket to /tmp/downloadfile.90 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.91 from bucket to /tmp/downloadfile.91 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.92 from bucket to /tmp/downloadfile.92 2024-05-10T09:57:14.522 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.93 from bucket to /tmp/downloadfile.93 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.94 from bucket to /tmp/downloadfile.94 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.95 from bucket to /tmp/downloadfile.95 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.96 from bucket to /tmp/downloadfile.96 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.97 from bucket to /tmp/downloadfile.97 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.98 from bucket to /tmp/downloadfile.98 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.99 from bucket to /tmp/downloadfile.99 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:Downloading 10Mb.100 from bucket to /tmp/downloadfile.100 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-05-10T09:57:14.523 INFO:tasks.workunit.client.0.smithi042.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-10T09:57:14.605 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:14.602+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:14.646 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.6 to 1 (10000) 2024-05-10T09:57:14.665 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-10T09:57:14.690 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.5024.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89)", 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:14.691326+0000", 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.00090105100000000004, 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00097983800000000002, 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.5024", 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/783471746", 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 89 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.691 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.691326+0000", 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.691326+0000", 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.691328+0000", 2024-05-10T09:57:14.692 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0480000000000001e-06 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.691337+0000", 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.1679999999999993e-06 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.691358+0000", 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0672000000000001e-05 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.691368+0000", 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0774000000000001e-05 2024-05-10T09:57:14.693 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.691484+0000", 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000116094 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.691619+0000", 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013458400000000001 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:14.694 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.695 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:14.695 INFO:teuthology.orchestra.run.smithi181.stdout: ], 2024-05-10T09:57:14.695 INFO:teuthology.orchestra.run.smithi181.stdout: "num_ops": 1 2024-05-10T09:57:14.695 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:14.706 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:57:14.711 INFO:tasks.ceph.osd.2.smithi042.stderr:2024-05-10T09:57:14.710+0000 7f724c088640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25102) UID: 0 2024-05-10T09:57:14.806 INFO:tasks.ceph.osd.7.smithi181.stderr:2024-05-10T09:57:14.806+0000 7f2b5e991640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25247) UID: 0 2024-05-10T09:57:14.842 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:14.842 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [], 2024-05-10T09:57:14.842 INFO:teuthology.orchestra.run.smithi181.stdout: "complaint_time": 30, 2024-05-10T09:57:14.842 INFO:teuthology.orchestra.run.smithi181.stdout: "num_blocked_ops": 0 2024-05-10T09:57:14.842 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:14.858 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:57:14.908 INFO:tasks.ceph.osd.3.smithi042.stderr:2024-05-10T09:57:14.906+0000 7f3e998dc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25104) UID: 0 2024-05-10T09:57:15.008 INFO:tasks.ceph.osd.1.smithi042.stderr:2024-05-10T09:57:15.006+0000 7f4a5019f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25100) UID: 0 2024-05-10T09:57:15.044 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-05-10T09:57:15.044 INFO:teuthology.orchestra.run.smithi181.stdout: "size": 20, 2024-05-10T09:57:15.044 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 600, 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "ops": [ 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2668 3.14 3:2a011de0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eHk4eMrRJM3cS-Q48W2BsKLN_D69iK7_1:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e83)", 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:08.855995+0000", 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 6.1870946169999996, 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.84593486600000001, 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:15.045 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2668 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.855995+0000", 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.855995+0000", 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.046 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.855998+0000", 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4830000000000002e-06 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856009+0000", 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.133e-05 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856031+0000", 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.1798999999999999e-05 2024-05-10T09:57:15.047 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856049+0000", 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7686999999999999e-05 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856153+0000", 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000104644 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for peered", 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:08.856169+0000", 2024-05-10T09:57:15.048 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5826000000000001e-05 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.662083+0000", 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.805913565 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "waiting for missing object", 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.662333+0000", 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000250117 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.049 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.696297+0000", 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.033964466999999998 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.696438+0000", 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00014065900000000001 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.701930+0000", 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.005492289 2024-05-10T09:57:15.050 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e5b7b639:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.Cf74aV4InIcSv68WXg_axwGYn27BuJi_12:head, version: 71'3, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:e5b7b639:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.Cf74aV4InIcSv68WXg_axwGYn27BuJi_12:head@71'3, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.654956+0000", 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.3881337189999998, 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0082345070000000003, 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.051 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.654956+0000", 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.654956+0000", 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.654957+0000", 2024-05-10T09:57:15.052 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.6000000000000004e-07 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660063+0000", 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0051057689999999996 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660109+0000", 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.6598999999999999e-05 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.053 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660167+0000", 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.7831000000000002e-05 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660388+0000", 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00022065 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.660436+0000", 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8000000000000001e-05 2024-05-10T09:57:15.054 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.663191+0000", 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027550980000000001 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.14 84/83 [PushOp(3:2a011de0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eHk4eMrRJM3cS-Q48W2BsKLN_D69iK7_1:head, version: 79'7, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:2a011de0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.eHk4eMrRJM3cS-Q48W2BsKLN_D69iK7_1:head@79'7, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.668790+0000", 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.3742996630000004, 2024-05-10T09:57:15.055 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036876449999999998, 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.668790+0000", 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.668790+0000", 2024-05-10T09:57:15.056 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.668791+0000", 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.6599999999999995e-07 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669892+0000", 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001100855 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.057 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669927+0000", 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.5417999999999999e-05 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.669955+0000", 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.7810999999999999e-05 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.670164+0000", 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020927000000000001 2024-05-10T09:57:15.058 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.670205+0000", 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0231999999999997e-05 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.672478+0000", 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002273293 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.059 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c3536bdc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_17:head, version: 72'1, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:c3536bdc:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.r0anTJq2CgX_5h7iw65h9M4z7muMz0P_17:head@72'1, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.673791+0000", 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.3692993360000001, 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0048843819999999996, 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.673791+0000", 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.060 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.673791+0000", 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.673792+0000", 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9999999999999995e-07 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.676971+0000", 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0031795809999999999 2024-05-10T09:57:15.061 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.677014+0000", 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.2796000000000002e-05 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.677039+0000", 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5338999999999999e-05 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.677187+0000", 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000147441 2024-05-10T09:57:15.062 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.677207+0000", 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0142000000000001e-05 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678675+0000", 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001468083 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.063 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e5b7b639:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.Cf74aV4InIcSv68WXg_axwGYn27BuJi_12:head, version: 71'3, data_included: [2097152~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:e5b7b639:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.Cf74aV4InIcSv68WXg_axwGYn27BuJi_12:head@71'3, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.676097+0000", 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.3669931960000001, 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0034061830000000001, 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.676097+0000", 2024-05-10T09:57:15.064 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.676097+0000", 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.676098+0000", 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.61e-06 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678159+0000", 2024-05-10T09:57:15.065 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020605549999999999 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678200+0000", 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.0992999999999999e-05 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678239+0000", 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8642e-05 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.066 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678351+0000", 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00011210299999999999 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.678360+0000", 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.0629999999999995e-06 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.679503+0000", 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001143217 2024-05-10T09:57:15.067 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head, version: 76'4, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 12, recovery_info: ObjectRecoveryInfo(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head@76'4, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.728333+0000", 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.3147572539999999, 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0037500609999999998, 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.068 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.728333+0000", 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.728333+0000", 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.728334+0000", 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3799999999999996e-07 2024-05-10T09:57:15.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730381+0000", 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0020475860000000001 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730406+0000", 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5009000000000001e-05 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730420+0000", 2024-05-10T09:57:15.070 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3842000000000001e-05 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730578+0000", 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000157832 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.730593+0000", 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5486e-05 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.071 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.732083+0000", 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001489368 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head, version: 76'4, data_included: [2097152~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head@76'4, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.740428+0000", 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.3026620339999999, 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003423021, 2024-05-10T09:57:15.072 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.740428+0000", 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.740428+0000", 2024-05-10T09:57:15.073 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.740429+0000", 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.0800000000000004e-07 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.741762+0000", 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001333339 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.074 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.741785+0000", 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3074e-05 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.741806+0000", 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0877e-05 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.742011+0000", 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020509 2024-05-10T09:57:15.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.742045+0000", 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.3722e-05 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.743851+0000", 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001806111 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.076 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e60fc7d4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Omlyut8jvwA6WAkdcBKdF9zMxMa5fC0_2:head, version: 75'6, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:e60fc7d4:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Omlyut8jvwA6WAkdcBKdF9zMxMa5fC0_2:head@75'6, size: 2097152, copy_subset: [(0, 2097152)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.746045+0000", 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.2970454799999995, 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003946064, 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.077 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746045+0000", 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746045+0000", 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746048+0000", 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.523e-06 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.078 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748412+0000", 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002364054 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748442+0000", 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.0215000000000001e-05 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748466+0000", 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.3706999999999999e-05 2024-05-10T09:57:15.079 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748589+0000", 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00012292600000000001 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748608+0000", 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9301999999999999e-05 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.749991+0000", 2024-05-10T09:57:15.080 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001382337 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head, version: 76'4, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:c09adb55:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.15:head@76'4, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.746272+0000", 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.2968182160000001, 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036164220000000002, 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.081 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746272+0000", 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746272+0000", 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.082 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.746273+0000", 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2130000000000001e-06 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748033+0000", 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001760445 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748071+0000", 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.7682000000000003e-05 2024-05-10T09:57:15.083 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748096+0000", 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.4994000000000002e-05 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748229+0000", 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013254 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.084 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.748247+0000", 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8544000000000001e-05 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.749888+0000", 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0016410039999999999 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.3 84/83 [PushOp(3:c3bbce48:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.30:head, version: 76'5, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:c3bbce48:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2_10Mb.30:head@76'5, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.770372+0000", 2024-05-10T09:57:15.085 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.2727183130000004, 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0046826439999999997, 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.770372+0000", 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.086 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.770372+0000", 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.770373+0000", 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.9300000000000006e-07 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772354+0000", 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001981741 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.087 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772381+0000", 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.6582999999999999e-05 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772401+0000", 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.9572000000000002e-05 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772537+0000", 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00013605 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.088 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.772553+0000", 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6762999999999999e-05 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.775054+0000", 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0025009419999999999 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e460a835:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.M1M7MFCTr3g93zoJrubSQcDZQ3YMhn-_1:head, version: 77'9, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:e460a835:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.M1M7MFCTr3g93zoJrubSQcDZQ3YMhn-_1:head@77'9, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:15.089 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.812231+0000", 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.230858692, 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003452587, 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.812231+0000", 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.090 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.812231+0000", 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.812232+0000", 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.3e-07 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814423+0000", 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.002190727 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.091 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814440+0000", 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7312999999999998e-05 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814453+0000", 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.2768999999999999e-05 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814563+0000", 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000110547 2024-05-10T09:57:15.092 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.814577+0000", 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.3217000000000001e-05 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.815684+0000", 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0011073840000000001 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.27 84/83 [PushOp(3:e426105c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.1xtBWPEQj7lfaNHJTw2Ua0-4RJwPN0I_1:head, version: 79'10, data_included: [3145728~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:e426105c:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.1xtBWPEQj7lfaNHJTw2Ua0-4RJwPN0I_1:head@79'10, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.836860+0000", 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.2062298980000001, 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0044046509999999999, 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.836860+0000", 2024-05-10T09:57:15.094 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.836860+0000", 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.836861+0000", 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.1900000000000002e-07 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.095 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838653+0000", 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0017922190000000001 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838701+0000", 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.8389e-05 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838746+0000", 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4236000000000001e-05 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.096 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838949+0000", 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00020313899999999999 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.838966+0000", 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.7702000000000001e-05 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.841265+0000", 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0022983470000000001 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.097 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:d912c5a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.lU0B2GRK3M0J0eVU9ODNBL6kcOFOokP_7:head, version: 71'2, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:d912c5a0:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.lU0B2GRK3M0J0eVU9ODNBL6kcOFOokP_7:head@71'2, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.845642+0000", 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.1974483679999999, 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033689850000000001, 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.098 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.845642+0000", 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.845642+0000", 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.845643+0000", 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.342e-06 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.099 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847525+0000", 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0018823780000000001 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847581+0000", 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 5.588e-05 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847626+0000", 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 4.4489e-05 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.100 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847741+0000", 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000115666 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.847753+0000", 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1844e-05 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.849011+0000", 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0012573860000000001 2024-05-10T09:57:15.101 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:dab81e27:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.lU0B2GRK3M0J0eVU9ODNBL6kcOFOokP_24:head, version: 71'3, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:dab81e27:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.1__shadow_.lU0B2GRK3M0J0eVU9ODNBL6kcOFOokP_24:head@71'3, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.874156+0000", 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.1689335170000001, 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035715510000000001, 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.102 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874156+0000", 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874156+0000", 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.874158+0000", 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.029e-06 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.103 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876093+0000", 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0019353599999999999 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876124+0000", 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.1199999999999999e-05 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876149+0000", 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.5409999999999999e-05 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.104 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876296+0000", 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000146766 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.876315+0000", 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.8921000000000001e-05 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.877728+0000", 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0014128649999999999 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.105 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:d9e10157:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Gj_nOJUTfvmNUaFHqwKUnpu-slR5bMR_1:head, version: 79'10, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:d9e10157:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.Gj_nOJUTfvmNUaFHqwKUnpu-slR5bMR_1:head@79'10, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.977759+0000", 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.0653308429999999, 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0036965890000000001, 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.106 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.977759+0000", 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.977759+0000", 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.977760+0000", 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.6299999999999993e-07 2024-05-10T09:57:15.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.109 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.978907+0000", 2024-05-10T09:57:15.109 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.001147368 2024-05-10T09:57:15.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.109 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.109 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.978937+0000", 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.9090000000000001e-05 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.978969+0000", 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.2085000000000002e-05 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.979087+0000", 2024-05-10T09:57:15.110 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000117998 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.979096+0000", 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.9020000000000005e-06 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.981456+0000", 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023601830000000001 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:d88d1550:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.DyDtw8JTcOFNdkwz3Cq-KneJ_TyzpIU_1:head, version: 79'11, data_included: [0~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:d88d1550:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.DyDtw8JTcOFNdkwz3Cq-KneJ_TyzpIU_1:head@79'11, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:09.997700+0000", 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.0453899089999998, 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0035740149999999998, 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.997700+0000", 2024-05-10T09:57:15.112 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.997700+0000", 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.997701+0000", 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.012e-06 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.113 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998696+0000", 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000994614 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998724+0000", 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.8714e-05 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998747+0000", 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.2495999999999999e-05 2024-05-10T09:57:15.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998868+0000", 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.000121483 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:09.998884+0000", 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.5381000000000001e-05 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.115 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.001274+0000", 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0023903150000000001 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.1b 84/83 [PushOp(3:d88d1550:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.DyDtw8JTcOFNdkwz3Cq-KneJ_TyzpIU_1:head, version: 79'11, data_included: [1048576~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:d88d1550:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.DyDtw8JTcOFNdkwz3Cq-KneJ_TyzpIU_1:head@79'11, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1048576, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:10.003342+0000", 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 5.0397483459999997, 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0042588189999999996, 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.116 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.003342+0000", 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.003342+0000", 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.117 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.003343+0000", 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.268e-06 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006707+0000", 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0033641190000000001 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006746+0000", 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8943000000000003e-05 2024-05-10T09:57:15.118 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006785+0000", 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 3.8658000000000002e-05 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006893+0000", 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00010863599999999999 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.119 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.006904+0000", 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0299000000000001e-05 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.007600+0000", 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.00069689600000000002 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.120 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.4373.0:2706 3.3 3:c2d658ff:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.PdLsDTA95CrN9ooWkOj_3U6wf3IE3zY_2:head [read 0~2097152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:10.373711+0000", 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.6693794109999995, 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003332968, 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.4373", 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/332755539", 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 2706 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.121 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373711+0000", 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373711+0000", 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373713+0000", 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0710000000000002e-06 2024-05-10T09:57:15.122 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373720+0000", 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.7559999999999999e-06 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373804+0000", 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3329000000000001e-05 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.123 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373869+0000", 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 6.5054000000000004e-05 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.373962+0000", 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.2974999999999997e-05 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.374055+0000", 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 9.3323000000000001e-05 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.124 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.377044+0000", 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0029884600000000001 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "MOSDPGPush(3.29 85/83 [PushOp(3:9452d492:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.96ic2g2SllWPMUNYDs3BnxUi73zdNqX_1:head, version: 78'12, data_included: [2097152~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:9452d492:::18d444c7-8ee7-4acd-b619-be3783007e3d.4373.2__shadow_.96ic2g2SllWPMUNYDs3BnxUi73zdNqX_1:head@78'12, size: 4194304, copy_subset: [(0, 4194304)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 3145728, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 2097152, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:10.617650+0000", 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 4.4254396219999999, 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0039030929999999998, 2024-05-10T09:57:15.125 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.617650+0000", 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.617650+0000", 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.126 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.617651+0000", 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.3200000000000004e-07 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618729+0000", 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0010777619999999999 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618746+0000", 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6952999999999998e-05 2024-05-10T09:57:15.127 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618757+0000", 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1195999999999999e-05 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618830+0000", 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.2793000000000006e-05 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.128 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.618840+0000", 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0052e-05 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:10.621553+0000", 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.0027135050000000002 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "description": "osd_op(client.5024.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-05-10T09:57:15.129 INFO:teuthology.orchestra.run.smithi181.stdout: "initiated_at": "2024-05-10T09:57:14.645370+0000", 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "age": 0.39771978000000002, 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003756629, 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "continuous": false, 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "type_data": { 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "flag_point": "started", 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "client_info": { 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "client": "client.5024", 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "client_addr": "172.21.15.42:0/783471746", 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "tid": 68 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "events": [ 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "initiated", 2024-05-10T09:57:15.130 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.645370+0000", 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "header_read", 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.645370+0000", 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "throttled", 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.645372+0000", 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 2.0880000000000002e-06 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.131 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "all_read", 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.645382+0000", 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.0079e-05 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "dispatched", 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.645399+0000", 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.6401000000000001e-05 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "queued_for_pg", 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.645410+0000", 2024-05-10T09:57:15.132 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 1.1263999999999999e-05 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "reached_pg", 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.645484+0000", 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 7.3522000000000005e-05 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "started", 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.645566+0000", 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 8.2640999999999997e-05 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: { 2024-05-10T09:57:15.133 INFO:teuthology.orchestra.run.smithi181.stdout: "event": "done", 2024-05-10T09:57:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "time": "2024-05-10T09:57:14.649127+0000", 2024-05-10T09:57:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: "duration": 0.003560634 2024-05-10T09:57:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-05-10T09:57:15.134 INFO:teuthology.orchestra.run.smithi181.stdout: ] 2024-05-10T09:57:15.134 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-05-10T09:57:15.135 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:15.134+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:15.136 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-10T09:57:15.236 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:15.234+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:15.268 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:57:15.268 INFO:teuthology.orchestra.run.smithi042.stdout: "num_ops": 0 2024-05-10T09:57:15.268 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:15.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-10T09:57:15.337 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:15.338+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:15.367 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-10T09:57:15.412 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "ops": [], 2024-05-10T09:57:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "complaint_time": 30, 2024-05-10T09:57:15.412 INFO:teuthology.orchestra.run.smithi042.stdout: "num_blocked_ops": 0 2024-05-10T09:57:15.412 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:15.428 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-10T09:57:15.438 INFO:tasks.ceph.osd.4.smithi181.stderr:2024-05-10T09:57:15.438+0000 7f6648e35640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 32230) UID: 0 2024-05-10T09:57:15.515 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0: {} 2024-05-10T09:57:15.515 INFO:teuthology.orchestra.run.smithi042.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-10T09:57:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:user 0.243827137255238 deleted 2024-05-10T09:57:15.525 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2024-05-10T09:57:15.525 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-10T09:57:15.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-10T09:57:15.531 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1: {} 2024-05-10T09:57:15.532 INFO:teuthology.orchestra.run.smithi042.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-10T09:57:15.541 INFO:tasks.workunit:Stopping ['rgw/s3_multipart_upload.pl'] on client.0... 2024-05-10T09:57:15.541 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-10T09:57:15.541 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:15.538+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:15.548 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2: {} 2024-05-10T09:57:15.549 INFO:teuthology.orchestra.run.smithi042.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-10T09:57:15.566 INFO:teuthology.orchestra.run.smithi042.stdout:osd.3: {} 2024-05-10T09:57:15.566 INFO:teuthology.orchestra.run.smithi042.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-10T09:57:15.586 INFO:teuthology.orchestra.run.smithi042.stdout:osd.4: {} 2024-05-10T09:57:15.586 INFO:teuthology.orchestra.run.smithi042.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-10T09:57:15.591 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:15.591 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:15.604 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-10T09:57:15.607 INFO:teuthology.orchestra.run.smithi042.stdout:osd.5: {} 2024-05-10T09:57:15.607 INFO:teuthology.orchestra.run.smithi042.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-10T09:57:15.627 INFO:teuthology.orchestra.run.smithi042.stdout:osd.6: {} 2024-05-10T09:57:15.627 INFO:teuthology.orchestra.run.smithi042.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-10T09:57:15.640 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:15.638+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:15.648 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.7 to 1 (10000) 2024-05-10T09:57:15.649 INFO:teuthology.orchestra.run.smithi042.stdout:osd.7: {} 2024-05-10T09:57:15.650 INFO:teuthology.orchestra.run.smithi042.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-10T09:57:15.666 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-10T09:57:15.682 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-10T09:57:15.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:57:15.733 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:15.733 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:15.740 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-10T09:57:15.738+0000 7f03fc22a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25098) UID: 0 2024-05-10T09:57:15.748 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-10T09:57:15.841 INFO:tasks.ceph.osd.6.smithi181.stderr:2024-05-10T09:57:15.838+0000 7fb2df380640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25245) UID: 0 2024-05-10T09:57:15.854 DEBUG:teuthology.parallel:result is None 2024-05-10T09:57:15.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T09:57:15.865 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T09:57:15.865 DEBUG:teuthology.orchestra.run.smithi042:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-10T09:57:15.904 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:15.904 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:15.913 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T09:57:15.913 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-05-10T09:57:15.922 INFO:tasks.thrashosds:joining thrashosds 2024-05-10T09:57:15.923 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-10T09:57:16.078 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:57:16.084 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:57:16.085 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:16.085 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:16.097 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-05-10T09:57:15.646151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1758204947,"num_objects":682,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":682,"num_whiteouts":0,"num_read":3307,"num_read_kb":2005310,"num_write":3012,"num_write_kb":2050163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1749,"ondisk_log_size":1749,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4122584,"kb_used_data":3855904,"kb_used_omap":16,"kb_used_meta":266543,"kb_avail":750852136,"statfs":{"total":773094113280,"available":768872587264,"internally_reserved":0,"allocated":3948445696,"data_stored":3944461265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":272940302},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-297692676,"num_objects":-71,"num_object_clones":0,"num_object_copies":-142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-71,"num_whiteouts":0,"num_read":854,"num_read_kb":129914,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":383790261,"num_keys_recovered":37,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038673"},"pg_stats":[{"pgid":"3.3f","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.214635+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:57:15.214635+0000","last_peered":"2024-05-10T09:57:15.214635+0000","last_clean":"2024-05-10T09:57:15.214635+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:57:15.214635+0000","last_undegraded":"2024-05-10T09:57:15.214635+0000","last_fullsized":"2024-05-10T09:57:15.214635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668907+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:57:14.668907+0000","last_peered":"2024-05-10T09:57:14.668907+0000","last_clean":"2024-05-10T09:57:14.668907+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:57:14.668907+0000","last_undegraded":"2024-05-10T09:57:14.668907+0000","last_fullsized":"2024-05-10T09:57:14.668907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"77'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980308+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:57:13.980308+0000","last_peered":"2024-05-10T09:57:13.980308+0000","last_clean":"2024-05-10T09:57:13.980308+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:57:13.980308+0000","last_undegraded":"2024-05-10T09:57:13.980308+0000","last_fullsized":"2024-05-10T09:57:13.980308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":10,"num_read_kb":30722,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'31","reported_seq":172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.846819+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:57:14.846819+0000","last_peered":"2024-05-10T09:57:14.846819+0000","last_clean":"2024-05-10T09:57:14.846819+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:57:14.846819+0000","last_undegraded":"2024-05-10T09:57:14.846819+0000","last_fullsized":"2024-05-10T09:57:14.846819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":78,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.912004+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:57:14.912004+0000","last_peered":"2024-05-10T09:57:14.912004+0000","last_clean":"2024-05-10T09:57:14.912004+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:57:14.912004+0000","last_undegraded":"2024-05-10T09:57:14.912004+0000","last_fullsized":"2024-05-10T09:57:14.912004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":28686,"num_write":39,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612166+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:57:11.612166+0000","last_peered":"2024-05-10T09:57:11.612166+0000","last_clean":"2024-05-10T09:57:11.612166+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:57:11.612166+0000","last_undegraded":"2024-05-10T09:57:11.612166+0000","last_fullsized":"2024-05-10T09:57:11.612166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'11","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.076606+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:57:15.076606+0000","last_peered":"2024-05-10T09:57:15.076606+0000","last_clean":"2024-05-10T09:57:15.076606+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:57:15.076606+0000","last_undegraded":"2024-05-10T09:57:15.076606+0000","last_fullsized":"2024-05-10T09:57:15.076606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":32788,"num_write":51,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660993+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:57:14.660993+0000","last_peered":"2024-05-10T09:57:14.660993+0000","last_clean":"2024-05-10T09:57:14.660993+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:57:14.660993+0000","last_undegraded":"2024-05-10T09:57:14.660993+0000","last_fullsized":"2024-05-10T09:57:14.660993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'16","reported_seq":173,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.188502+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:57:15.188502+0000","last_peered":"2024-05-10T09:57:15.188502+0000","last_clean":"2024-05-10T09:57:15.188502+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:57:15.188502+0000","last_undegraded":"2024-05-10T09:57:15.188502+0000","last_fullsized":"2024-05-10T09:57:15.188502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":43032,"num_write":56,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663763+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:57:14.663763+0000","last_peered":"2024-05-10T09:57:14.663763+0000","last_clean":"2024-05-10T09:57:14.663763+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:57:14.663763+0000","last_undegraded":"2024-05-10T09:57:14.663763+0000","last_fullsized":"2024-05-10T09:57:14.663763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.235284+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:57:15.235284+0000","last_peered":"2024-05-10T09:57:15.235284+0000","last_clean":"2024-05-10T09:57:15.235284+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:57:15.235284+0000","last_undegraded":"2024-05-10T09:57:15.235284+0000","last_fullsized":"2024-05-10T09:57:15.235284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":16,"num_read_kb":36872,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":118,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613205+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:57:11.613205+0000","last_peered":"2024-05-10T09:57:11.613205+0000","last_clean":"2024-05-10T09:57:11.613205+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:57:11.613205+0000","last_undegraded":"2024-05-10T09:57:11.613205+0000","last_fullsized":"2024-05-10T09:57:11.613205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'6","reported_seq":114,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.179409+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:57:15.179409+0000","last_peered":"2024-05-10T09:57:15.179409+0000","last_clean":"2024-05-10T09:57:15.179409+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:57:15.179409+0000","last_undegraded":"2024-05-10T09:57:15.179409+0000","last_fullsized":"2024-05-10T09:57:15.179409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670553+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:57:14.670553+0000","last_peered":"2024-05-10T09:57:14.670553+0000","last_clean":"2024-05-10T09:57:14.670553+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:57:14.670553+0000","last_undegraded":"2024-05-10T09:57:14.670553+0000","last_fullsized":"2024-05-10T09:57:14.670553+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"78'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644172+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:57:14.644172+0000","last_peered":"2024-05-10T09:57:14.644172+0000","last_clean":"2024-05-10T09:57:14.644172+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:57:14.644172+0000","last_undegraded":"2024-05-10T09:57:14.644172+0000","last_fullsized":"2024-05-10T09:57:14.644172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643301+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:57:14.643301+0000","last_peered":"2024-05-10T09:57:14.643301+0000","last_clean":"2024-05-10T09:57:14.643301+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:57:14.643301+0000","last_undegraded":"2024-05-10T09:57:14.643301+0000","last_fullsized":"2024-05-10T09:57:14.643301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611220+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:57:11.611220+0000","last_peered":"2024-05-10T09:57:11.611220+0000","last_clean":"2024-05-10T09:57:11.611220+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:57:11.611220+0000","last_undegraded":"2024-05-10T09:57:11.611220+0000","last_fullsized":"2024-05-10T09:57:11.611220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'7","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.725154+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:57:14.725154+0000","last_peered":"2024-05-10T09:57:14.725154+0000","last_clean":"2024-05-10T09:57:14.725154+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:57:14.725154+0000","last_undegraded":"2024-05-10T09:57:14.725154+0000","last_fullsized":"2024-05-10T09:57:14.725154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":22536,"num_write":27,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658205+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:57:14.658205+0000","last_peered":"2024-05-10T09:57:14.658205+0000","last_clean":"2024-05-10T09:57:14.658205+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:57:14.658205+0000","last_undegraded":"2024-05-10T09:57:14.658205+0000","last_fullsized":"2024-05-10T09:57:14.658205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'7","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.871393+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:57:14.871393+0000","last_peered":"2024-05-10T09:57:14.871393+0000","last_clean":"2024-05-10T09:57:14.871393+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:57:14.871393+0000","last_undegraded":"2024-05-10T09:57:14.871393+0000","last_fullsized":"2024-05-10T09:57:14.871393+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'33","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.749562+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:57:14.749562+0000","last_peered":"2024-05-10T09:57:14.749562+0000","last_clean":"2024-05-10T09:57:14.749562+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:57:14.749562+0000","last_undegraded":"2024-05-10T09:57:14.749562+0000","last_fullsized":"2024-05-10T09:57:14.749562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":84,"num_write":49,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"79'5","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664024+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:57:14.664024+0000","last_peered":"2024-05-10T09:57:14.664024+0000","last_clean":"2024-05-10T09:57:14.664024+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:57:14.664024+0000","last_undegraded":"2024-05-10T09:57:14.664024+0000","last_fullsized":"2024-05-10T09:57:14.664024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642792+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:57:14.642792+0000","last_peered":"2024-05-10T09:57:14.642792+0000","last_clean":"2024-05-10T09:57:14.642792+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:57:14.642792+0000","last_undegraded":"2024-05-10T09:57:14.642792+0000","last_fullsized":"2024-05-10T09:57:14.642792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"78'18","reported_seq":148,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614041+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:57:11.614041+0000","last_peered":"2024-05-10T09:57:11.614041+0000","last_clean":"2024-05-10T09:57:11.614041+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:57:11.614041+0000","last_undegraded":"2024-05-10T09:57:11.614041+0000","last_fullsized":"2024-05-10T09:57:11.614041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":61448,"num_write":38,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"79'19","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642980+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:57:14.642980+0000","last_peered":"2024-05-10T09:57:14.642980+0000","last_clean":"2024-05-10T09:57:14.642980+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:57:14.642980+0000","last_undegraded":"2024-05-10T09:57:14.642980+0000","last_fullsized":"2024-05-10T09:57:14.642980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:28.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":49,"num_write":28,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.898427+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:57:14.898427+0000","last_peered":"2024-05-10T09:57:14.898427+0000","last_clean":"2024-05-10T09:57:14.898427+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:57:14.898427+0000","last_undegraded":"2024-05-10T09:57:14.898427+0000","last_fullsized":"2024-05-10T09:57:14.898427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612837+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:57:11.612837+0000","last_peered":"2024-05-10T09:57:11.612837+0000","last_clean":"2024-05-10T09:57:11.612837+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:57:11.612837+0000","last_undegraded":"2024-05-10T09:57:11.612837+0000","last_fullsized":"2024-05-10T09:57:11.612837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"79'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660931+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:57:14.660931+0000","last_peered":"2024-05-10T09:57:14.660931+0000","last_clean":"2024-05-10T09:57:14.660931+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:57:14.660931+0000","last_undegraded":"2024-05-10T09:57:14.660931+0000","last_fullsized":"2024-05-10T09:57:14.660931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611728+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:57:11.611728+0000","last_peered":"2024-05-10T09:57:11.611728+0000","last_clean":"2024-05-10T09:57:11.611728+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:57:11.611728+0000","last_undegraded":"2024-05-10T09:57:11.611728+0000","last_fullsized":"2024-05-10T09:57:11.611728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645981+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:57:14.645981+0000","last_peered":"2024-05-10T09:57:14.645981+0000","last_clean":"2024-05-10T09:57:14.645981+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:57:14.645981+0000","last_undegraded":"2024-05-10T09:57:14.645981+0000","last_fullsized":"2024-05-10T09:57:14.645981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'10","reported_seq":186,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.203343+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:57:15.203343+0000","last_peered":"2024-05-10T09:57:15.203343+0000","last_clean":"2024-05-10T09:57:15.203343+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:57:15.203343+0000","last_undegraded":"2024-05-10T09:57:15.203343+0000","last_fullsized":"2024-05-10T09:57:15.203343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":18442,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670164+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:57:14.670164+0000","last_peered":"2024-05-10T09:57:14.670164+0000","last_clean":"2024-05-10T09:57:14.670164+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:57:14.670164+0000","last_undegraded":"2024-05-10T09:57:14.670164+0000","last_fullsized":"2024-05-10T09:57:14.670164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"89'14","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.880793+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:57:14.880793+0000","last_peered":"2024-05-10T09:57:14.880793+0000","last_clean":"2024-05-10T09:57:14.880793+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:57:14.880793+0000","last_undegraded":"2024-05-10T09:57:14.880793+0000","last_fullsized":"2024-05-10T09:57:14.880793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659360+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:57:14.659360+0000","last_peered":"2024-05-10T09:57:14.659360+0000","last_clean":"2024-05-10T09:57:14.659360+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:57:14.659360+0000","last_undegraded":"2024-05-10T09:57:14.659360+0000","last_fullsized":"2024-05-10T09:57:14.659360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669023+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:57:14.669023+0000","last_peered":"2024-05-10T09:57:14.669023+0000","last_clean":"2024-05-10T09:57:14.669023+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:57:14.669023+0000","last_undegraded":"2024-05-10T09:57:14.669023+0000","last_fullsized":"2024-05-10T09:57:14.669023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670472+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:57:14.670472+0000","last_peered":"2024-05-10T09:57:14.670472+0000","last_clean":"2024-05-10T09:57:14.670472+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:57:14.670472+0000","last_undegraded":"2024-05-10T09:57:14.670472+0000","last_fullsized":"2024-05-10T09:57:14.670472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'11","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.966513+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:57:14.966513+0000","last_peered":"2024-05-10T09:57:14.966513+0000","last_clean":"2024-05-10T09:57:14.966513+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:57:14.966513+0000","last_undegraded":"2024-05-10T09:57:14.966513+0000","last_fullsized":"2024-05-10T09:57:14.966513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645820+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:57:14.645820+0000","last_peered":"2024-05-10T09:57:14.645820+0000","last_clean":"2024-05-10T09:57:14.645820+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:57:14.645820+0000","last_undegraded":"2024-05-10T09:57:14.645820+0000","last_fullsized":"2024-05-10T09:57:14.645820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613295+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:57:11.613295+0000","last_peered":"2024-05-10T09:57:11.613295+0000","last_clean":"2024-05-10T09:57:11.613295+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:57:11.613295+0000","last_undegraded":"2024-05-10T09:57:11.613295+0000","last_fullsized":"2024-05-10T09:57:11.613295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614538+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:57:11.614538+0000","last_peered":"2024-05-10T09:57:11.614538+0000","last_clean":"2024-05-10T09:57:11.614538+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:57:11.614538+0000","last_undegraded":"2024-05-10T09:57:11.614538+0000","last_fullsized":"2024-05-10T09:57:11.614538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660749+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:57:14.660749+0000","last_peered":"2024-05-10T09:57:14.660749+0000","last_clean":"2024-05-10T09:57:14.660749+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:57:14.660749+0000","last_undegraded":"2024-05-10T09:57:14.660749+0000","last_fullsized":"2024-05-10T09:57:14.660749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662055+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:57:14.662055+0000","last_peered":"2024-05-10T09:57:14.662055+0000","last_clean":"2024-05-10T09:57:14.662055+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:57:14.662055+0000","last_undegraded":"2024-05-10T09:57:14.662055+0000","last_fullsized":"2024-05-10T09:57:14.662055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'13","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.031023+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:57:15.031023+0000","last_peered":"2024-05-10T09:57:15.031023+0000","last_clean":"2024-05-10T09:57:15.031023+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:57:15.031023+0000","last_undegraded":"2024-05-10T09:57:15.031023+0000","last_fullsized":"2024-05-10T09:57:15.031023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646795+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:57:14.646795+0000","last_peered":"2024-05-10T09:57:14.646795+0000","last_clean":"2024-05-10T09:57:14.646795+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:57:14.646795+0000","last_undegraded":"2024-05-10T09:57:14.646795+0000","last_fullsized":"2024-05-10T09:57:14.646795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642811+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:57:14.642811+0000","last_peered":"2024-05-10T09:57:14.642811+0000","last_clean":"2024-05-10T09:57:14.642811+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:57:14.642811+0000","last_undegraded":"2024-05-10T09:57:14.642811+0000","last_fullsized":"2024-05-10T09:57:14.642811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:28.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"88'13","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658261+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:57:14.658261+0000","last_peered":"2024-05-10T09:57:14.658261+0000","last_clean":"2024-05-10T09:57:14.658261+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:57:14.658261+0000","last_undegraded":"2024-05-10T09:57:14.658261+0000","last_fullsized":"2024-05-10T09:57:14.658261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612651+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:57:11.612651+0000","last_peered":"2024-05-10T09:57:11.612651+0000","last_clean":"2024-05-10T09:57:11.612651+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:57:11.612651+0000","last_undegraded":"2024-05-10T09:57:11.612651+0000","last_fullsized":"2024-05-10T09:57:11.612651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646130+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:57:14.646130+0000","last_peered":"2024-05-10T09:57:14.646130+0000","last_clean":"2024-05-10T09:57:14.646130+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:57:14.646130+0000","last_undegraded":"2024-05-10T09:57:14.646130+0000","last_fullsized":"2024-05-10T09:57:14.646130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.828622+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:57:14.828622+0000","last_peered":"2024-05-10T09:57:14.828622+0000","last_clean":"2024-05-10T09:57:14.828622+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:57:14.828622+0000","last_undegraded":"2024-05-10T09:57:14.828622+0000","last_fullsized":"2024-05-10T09:57:14.828622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670406+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:57:14.670406+0000","last_peered":"2024-05-10T09:57:14.670406+0000","last_clean":"2024-05-10T09:57:14.670406+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:57:14.670406+0000","last_undegraded":"2024-05-10T09:57:14.670406+0000","last_fullsized":"2024-05-10T09:57:14.670406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.946203+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:57:14.946203+0000","last_peered":"2024-05-10T09:57:14.946203+0000","last_clean":"2024-05-10T09:57:14.946203+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:57:14.946203+0000","last_undegraded":"2024-05-10T09:57:14.946203+0000","last_fullsized":"2024-05-10T09:57:14.946203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645117+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:57:14.645117+0000","last_peered":"2024-05-10T09:57:14.645117+0000","last_clean":"2024-05-10T09:57:14.645117+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:57:14.645117+0000","last_undegraded":"2024-05-10T09:57:14.645117+0000","last_fullsized":"2024-05-10T09:57:14.645117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669027+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:57:14.669027+0000","last_peered":"2024-05-10T09:57:14.669027+0000","last_clean":"2024-05-10T09:57:14.669027+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:57:14.669027+0000","last_undegraded":"2024-05-10T09:57:14.669027+0000","last_fullsized":"2024-05-10T09:57:14.669027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'7","reported_seq":176,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.055149+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:57:15.055149+0000","last_peered":"2024-05-10T09:57:15.055149+0000","last_clean":"2024-05-10T09:57:15.055149+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:57:15.055149+0000","last_undegraded":"2024-05-10T09:57:15.055149+0000","last_fullsized":"2024-05-10T09:57:15.055149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":18440,"num_write":27,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657400+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:57:14.657400+0000","last_peered":"2024-05-10T09:57:14.657400+0000","last_clean":"2024-05-10T09:57:14.657400+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:57:14.657400+0000","last_undegraded":"2024-05-10T09:57:14.657400+0000","last_fullsized":"2024-05-10T09:57:14.657400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"89'23","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.736581+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:57:14.736581+0000","last_peered":"2024-05-10T09:57:14.736581+0000","last_clean":"2024-05-10T09:57:14.736581+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:57:14.736581+0000","last_undegraded":"2024-05-10T09:57:14.736581+0000","last_fullsized":"2024-05-10T09:57:14.736581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980750+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:57:13.980750+0000","last_peered":"2024-05-10T09:57:13.980750+0000","last_clean":"2024-05-10T09:57:13.980750+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:57:13.980750+0000","last_undegraded":"2024-05-10T09:57:13.980750+0000","last_fullsized":"2024-05-10T09:57:13.980750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669713+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:57:14.669713+0000","last_peered":"2024-05-10T09:57:14.669713+0000","last_clean":"2024-05-10T09:57:14.669713+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:57:14.669713+0000","last_undegraded":"2024-05-10T09:57:14.669713+0000","last_fullsized":"2024-05-10T09:57:14.669713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":120,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611357+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:57:11.611357+0000","last_peered":"2024-05-10T09:57:11.611357+0000","last_clean":"2024-05-10T09:57:11.611357+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:57:11.611357+0000","last_undegraded":"2024-05-10T09:57:11.611357+0000","last_fullsized":"2024-05-10T09:57:11.611357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'13","reported_seq":193,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.894085+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:57:14.894085+0000","last_peered":"2024-05-10T09:57:14.894085+0000","last_clean":"2024-05-10T09:57:14.894085+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:57:14.894085+0000","last_undegraded":"2024-05-10T09:57:14.894085+0000","last_fullsized":"2024-05-10T09:57:14.894085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642617+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:57:14.642617+0000","last_peered":"2024-05-10T09:57:14.642617+0000","last_clean":"2024-05-10T09:57:14.642617+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:57:14.642617+0000","last_undegraded":"2024-05-10T09:57:14.642617+0000","last_fullsized":"2024-05-10T09:57:14.642617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.746019+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:57:14.746019+0000","last_peered":"2024-05-10T09:57:14.746019+0000","last_clean":"2024-05-10T09:57:14.746019+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:57:14.746019+0000","last_undegraded":"2024-05-10T09:57:14.746019+0000","last_fullsized":"2024-05-10T09:57:14.746019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644410+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:57:14.644410+0000","last_peered":"2024-05-10T09:57:14.644410+0000","last_clean":"2024-05-10T09:57:14.644410+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:57:14.644410+0000","last_undegraded":"2024-05-10T09:57:14.644410+0000","last_fullsized":"2024-05-10T09:57:14.644410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"75'1","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663569+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:57:14.663569+0000","last_peered":"2024-05-10T09:57:14.663569+0000","last_clean":"2024-05-10T09:57:14.663569+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:57:14.663569+0000","last_undegraded":"2024-05-10T09:57:14.663569+0000","last_fullsized":"2024-05-10T09:57:14.663569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663142+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:57:14.663142+0000","last_peered":"2024-05-10T09:57:14.663142+0000","last_clean":"2024-05-10T09:57:14.663142+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:57:14.663142+0000","last_undegraded":"2024-05-10T09:57:14.663142+0000","last_fullsized":"2024-05-10T09:57:14.663142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659722+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:57:14.659722+0000","last_peered":"2024-05-10T09:57:14.659722+0000","last_clean":"2024-05-10T09:57:14.659722+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:57:14.659722+0000","last_undegraded":"2024-05-10T09:57:14.659722+0000","last_fullsized":"2024-05-10T09:57:14.659722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643136+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:57:14.643136+0000","last_peered":"2024-05-10T09:57:14.643136+0000","last_clean":"2024-05-10T09:57:14.643136+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:57:14.643136+0000","last_undegraded":"2024-05-10T09:57:14.643136+0000","last_fullsized":"2024-05-10T09:57:14.643136+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"89'18","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.685205+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:57:14.685205+0000","last_peered":"2024-05-10T09:57:14.685205+0000","last_clean":"2024-05-10T09:57:14.685205+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:57:14.685205+0000","last_undegraded":"2024-05-10T09:57:14.685205+0000","last_fullsized":"2024-05-10T09:57:14.685205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660549+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:57:14.660549+0000","last_peered":"2024-05-10T09:57:14.660549+0000","last_clean":"2024-05-10T09:57:14.660549+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:57:14.660549+0000","last_undegraded":"2024-05-10T09:57:14.660549+0000","last_fullsized":"2024-05-10T09:57:14.660549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661542+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:57:14.661542+0000","last_peered":"2024-05-10T09:57:14.661542+0000","last_clean":"2024-05-10T09:57:14.661542+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:57:14.661542+0000","last_undegraded":"2024-05-10T09:57:14.661542+0000","last_fullsized":"2024-05-10T09:57:14.661542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'41","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.170938+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:57:15.170938+0000","last_peered":"2024-05-10T09:57:15.170938+0000","last_clean":"2024-05-10T09:57:15.170938+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:57:15.170938+0000","last_undegraded":"2024-05-10T09:57:15.170938+0000","last_fullsized":"2024-05-10T09:57:15.170938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":142,"num_read_kb":104,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'14","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.123860+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:57:15.123860+0000","last_peered":"2024-05-10T09:57:15.123860+0000","last_clean":"2024-05-10T09:57:15.123860+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:57:15.123860+0000","last_undegraded":"2024-05-10T09:57:15.123860+0000","last_fullsized":"2024-05-10T09:57:15.123860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":24,"num_read_kb":49166,"num_write":44,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643601+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:57:14.643601+0000","last_peered":"2024-05-10T09:57:14.643601+0000","last_clean":"2024-05-10T09:57:14.643601+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:57:14.643601+0000","last_undegraded":"2024-05-10T09:57:14.643601+0000","last_fullsized":"2024-05-10T09:57:14.643601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:37.269066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"89'22","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.018670+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:57:15.018670+0000","last_peered":"2024-05-10T09:57:15.018670+0000","last_clean":"2024-05-10T09:57:15.018670+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:57:15.018670+0000","last_undegraded":"2024-05-10T09:57:15.018670+0000","last_fullsized":"2024-05-10T09:57:15.018670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16575,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642535+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:57:14.642535+0000","last_peered":"2024-05-10T09:57:14.642535+0000","last_clean":"2024-05-10T09:57:14.642535+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:57:14.642535+0000","last_undegraded":"2024-05-10T09:57:14.642535+0000","last_fullsized":"2024-05-10T09:57:14.642535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979533+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:57:13.979533+0000","last_peered":"2024-05-10T09:57:13.979533+0000","last_clean":"2024-05-10T09:57:13.979533+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:57:13.979533+0000","last_undegraded":"2024-05-10T09:57:13.979533+0000","last_fullsized":"2024-05-10T09:57:13.979533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614061+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:57:11.614061+0000","last_peered":"2024-05-10T09:57:11.614061+0000","last_clean":"2024-05-10T09:57:11.614061+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:57:11.614061+0000","last_undegraded":"2024-05-10T09:57:11.614061+0000","last_fullsized":"2024-05-10T09:57:11.614061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.019224+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:57:15.019224+0000","last_peered":"2024-05-10T09:57:15.019224+0000","last_clean":"2024-05-10T09:57:15.019224+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:57:15.019224+0000","last_undegraded":"2024-05-10T09:57:15.019224+0000","last_fullsized":"2024-05-10T09:57:15.019224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":28688,"num_write":49,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642798+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:57:14.642798+0000","last_peered":"2024-05-10T09:57:14.642798+0000","last_clean":"2024-05-10T09:57:14.642798+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:57:14.642798+0000","last_undegraded":"2024-05-10T09:57:14.642798+0000","last_fullsized":"2024-05-10T09:57:14.642798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'14","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614674+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:57:11.614674+0000","last_peered":"2024-05-10T09:57:11.614674+0000","last_clean":"2024-05-10T09:57:11.614674+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:57:11.614674+0000","last_undegraded":"2024-05-10T09:57:11.614674+0000","last_fullsized":"2024-05-10T09:57:11.614674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662481+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:57:14.662481+0000","last_peered":"2024-05-10T09:57:14.662481+0000","last_clean":"2024-05-10T09:57:14.662481+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:57:14.662481+0000","last_undegraded":"2024-05-10T09:57:14.662481+0000","last_fullsized":"2024-05-10T09:57:14.662481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643655+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:57:14.643655+0000","last_peered":"2024-05-10T09:57:14.643655+0000","last_clean":"2024-05-10T09:57:14.643655+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:57:14.643655+0000","last_undegraded":"2024-05-10T09:57:14.643655+0000","last_fullsized":"2024-05-10T09:57:14.643655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613227+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:57:11.613227+0000","last_peered":"2024-05-10T09:57:11.613227+0000","last_clean":"2024-05-10T09:57:11.613227+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:57:11.613227+0000","last_undegraded":"2024-05-10T09:57:11.613227+0000","last_fullsized":"2024-05-10T09:57:11.613227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'7","reported_seq":171,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.171003+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:57:15.171003+0000","last_peered":"2024-05-10T09:57:15.171003+0000","last_clean":"2024-05-10T09:57:15.171003+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:57:15.171003+0000","last_undegraded":"2024-05-10T09:57:15.171003+0000","last_fullsized":"2024-05-10T09:57:15.171003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980390+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:57:13.980390+0000","last_peered":"2024-05-10T09:57:13.980390+0000","last_clean":"2024-05-10T09:57:13.980390+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:57:13.980390+0000","last_undegraded":"2024-05-10T09:57:13.980390+0000","last_fullsized":"2024-05-10T09:57:13.980390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"89'21","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.869191+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:57:14.869191+0000","last_peered":"2024-05-10T09:57:14.869191+0000","last_clean":"2024-05-10T09:57:14.869191+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:57:14.869191+0000","last_undegraded":"2024-05-10T09:57:14.869191+0000","last_fullsized":"2024-05-10T09:57:14.869191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"88'13","reported_seq":187,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643053+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:57:14.643053+0000","last_peered":"2024-05-10T09:57:14.643053+0000","last_clean":"2024-05-10T09:57:14.643053+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:57:14.643053+0000","last_undegraded":"2024-05-10T09:57:14.643053+0000","last_fullsized":"2024-05-10T09:57:14.643053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'1","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977575+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:57:13.977575+0000","last_peered":"2024-05-10T09:57:13.977575+0000","last_clean":"2024-05-10T09:57:13.977575+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:57:13.977575+0000","last_undegraded":"2024-05-10T09:57:13.977575+0000","last_fullsized":"2024-05-10T09:57:13.977575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614297+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:57:11.614297+0000","last_peered":"2024-05-10T09:57:11.614297+0000","last_clean":"2024-05-10T09:57:11.614297+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:57:11.614297+0000","last_undegraded":"2024-05-10T09:57:11.614297+0000","last_fullsized":"2024-05-10T09:57:11.614297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"78'3","reported_seq":121,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612084+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:57:11.612084+0000","last_peered":"2024-05-10T09:57:11.612084+0000","last_clean":"2024-05-10T09:57:11.612084+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:57:11.612084+0000","last_undegraded":"2024-05-10T09:57:11.612084+0000","last_fullsized":"2024-05-10T09:57:11.612084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670534+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:57:14.670534+0000","last_peered":"2024-05-10T09:57:14.670534+0000","last_clean":"2024-05-10T09:57:14.670534+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:57:14.670534+0000","last_undegraded":"2024-05-10T09:57:14.670534+0000","last_fullsized":"2024-05-10T09:57:14.670534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645293+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:57:14.645293+0000","last_peered":"2024-05-10T09:57:14.645293+0000","last_clean":"2024-05-10T09:57:14.645293+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:57:14.645293+0000","last_undegraded":"2024-05-10T09:57:14.645293+0000","last_fullsized":"2024-05-10T09:57:14.645293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"88'13","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663712+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:57:14.663712+0000","last_peered":"2024-05-10T09:57:14.663712+0000","last_clean":"2024-05-10T09:57:14.663712+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:57:14.663712+0000","last_undegraded":"2024-05-10T09:57:14.663712+0000","last_fullsized":"2024-05-10T09:57:14.663712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612069+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:57:11.612069+0000","last_peered":"2024-05-10T09:57:11.612069+0000","last_clean":"2024-05-10T09:57:11.612069+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:57:11.612069+0000","last_undegraded":"2024-05-10T09:57:11.612069+0000","last_fullsized":"2024-05-10T09:57:11.612069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"79'23","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978687+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:57:13.978687+0000","last_peered":"2024-05-10T09:57:13.978687+0000","last_clean":"2024-05-10T09:57:13.978687+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:57:13.978687+0000","last_undegraded":"2024-05-10T09:57:13.978687+0000","last_fullsized":"2024-05-10T09:57:13.978687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":77,"num_read_kb":55,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.978093+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:57:14.978093+0000","last_peered":"2024-05-10T09:57:14.978093+0000","last_clean":"2024-05-10T09:57:14.978093+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:57:14.978093+0000","last_undegraded":"2024-05-10T09:57:14.978093+0000","last_fullsized":"2024-05-10T09:57:14.978093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":18,"num_read_kb":43016,"num_write":32,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613792+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:57:11.613792+0000","last_peered":"2024-05-10T09:57:11.613792+0000","last_clean":"2024-05-10T09:57:11.613792+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:57:11.613792+0000","last_undegraded":"2024-05-10T09:57:11.613792+0000","last_fullsized":"2024-05-10T09:57:11.613792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"89'24","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.958778+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:57:14.958778+0000","last_peered":"2024-05-10T09:57:14.958778+0000","last_clean":"2024-05-10T09:57:14.958778+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:57:14.958778+0000","last_undegraded":"2024-05-10T09:57:14.958778+0000","last_fullsized":"2024-05-10T09:57:14.958778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663509+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:57:14.663509+0000","last_peered":"2024-05-10T09:57:14.663509+0000","last_clean":"2024-05-10T09:57:14.663509+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:57:14.663509+0000","last_undegraded":"2024-05-10T09:57:14.663509+0000","last_fullsized":"2024-05-10T09:57:14.663509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977320+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:57:13.977320+0000","last_peered":"2024-05-10T09:57:13.977320+0000","last_clean":"2024-05-10T09:57:13.977320+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:57:13.977320+0000","last_undegraded":"2024-05-10T09:57:13.977320+0000","last_fullsized":"2024-05-10T09:57:13.977320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'45","reported_seq":194,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.032881+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:57:15.032881+0000","last_peered":"2024-05-10T09:57:15.032881+0000","last_clean":"2024-05-10T09:57:15.032881+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:57:15.032881+0000","last_undegraded":"2024-05-10T09:57:15.032881+0000","last_fullsized":"2024-05-10T09:57:15.032881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":156,"num_read_kb":114,"num_write":67,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":243,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658368+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:57:14.658368+0000","last_peered":"2024-05-10T09:57:14.658368+0000","last_clean":"2024-05-10T09:57:14.658368+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:57:14.658368+0000","last_undegraded":"2024-05-10T09:57:14.658368+0000","last_fullsized":"2024-05-10T09:57:14.658368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669666+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:57:14.669666+0000","last_peered":"2024-05-10T09:57:14.669666+0000","last_clean":"2024-05-10T09:57:14.669666+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:57:14.669666+0000","last_undegraded":"2024-05-10T09:57:14.669666+0000","last_fullsized":"2024-05-10T09:57:14.669666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'11","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.925227+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:57:14.925227+0000","last_peered":"2024-05-10T09:57:14.925227+0000","last_clean":"2024-05-10T09:57:14.925227+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:57:14.925227+0000","last_undegraded":"2024-05-10T09:57:14.925227+0000","last_fullsized":"2024-05-10T09:57:14.925227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658016+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:57:14.658016+0000","last_peered":"2024-05-10T09:57:14.658016+0000","last_clean":"2024-05-10T09:57:14.658016+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:57:14.658016+0000","last_undegraded":"2024-05-10T09:57:14.658016+0000","last_fullsized":"2024-05-10T09:57:14.658016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"89'30","reported_seq":172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.229354+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:57:15.229354+0000","last_peered":"2024-05-10T09:57:15.229354+0000","last_clean":"2024-05-10T09:57:15.229354+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:57:15.229354+0000","last_undegraded":"2024-05-10T09:57:15.229354+0000","last_fullsized":"2024-05-10T09:57:15.229354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18409,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661634+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:57:14.661634+0000","last_peered":"2024-05-10T09:57:14.661634+0000","last_clean":"2024-05-10T09:57:14.661634+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:57:14.661634+0000","last_undegraded":"2024-05-10T09:57:14.661634+0000","last_fullsized":"2024-05-10T09:57:14.661634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662474+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:57:14.662474+0000","last_peered":"2024-05-10T09:57:14.662474+0000","last_clean":"2024-05-10T09:57:14.662474+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:57:14.662474+0000","last_undegraded":"2024-05-10T09:57:14.662474+0000","last_fullsized":"2024-05-10T09:57:14.662474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661914+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:57:14.661914+0000","last_peered":"2024-05-10T09:57:14.661914+0000","last_clean":"2024-05-10T09:57:14.661914+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:57:14.661914+0000","last_undegraded":"2024-05-10T09:57:14.661914+0000","last_fullsized":"2024-05-10T09:57:14.661914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657868+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:57:14.657868+0000","last_peered":"2024-05-10T09:57:14.657868+0000","last_clean":"2024-05-10T09:57:14.657868+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:57:14.657868+0000","last_undegraded":"2024-05-10T09:57:14.657868+0000","last_fullsized":"2024-05-10T09:57:14.657868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'12","reported_seq":196,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660796+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:57:14.660796+0000","last_peered":"2024-05-10T09:57:14.660796+0000","last_clean":"2024-05-10T09:57:14.660796+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:57:14.660796+0000","last_undegraded":"2024-05-10T09:57:14.660796+0000","last_fullsized":"2024-05-10T09:57:14.660796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.015437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.671724+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:57:14.671724+0000","last_peered":"2024-05-10T09:57:14.671724+0000","last_clean":"2024-05-10T09:57:14.671724+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:57:14.671724+0000","last_undegraded":"2024-05-10T09:57:14.671724+0000","last_fullsized":"2024-05-10T09:57:14.671724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'32","reported_seq":209,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979027+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:57:13.979027+0000","last_peered":"2024-05-10T09:57:13.979027+0000","last_clean":"2024-05-10T09:57:13.979027+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:57:13.979027+0000","last_undegraded":"2024-05-10T09:57:13.979027+0000","last_fullsized":"2024-05-10T09:57:13.979027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658354+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:57:14.658354+0000","last_peered":"2024-05-10T09:57:14.658354+0000","last_clean":"2024-05-10T09:57:14.658354+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:57:14.658354+0000","last_undegraded":"2024-05-10T09:57:14.658354+0000","last_fullsized":"2024-05-10T09:57:14.658354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977492+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:57:13.977492+0000","last_peered":"2024-05-10T09:57:13.977492+0000","last_clean":"2024-05-10T09:57:13.977492+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:57:13.977492+0000","last_undegraded":"2024-05-10T09:57:13.977492+0000","last_fullsized":"2024-05-10T09:57:13.977492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980779+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:57:13.980779+0000","last_peered":"2024-05-10T09:57:13.980779+0000","last_clean":"2024-05-10T09:57:13.980779+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:57:13.980779+0000","last_undegraded":"2024-05-10T09:57:13.980779+0000","last_fullsized":"2024-05-10T09:57:13.980779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643785+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:57:14.643785+0000","last_peered":"2024-05-10T09:57:14.643785+0000","last_clean":"2024-05-10T09:57:14.643785+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:57:14.643785+0000","last_undegraded":"2024-05-10T09:57:14.643785+0000","last_fullsized":"2024-05-10T09:57:14.643785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978346+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:57:13.978346+0000","last_peered":"2024-05-10T09:57:13.978346+0000","last_clean":"2024-05-10T09:57:13.978346+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:57:13.978346+0000","last_undegraded":"2024-05-10T09:57:13.978346+0000","last_fullsized":"2024-05-10T09:57:13.978346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":12,"num_read_kb":26628,"num_write":28,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":134,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643210+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:57:14.643210+0000","last_peered":"2024-05-10T09:57:14.643210+0000","last_clean":"2024-05-10T09:57:14.643210+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:57:14.643210+0000","last_undegraded":"2024-05-10T09:57:14.643210+0000","last_fullsized":"2024-05-10T09:57:14.643210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658897+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:57:14.658897+0000","last_peered":"2024-05-10T09:57:14.658897+0000","last_clean":"2024-05-10T09:57:14.658897+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:57:14.658897+0000","last_undegraded":"2024-05-10T09:57:14.658897+0000","last_fullsized":"2024-05-10T09:57:14.658897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661078+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:57:14.661078+0000","last_peered":"2024-05-10T09:57:14.661078+0000","last_clean":"2024-05-10T09:57:14.661078+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:57:14.661078+0000","last_undegraded":"2024-05-10T09:57:14.661078+0000","last_fullsized":"2024-05-10T09:57:14.661078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:06.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645314+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:57:14.645314+0000","last_peered":"2024-05-10T09:57:14.645314+0000","last_clean":"2024-05-10T09:57:14.645314+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:57:14.645314+0000","last_undegraded":"2024-05-10T09:57:14.645314+0000","last_fullsized":"2024-05-10T09:57:14.645314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977515+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:57:13.977515+0000","last_peered":"2024-05-10T09:57:13.977515+0000","last_clean":"2024-05-10T09:57:13.977515+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:57:13.977515+0000","last_undegraded":"2024-05-10T09:57:13.977515+0000","last_fullsized":"2024-05-10T09:57:13.977515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669739+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:57:14.669739+0000","last_peered":"2024-05-10T09:57:14.669739+0000","last_clean":"2024-05-10T09:57:14.669739+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:57:14.669739+0000","last_undegraded":"2024-05-10T09:57:14.669739+0000","last_fullsized":"2024-05-10T09:57:14.669739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"79'8","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612044+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:57:11.612044+0000","last_peered":"2024-05-10T09:57:11.612044+0000","last_clean":"2024-05-10T09:57:11.612044+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:57:11.612044+0000","last_undegraded":"2024-05-10T09:57:11.612044+0000","last_fullsized":"2024-05-10T09:57:11.612044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":12,"num_read_kb":24580,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661261+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:57:14.661261+0000","last_peered":"2024-05-10T09:57:14.661261+0000","last_clean":"2024-05-10T09:57:14.661261+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:57:14.661261+0000","last_undegraded":"2024-05-10T09:57:14.661261+0000","last_fullsized":"2024-05-10T09:57:14.661261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645918+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:57:14.645918+0000","last_peered":"2024-05-10T09:57:14.645918+0000","last_clean":"2024-05-10T09:57:14.645918+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:57:14.645918+0000","last_undegraded":"2024-05-10T09:57:14.645918+0000","last_fullsized":"2024-05-10T09:57:14.645918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663991+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:57:14.663991+0000","last_peered":"2024-05-10T09:57:14.663991+0000","last_clean":"2024-05-10T09:57:14.663991+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:57:14.663991+0000","last_undegraded":"2024-05-10T09:57:14.663991+0000","last_fullsized":"2024-05-10T09:57:14.663991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668718+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:57:14.668718+0000","last_peered":"2024-05-10T09:57:14.668718+0000","last_clean":"2024-05-10T09:57:14.668718+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:57:14.668718+0000","last_undegraded":"2024-05-10T09:57:14.668718+0000","last_fullsized":"2024-05-10T09:57:14.668718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979564+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:57:13.979564+0000","last_peered":"2024-05-10T09:57:13.979564+0000","last_clean":"2024-05-10T09:57:13.979564+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:57:13.979564+0000","last_undegraded":"2024-05-10T09:57:13.979564+0000","last_fullsized":"2024-05-10T09:57:13.979564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'13","reported_seq":166,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.817255+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:57:14.817255+0000","last_peered":"2024-05-10T09:57:14.817255+0000","last_clean":"2024-05-10T09:57:14.817255+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:57:14.817255+0000","last_undegraded":"2024-05-10T09:57:14.817255+0000","last_fullsized":"2024-05-10T09:57:14.817255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":19,"num_read_kb":45064,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979878+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:57:13.979878+0000","last_peered":"2024-05-10T09:57:13.979878+0000","last_clean":"2024-05-10T09:57:13.979878+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:57:13.979878+0000","last_undegraded":"2024-05-10T09:57:13.979878+0000","last_fullsized":"2024-05-10T09:57:13.979878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661037+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:57:14.661037+0000","last_peered":"2024-05-10T09:57:14.661037+0000","last_clean":"2024-05-10T09:57:14.661037+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:57:14.661037+0000","last_undegraded":"2024-05-10T09:57:14.661037+0000","last_fullsized":"2024-05-10T09:57:14.661037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"89'25","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.028912+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:57:15.028912+0000","last_peered":"2024-05-10T09:57:15.028912+0000","last_clean":"2024-05-10T09:57:15.028912+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:57:15.028912+0000","last_undegraded":"2024-05-10T09:57:15.028912+0000","last_fullsized":"2024-05-10T09:57:15.028912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9860,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613125+0000","last_change":"2024-05-10T09:57:09.652257+0000","last_active":"2024-05-10T09:57:11.613125+0000","last_peered":"2024-05-10T09:57:11.613125+0000","last_clean":"2024-05-10T09:57:11.613125+0000","last_became_active":"2024-05-10T09:57:09.648476+0000","last_became_peered":"2024-05-10T09:57:09.648476+0000","last_unstale":"2024-05-10T09:57:11.613125+0000","last_undegraded":"2024-05-10T09:57:11.613125+0000","last_fullsized":"2024-05-10T09:57:11.613125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:20.904851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661288+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:57:14.661288+0000","last_peered":"2024-05-10T09:57:14.661288+0000","last_clean":"2024-05-10T09:57:14.661288+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:57:14.661288+0000","last_undegraded":"2024-05-10T09:57:14.661288+0000","last_fullsized":"2024-05-10T09:57:14.661288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'37","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.798413+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:57:14.798413+0000","last_peered":"2024-05-10T09:57:14.798413+0000","last_clean":"2024-05-10T09:57:14.798413+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:57:14.798413+0000","last_undegraded":"2024-05-10T09:57:14.798413+0000","last_fullsized":"2024-05-10T09:57:14.798413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":94,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"77'3","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979612+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:57:13.979612+0000","last_peered":"2024-05-10T09:57:13.979612+0000","last_clean":"2024-05-10T09:57:13.979612+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:57:13.979612+0000","last_undegraded":"2024-05-10T09:57:13.979612+0000","last_fullsized":"2024-05-10T09:57:13.979612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659830+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:57:14.659830+0000","last_peered":"2024-05-10T09:57:14.659830+0000","last_clean":"2024-05-10T09:57:14.659830+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:57:14.659830+0000","last_undegraded":"2024-05-10T09:57:14.659830+0000","last_fullsized":"2024-05-10T09:57:14.659830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663017+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:57:14.663017+0000","last_peered":"2024-05-10T09:57:14.663017+0000","last_clean":"2024-05-10T09:57:14.663017+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:57:14.663017+0000","last_undegraded":"2024-05-10T09:57:14.663017+0000","last_fullsized":"2024-05-10T09:57:14.663017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978748+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:57:13.978748+0000","last_peered":"2024-05-10T09:57:13.978748+0000","last_clean":"2024-05-10T09:57:13.978748+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:57:13.978748+0000","last_undegraded":"2024-05-10T09:57:13.978748+0000","last_fullsized":"2024-05-10T09:57:13.978748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"88'13","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668905+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:57:14.668905+0000","last_peered":"2024-05-10T09:57:14.668905+0000","last_clean":"2024-05-10T09:57:14.668905+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:57:14.668905+0000","last_undegraded":"2024-05-10T09:57:14.668905+0000","last_fullsized":"2024-05-10T09:57:14.668905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646585+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:57:14.646585+0000","last_peered":"2024-05-10T09:57:14.646585+0000","last_clean":"2024-05-10T09:57:14.646585+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:57:14.646585+0000","last_undegraded":"2024-05-10T09:57:14.646585+0000","last_fullsized":"2024-05-10T09:57:14.646585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643947+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:57:14.643947+0000","last_peered":"2024-05-10T09:57:14.643947+0000","last_clean":"2024-05-10T09:57:14.643947+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:57:14.643947+0000","last_undegraded":"2024-05-10T09:57:14.643947+0000","last_fullsized":"2024-05-10T09:57:14.643947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"79'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645761+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:57:14.645761+0000","last_peered":"2024-05-10T09:57:14.645761+0000","last_clean":"2024-05-10T09:57:14.645761+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:57:14.645761+0000","last_undegraded":"2024-05-10T09:57:14.645761+0000","last_fullsized":"2024-05-10T09:57:14.645761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":12,"num_read_kb":38914,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978019+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:57:13.978019+0000","last_peered":"2024-05-10T09:57:13.978019+0000","last_clean":"2024-05-10T09:57:13.978019+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:57:13.978019+0000","last_undegraded":"2024-05-10T09:57:13.978019+0000","last_fullsized":"2024-05-10T09:57:13.978019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612834+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:57:11.612834+0000","last_peered":"2024-05-10T09:57:11.612834+0000","last_clean":"2024-05-10T09:57:11.612834+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:57:11.612834+0000","last_undegraded":"2024-05-10T09:57:11.612834+0000","last_fullsized":"2024-05-10T09:57:11.612834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614782+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:57:11.614782+0000","last_peered":"2024-05-10T09:57:11.614782+0000","last_clean":"2024-05-10T09:57:11.614782+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:57:11.614782+0000","last_undegraded":"2024-05-10T09:57:11.614782+0000","last_fullsized":"2024-05-10T09:57:11.614782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645993+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:57:14.645993+0000","last_peered":"2024-05-10T09:57:14.645993+0000","last_clean":"2024-05-10T09:57:14.645993+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:57:14.645993+0000","last_undegraded":"2024-05-10T09:57:14.645993+0000","last_fullsized":"2024-05-10T09:57:14.645993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"75'4","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.697706+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:57:14.697706+0000","last_peered":"2024-05-10T09:57:14.697706+0000","last_clean":"2024-05-10T09:57:14.697706+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:57:14.697706+0000","last_undegraded":"2024-05-10T09:57:14.697706+0000","last_fullsized":"2024-05-10T09:57:14.697706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"79'38","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612363+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:57:11.612363+0000","last_peered":"2024-05-10T09:57:11.612363+0000","last_clean":"2024-05-10T09:57:11.612363+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:57:11.612363+0000","last_undegraded":"2024-05-10T09:57:11.612363+0000","last_fullsized":"2024-05-10T09:57:11.612363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":56,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'19","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.010777+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:57:15.010777+0000","last_peered":"2024-05-10T09:57:15.010777+0000","last_clean":"2024-05-10T09:57:15.010777+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:57:15.010777+0000","last_undegraded":"2024-05-10T09:57:15.010777+0000","last_fullsized":"2024-05-10T09:57:15.010777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":35,"num_read_kb":59414,"num_write":69,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664373+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:57:14.664373+0000","last_peered":"2024-05-10T09:57:14.664373+0000","last_clean":"2024-05-10T09:57:14.664373+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:57:14.664373+0000","last_undegraded":"2024-05-10T09:57:14.664373+0000","last_fullsized":"2024-05-10T09:57:14.664373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643866+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:57:14.643866+0000","last_peered":"2024-05-10T09:57:14.643866+0000","last_clean":"2024-05-10T09:57:14.643866+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:57:14.643866+0000","last_undegraded":"2024-05-10T09:57:14.643866+0000","last_fullsized":"2024-05-10T09:57:14.643866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"89'30","reported_seq":176,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.069438+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:57:15.069438+0000","last_peered":"2024-05-10T09:57:15.069438+0000","last_clean":"2024-05-10T09:57:15.069438+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:57:15.069438+0000","last_undegraded":"2024-05-10T09:57:15.069438+0000","last_fullsized":"2024-05-10T09:57:15.069438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644605+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:57:14.644605+0000","last_peered":"2024-05-10T09:57:14.644605+0000","last_clean":"2024-05-10T09:57:14.644605+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:57:14.644605+0000","last_undegraded":"2024-05-10T09:57:14.644605+0000","last_fullsized":"2024-05-10T09:57:14.644605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669634+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:57:14.669634+0000","last_peered":"2024-05-10T09:57:14.669634+0000","last_clean":"2024-05-10T09:57:14.669634+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:57:14.669634+0000","last_undegraded":"2024-05-10T09:57:14.669634+0000","last_fullsized":"2024-05-10T09:57:14.669634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662340+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:57:14.662340+0000","last_peered":"2024-05-10T09:57:14.662340+0000","last_clean":"2024-05-10T09:57:14.662340+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:57:14.662340+0000","last_undegraded":"2024-05-10T09:57:14.662340+0000","last_fullsized":"2024-05-10T09:57:14.662340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612528+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:57:11.612528+0000","last_peered":"2024-05-10T09:57:11.612528+0000","last_clean":"2024-05-10T09:57:11.612528+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:57:11.612528+0000","last_undegraded":"2024-05-10T09:57:11.612528+0000","last_fullsized":"2024-05-10T09:57:11.612528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"79'7","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612013+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:57:11.612013+0000","last_peered":"2024-05-10T09:57:11.612013+0000","last_clean":"2024-05-10T09:57:11.612013+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:57:11.612013+0000","last_undegraded":"2024-05-10T09:57:11.612013+0000","last_fullsized":"2024-05-10T09:57:11.612013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":130,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980011+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:57:13.980011+0000","last_peered":"2024-05-10T09:57:13.980011+0000","last_clean":"2024-05-10T09:57:13.980011+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:57:13.980011+0000","last_undegraded":"2024-05-10T09:57:13.980011+0000","last_fullsized":"2024-05-10T09:57:13.980011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"89'15","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.682121+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:57:14.682121+0000","last_peered":"2024-05-10T09:57:14.682121+0000","last_clean":"2024-05-10T09:57:14.682121+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:57:14.682121+0000","last_undegraded":"2024-05-10T09:57:14.682121+0000","last_fullsized":"2024-05-10T09:57:14.682121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643726+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:57:14.643726+0000","last_peered":"2024-05-10T09:57:14.643726+0000","last_clean":"2024-05-10T09:57:14.643726+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:57:14.643726+0000","last_undegraded":"2024-05-10T09:57:14.643726+0000","last_fullsized":"2024-05-10T09:57:14.643726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"75'5","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645418+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:57:14.645418+0000","last_peered":"2024-05-10T09:57:14.645418+0000","last_clean":"2024-05-10T09:57:14.645418+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:57:14.645418+0000","last_undegraded":"2024-05-10T09:57:14.645418+0000","last_fullsized":"2024-05-10T09:57:14.645418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977014+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:57:13.977014+0000","last_peered":"2024-05-10T09:57:13.977014+0000","last_clean":"2024-05-10T09:57:13.977014+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:57:13.977014+0000","last_undegraded":"2024-05-10T09:57:13.977014+0000","last_fullsized":"2024-05-10T09:57:13.977014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.156571+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:57:15.156571+0000","last_peered":"2024-05-10T09:57:15.156571+0000","last_clean":"2024-05-10T09:57:15.156571+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:57:15.156571+0000","last_undegraded":"2024-05-10T09:57:15.156571+0000","last_fullsized":"2024-05-10T09:57:15.156571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":30738,"num_write":42,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645204+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:57:14.645204+0000","last_peered":"2024-05-10T09:57:14.645204+0000","last_clean":"2024-05-10T09:57:14.645204+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:57:14.645204+0000","last_undegraded":"2024-05-10T09:57:14.645204+0000","last_fullsized":"2024-05-10T09:57:14.645204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660626+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:57:14.660626+0000","last_peered":"2024-05-10T09:57:14.660626+0000","last_clean":"2024-05-10T09:57:14.660626+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:57:14.660626+0000","last_undegraded":"2024-05-10T09:57:14.660626+0000","last_fullsized":"2024-05-10T09:57:14.660626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657605+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:57:14.657605+0000","last_peered":"2024-05-10T09:57:14.657605+0000","last_clean":"2024-05-10T09:57:14.657605+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:57:14.657605+0000","last_undegraded":"2024-05-10T09:57:14.657605+0000","last_fullsized":"2024-05-10T09:57:14.657605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661135+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:57:14.661135+0000","last_peered":"2024-05-10T09:57:14.661135+0000","last_clean":"2024-05-10T09:57:14.661135+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:57:14.661135+0000","last_undegraded":"2024-05-10T09:57:14.661135+0000","last_fullsized":"2024-05-10T09:57:14.661135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644304+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:57:14.644304+0000","last_peered":"2024-05-10T09:57:14.644304+0000","last_clean":"2024-05-10T09:57:14.644304+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:57:14.644304+0000","last_undegraded":"2024-05-10T09:57:14.644304+0000","last_fullsized":"2024-05-10T09:57:14.644304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'9","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.822711+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:57:14.822711+0000","last_peered":"2024-05-10T09:57:14.822711+0000","last_clean":"2024-05-10T09:57:14.822711+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:57:14.822711+0000","last_undegraded":"2024-05-10T09:57:14.822711+0000","last_fullsized":"2024-05-10T09:57:14.822711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657037+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:57:14.657037+0000","last_peered":"2024-05-10T09:57:14.657037+0000","last_clean":"2024-05-10T09:57:14.657037+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:57:14.657037+0000","last_undegraded":"2024-05-10T09:57:14.657037+0000","last_fullsized":"2024-05-10T09:57:14.657037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"89'17","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.809194+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:57:14.809194+0000","last_peered":"2024-05-10T09:57:14.809194+0000","last_clean":"2024-05-10T09:57:14.809194+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:57:14.809194+0000","last_undegraded":"2024-05-10T09:57:14.809194+0000","last_fullsized":"2024-05-10T09:57:14.809194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11369,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662896+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:57:14.662896+0000","last_peered":"2024-05-10T09:57:14.662896+0000","last_clean":"2024-05-10T09:57:14.662896+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:57:14.662896+0000","last_undegraded":"2024-05-10T09:57:14.662896+0000","last_fullsized":"2024-05-10T09:57:14.662896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669643+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:57:14.669643+0000","last_peered":"2024-05-10T09:57:14.669643+0000","last_clean":"2024-05-10T09:57:14.669643+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:57:14.669643+0000","last_undegraded":"2024-05-10T09:57:14.669643+0000","last_fullsized":"2024-05-10T09:57:14.669643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644113+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:57:14.644113+0000","last_peered":"2024-05-10T09:57:14.644113+0000","last_clean":"2024-05-10T09:57:14.644113+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:57:14.644113+0000","last_undegraded":"2024-05-10T09:57:14.644113+0000","last_fullsized":"2024-05-10T09:57:14.644113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.161242+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:57:15.161242+0000","last_peered":"2024-05-10T09:57:15.161242+0000","last_clean":"2024-05-10T09:57:15.161242+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:57:15.161242+0000","last_undegraded":"2024-05-10T09:57:15.161242+0000","last_fullsized":"2024-05-10T09:57:15.161242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":20,"num_read_kb":40970,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662834+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:57:14.662834+0000","last_peered":"2024-05-10T09:57:14.662834+0000","last_clean":"2024-05-10T09:57:14.662834+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:57:14.662834+0000","last_undegraded":"2024-05-10T09:57:14.662834+0000","last_fullsized":"2024-05-10T09:57:14.662834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"89'15","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.777248+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:57:14.777248+0000","last_peered":"2024-05-10T09:57:14.777248+0000","last_clean":"2024-05-10T09:57:14.777248+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:57:14.777248+0000","last_undegraded":"2024-05-10T09:57:14.777248+0000","last_fullsized":"2024-05-10T09:57:14.777248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660860+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:57:14.660860+0000","last_peered":"2024-05-10T09:57:14.660860+0000","last_clean":"2024-05-10T09:57:14.660860+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:57:14.660860+0000","last_undegraded":"2024-05-10T09:57:14.660860+0000","last_fullsized":"2024-05-10T09:57:14.660860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664331+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:57:14.664331+0000","last_peered":"2024-05-10T09:57:14.664331+0000","last_clean":"2024-05-10T09:57:14.664331+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:57:14.664331+0000","last_undegraded":"2024-05-10T09:57:14.664331+0000","last_fullsized":"2024-05-10T09:57:14.664331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.712733+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:57:14.712733+0000","last_peered":"2024-05-10T09:57:14.712733+0000","last_clean":"2024-05-10T09:57:14.712733+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:57:14.712733+0000","last_undegraded":"2024-05-10T09:57:14.712733+0000","last_fullsized":"2024-05-10T09:57:14.712733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":18440,"num_write":26,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661713+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:57:14.661713+0000","last_peered":"2024-05-10T09:57:14.661713+0000","last_clean":"2024-05-10T09:57:14.661713+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:57:14.661713+0000","last_undegraded":"2024-05-10T09:57:14.661713+0000","last_fullsized":"2024-05-10T09:57:14.661713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'14","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979138+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:57:13.979138+0000","last_peered":"2024-05-10T09:57:13.979138+0000","last_clean":"2024-05-10T09:57:13.979138+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:57:13.979138+0000","last_undegraded":"2024-05-10T09:57:13.979138+0000","last_fullsized":"2024-05-10T09:57:13.979138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669821+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:57:14.669821+0000","last_peered":"2024-05-10T09:57:14.669821+0000","last_clean":"2024-05-10T09:57:14.669821+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:57:14.669821+0000","last_undegraded":"2024-05-10T09:57:14.669821+0000","last_fullsized":"2024-05-10T09:57:14.669821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644862+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:57:14.644862+0000","last_peered":"2024-05-10T09:57:14.644862+0000","last_clean":"2024-05-10T09:57:14.644862+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:57:14.644862+0000","last_undegraded":"2024-05-10T09:57:14.644862+0000","last_fullsized":"2024-05-10T09:57:14.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661829+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:57:14.661829+0000","last_peered":"2024-05-10T09:57:14.661829+0000","last_clean":"2024-05-10T09:57:14.661829+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:57:14.661829+0000","last_undegraded":"2024-05-10T09:57:14.661829+0000","last_fullsized":"2024-05-10T09:57:14.661829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":163,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980549+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:57:13.980549+0000","last_peered":"2024-05-10T09:57:13.980549+0000","last_clean":"2024-05-10T09:57:13.980549+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:57:13.980549+0000","last_undegraded":"2024-05-10T09:57:13.980549+0000","last_fullsized":"2024-05-10T09:57:13.980549+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":12,"num_read_kb":30722,"num_write":20,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664106+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:57:14.664106+0000","last_peered":"2024-05-10T09:57:14.664106+0000","last_clean":"2024-05-10T09:57:14.664106+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:57:14.664106+0000","last_undegraded":"2024-05-10T09:57:14.664106+0000","last_fullsized":"2024-05-10T09:57:14.664106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"89'20","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.084219+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:57:15.084219+0000","last_peered":"2024-05-10T09:57:15.084219+0000","last_clean":"2024-05-10T09:57:15.084219+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:57:15.084219+0000","last_undegraded":"2024-05-10T09:57:15.084219+0000","last_fullsized":"2024-05-10T09:57:15.084219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979746+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:57:13.979746+0000","last_peered":"2024-05-10T09:57:13.979746+0000","last_clean":"2024-05-10T09:57:13.979746+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:57:13.979746+0000","last_undegraded":"2024-05-10T09:57:13.979746+0000","last_fullsized":"2024-05-10T09:57:13.979746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662741+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:57:14.662741+0000","last_peered":"2024-05-10T09:57:14.662741+0000","last_clean":"2024-05-10T09:57:14.662741+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:57:14.662741+0000","last_undegraded":"2024-05-10T09:57:14.662741+0000","last_fullsized":"2024-05-10T09:57:14.662741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645473+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:57:14.645473+0000","last_peered":"2024-05-10T09:57:14.645473+0000","last_clean":"2024-05-10T09:57:14.645473+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:57:14.645473+0000","last_undegraded":"2024-05-10T09:57:14.645473+0000","last_fullsized":"2024-05-10T09:57:14.645473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"78'6","reported_seq":127,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611612+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:57:11.611612+0000","last_peered":"2024-05-10T09:57:11.611612+0000","last_clean":"2024-05-10T09:57:11.611612+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:57:11.611612+0000","last_undegraded":"2024-05-10T09:57:11.611612+0000","last_fullsized":"2024-05-10T09:57:11.611612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":18434,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612963+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:57:11.612963+0000","last_peered":"2024-05-10T09:57:11.612963+0000","last_clean":"2024-05-10T09:57:11.612963+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:57:11.612963+0000","last_undegraded":"2024-05-10T09:57:11.612963+0000","last_fullsized":"2024-05-10T09:57:11.612963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"89'15","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646841+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:57:14.646841+0000","last_peered":"2024-05-10T09:57:14.646841+0000","last_clean":"2024-05-10T09:57:14.646841+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:57:14.646841+0000","last_undegraded":"2024-05-10T09:57:14.646841+0000","last_fullsized":"2024-05-10T09:57:14.646841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979463+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:57:13.979463+0000","last_peered":"2024-05-10T09:57:13.979463+0000","last_clean":"2024-05-10T09:57:13.979463+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:57:13.979463+0000","last_undegraded":"2024-05-10T09:57:13.979463+0000","last_fullsized":"2024-05-10T09:57:13.979463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669089+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:57:14.669089+0000","last_peered":"2024-05-10T09:57:14.669089+0000","last_clean":"2024-05-10T09:57:14.669089+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:57:14.669089+0000","last_undegraded":"2024-05-10T09:57:14.669089+0000","last_fullsized":"2024-05-10T09:57:14.669089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'37","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.897854+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:57:14.897854+0000","last_peered":"2024-05-10T09:57:14.897854+0000","last_clean":"2024-05-10T09:57:14.897854+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:57:14.897854+0000","last_undegraded":"2024-05-10T09:57:14.897854+0000","last_fullsized":"2024-05-10T09:57:14.897854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":94,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"79'11","reported_seq":191,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660922+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:57:14.660922+0000","last_peered":"2024-05-10T09:57:14.660922+0000","last_clean":"2024-05-10T09:57:14.660922+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:57:14.660922+0000","last_undegraded":"2024-05-10T09:57:14.660922+0000","last_fullsized":"2024-05-10T09:57:14.660922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:36.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980205+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:57:13.980205+0000","last_peered":"2024-05-10T09:57:13.980205+0000","last_clean":"2024-05-10T09:57:13.980205+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:57:13.980205+0000","last_undegraded":"2024-05-10T09:57:13.980205+0000","last_fullsized":"2024-05-10T09:57:13.980205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614029+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:57:11.614029+0000","last_peered":"2024-05-10T09:57:11.614029+0000","last_clean":"2024-05-10T09:57:11.614029+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:57:11.614029+0000","last_undegraded":"2024-05-10T09:57:11.614029+0000","last_fullsized":"2024-05-10T09:57:11.614029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"88'15","reported_seq":182,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663795+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:57:14.663795+0000","last_peered":"2024-05-10T09:57:14.663795+0000","last_clean":"2024-05-10T09:57:14.663795+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:57:14.663795+0000","last_undegraded":"2024-05-10T09:57:14.663795+0000","last_fullsized":"2024-05-10T09:57:14.663795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657041+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:57:14.657041+0000","last_peered":"2024-05-10T09:57:14.657041+0000","last_clean":"2024-05-10T09:57:14.657041+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:57:14.657041+0000","last_undegraded":"2024-05-10T09:57:14.657041+0000","last_fullsized":"2024-05-10T09:57:14.657041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979034+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:57:13.979034+0000","last_peered":"2024-05-10T09:57:13.979034+0000","last_clean":"2024-05-10T09:57:13.979034+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:57:13.979034+0000","last_undegraded":"2024-05-10T09:57:13.979034+0000","last_fullsized":"2024-05-10T09:57:13.979034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"89'7","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.139712+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:57:15.139712+0000","last_peered":"2024-05-10T09:57:15.139712+0000","last_clean":"2024-05-10T09:57:15.139712+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:57:15.139712+0000","last_undegraded":"2024-05-10T09:57:15.139712+0000","last_fullsized":"2024-05-10T09:57:15.139712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18442,"num_write":37,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657721+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:57:14.657721+0000","last_peered":"2024-05-10T09:57:14.657721+0000","last_clean":"2024-05-10T09:57:14.657721+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:57:14.657721+0000","last_undegraded":"2024-05-10T09:57:14.657721+0000","last_fullsized":"2024-05-10T09:57:14.657721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"89'19","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.123342+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:57:15.123342+0000","last_peered":"2024-05-10T09:57:15.123342+0000","last_clean":"2024-05-10T09:57:15.123342+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:57:15.123342+0000","last_undegraded":"2024-05-10T09:57:15.123342+0000","last_fullsized":"2024-05-10T09:57:15.123342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660473+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:57:14.660473+0000","last_peered":"2024-05-10T09:57:14.660473+0000","last_clean":"2024-05-10T09:57:14.660473+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:57:14.660473+0000","last_undegraded":"2024-05-10T09:57:14.660473+0000","last_fullsized":"2024-05-10T09:57:14.660473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660334+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:57:14.660334+0000","last_peered":"2024-05-10T09:57:14.660334+0000","last_clean":"2024-05-10T09:57:14.660334+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:57:14.660334+0000","last_undegraded":"2024-05-10T09:57:14.660334+0000","last_fullsized":"2024-05-10T09:57:14.660334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614677+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:57:11.614677+0000","last_peered":"2024-05-10T09:57:11.614677+0000","last_clean":"2024-05-10T09:57:11.614677+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:57:11.614677+0000","last_undegraded":"2024-05-10T09:57:11.614677+0000","last_fullsized":"2024-05-10T09:57:11.614677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"89'9","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.865306+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:57:14.865306+0000","last_peered":"2024-05-10T09:57:14.865306+0000","last_clean":"2024-05-10T09:57:14.865306+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:57:14.865306+0000","last_undegraded":"2024-05-10T09:57:14.865306+0000","last_fullsized":"2024-05-10T09:57:14.865306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669591+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:57:14.669591+0000","last_peered":"2024-05-10T09:57:14.669591+0000","last_clean":"2024-05-10T09:57:14.669591+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:57:14.669591+0000","last_undegraded":"2024-05-10T09:57:14.669591+0000","last_fullsized":"2024-05-10T09:57:14.669591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.722985+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:57:14.722985+0000","last_peered":"2024-05-10T09:57:14.722985+0000","last_clean":"2024-05-10T09:57:14.722985+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:57:14.722985+0000","last_undegraded":"2024-05-10T09:57:14.722985+0000","last_fullsized":"2024-05-10T09:57:14.722985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662705+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:57:14.662705+0000","last_peered":"2024-05-10T09:57:14.662705+0000","last_clean":"2024-05-10T09:57:14.662705+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:57:14.662705+0000","last_undegraded":"2024-05-10T09:57:14.662705+0000","last_fullsized":"2024-05-10T09:57:14.662705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645636+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:57:14.645636+0000","last_peered":"2024-05-10T09:57:14.645636+0000","last_clean":"2024-05-10T09:57:14.645636+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:57:14.645636+0000","last_undegraded":"2024-05-10T09:57:14.645636+0000","last_fullsized":"2024-05-10T09:57:14.645636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644409+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:57:14.644409+0000","last_peered":"2024-05-10T09:57:14.644409+0000","last_clean":"2024-05-10T09:57:14.644409+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:57:14.644409+0000","last_undegraded":"2024-05-10T09:57:14.644409+0000","last_fullsized":"2024-05-10T09:57:14.644409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'7","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.045324+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:57:15.045324+0000","last_peered":"2024-05-10T09:57:15.045324+0000","last_clean":"2024-05-10T09:57:15.045324+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:57:15.045324+0000","last_undegraded":"2024-05-10T09:57:15.045324+0000","last_fullsized":"2024-05-10T09:57:15.045324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611725+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:57:11.611725+0000","last_peered":"2024-05-10T09:57:11.611725+0000","last_clean":"2024-05-10T09:57:11.611725+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:57:11.611725+0000","last_undegraded":"2024-05-10T09:57:11.611725+0000","last_fullsized":"2024-05-10T09:57:11.611725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"89'8","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.044920+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:57:15.044920+0000","last_peered":"2024-05-10T09:57:15.044920+0000","last_clean":"2024-05-10T09:57:15.044920+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:57:15.044920+0000","last_undegraded":"2024-05-10T09:57:15.044920+0000","last_fullsized":"2024-05-10T09:57:15.044920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614956+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:57:11.614956+0000","last_peered":"2024-05-10T09:57:11.614956+0000","last_clean":"2024-05-10T09:57:11.614956+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:57:11.614956+0000","last_undegraded":"2024-05-10T09:57:11.614956+0000","last_fullsized":"2024-05-10T09:57:11.614956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658786+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:57:14.658786+0000","last_peered":"2024-05-10T09:57:14.658786+0000","last_clean":"2024-05-10T09:57:14.658786+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:57:14.658786+0000","last_undegraded":"2024-05-10T09:57:14.658786+0000","last_fullsized":"2024-05-10T09:57:14.658786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611206+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:57:11.611206+0000","last_peered":"2024-05-10T09:57:11.611206+0000","last_clean":"2024-05-10T09:57:11.611206+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:57:11.611206+0000","last_undegraded":"2024-05-10T09:57:11.611206+0000","last_fullsized":"2024-05-10T09:57:11.611206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'14","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.113881+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:57:15.113881+0000","last_peered":"2024-05-10T09:57:15.113881+0000","last_clean":"2024-05-10T09:57:15.113881+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:57:15.113881+0000","last_undegraded":"2024-05-10T09:57:15.113881+0000","last_fullsized":"2024-05-10T09:57:15.113881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978862+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:57:13.978862+0000","last_peered":"2024-05-10T09:57:13.978862+0000","last_clean":"2024-05-10T09:57:13.978862+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:57:13.978862+0000","last_undegraded":"2024-05-10T09:57:13.978862+0000","last_fullsized":"2024-05-10T09:57:13.978862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'11","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614627+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:57:11.614627+0000","last_peered":"2024-05-10T09:57:11.614627+0000","last_clean":"2024-05-10T09:57:11.614627+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:57:11.614627+0000","last_undegraded":"2024-05-10T09:57:11.614627+0000","last_fullsized":"2024-05-10T09:57:11.614627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660673+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:57:14.660673+0000","last_peered":"2024-05-10T09:57:14.660673+0000","last_clean":"2024-05-10T09:57:14.660673+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:57:14.660673+0000","last_undegraded":"2024-05-10T09:57:14.660673+0000","last_fullsized":"2024-05-10T09:57:14.660673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613323+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:57:11.613323+0000","last_peered":"2024-05-10T09:57:11.613323+0000","last_clean":"2024-05-10T09:57:11.613323+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:57:11.613323+0000","last_undegraded":"2024-05-10T09:57:11.613323+0000","last_fullsized":"2024-05-10T09:57:11.613323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979108+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:57:13.979108+0000","last_peered":"2024-05-10T09:57:13.979108+0000","last_clean":"2024-05-10T09:57:13.979108+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:57:13.979108+0000","last_undegraded":"2024-05-10T09:57:13.979108+0000","last_fullsized":"2024-05-10T09:57:13.979108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.754927+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:57:14.754927+0000","last_peered":"2024-05-10T09:57:14.754927+0000","last_clean":"2024-05-10T09:57:14.754927+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:57:14.754927+0000","last_undegraded":"2024-05-10T09:57:14.754927+0000","last_fullsized":"2024-05-10T09:57:14.754927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978145+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:57:13.978145+0000","last_peered":"2024-05-10T09:57:13.978145+0000","last_clean":"2024-05-10T09:57:13.978145+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:57:13.978145+0000","last_undegraded":"2024-05-10T09:57:13.978145+0000","last_fullsized":"2024-05-10T09:57:13.978145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'14","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.194965+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:57:15.194965+0000","last_peered":"2024-05-10T09:57:15.194965+0000","last_clean":"2024-05-10T09:57:15.194965+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:57:15.194965+0000","last_undegraded":"2024-05-10T09:57:15.194965+0000","last_fullsized":"2024-05-10T09:57:15.194965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'33","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.092894+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:57:15.092894+0000","last_peered":"2024-05-10T09:57:15.092894+0000","last_clean":"2024-05-10T09:57:15.092894+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:57:15.092894+0000","last_undegraded":"2024-05-10T09:57:15.092894+0000","last_fullsized":"2024-05-10T09:57:15.092894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":84,"num_write":49,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"79'6","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669696+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:57:14.669696+0000","last_peered":"2024-05-10T09:57:14.669696+0000","last_clean":"2024-05-10T09:57:14.669696+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:57:14.669696+0000","last_undegraded":"2024-05-10T09:57:14.669696+0000","last_fullsized":"2024-05-10T09:57:14.669696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977880+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:57:13.977880+0000","last_peered":"2024-05-10T09:57:13.977880+0000","last_clean":"2024-05-10T09:57:13.977880+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:57:13.977880+0000","last_undegraded":"2024-05-10T09:57:13.977880+0000","last_fullsized":"2024-05-10T09:57:13.977880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'21","reported_seq":183,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.083034+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:57:15.083034+0000","last_peered":"2024-05-10T09:57:15.083034+0000","last_clean":"2024-05-10T09:57:15.083034+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:57:15.083034+0000","last_undegraded":"2024-05-10T09:57:15.083034+0000","last_fullsized":"2024-05-10T09:57:15.083034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":29,"num_read_kb":71692,"num_write":41,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645409+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:57:14.645409+0000","last_peered":"2024-05-10T09:57:14.645409+0000","last_clean":"2024-05-10T09:57:14.645409+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:57:14.645409+0000","last_undegraded":"2024-05-10T09:57:14.645409+0000","last_fullsized":"2024-05-10T09:57:14.645409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646233+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:57:14.646233+0000","last_peered":"2024-05-10T09:57:14.646233+0000","last_clean":"2024-05-10T09:57:14.646233+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:57:14.646233+0000","last_undegraded":"2024-05-10T09:57:14.646233+0000","last_fullsized":"2024-05-10T09:57:14.646233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":14338,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611759+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:57:11.611759+0000","last_peered":"2024-05-10T09:57:11.611759+0000","last_clean":"2024-05-10T09:57:11.611759+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:57:11.611759+0000","last_undegraded":"2024-05-10T09:57:11.611759+0000","last_fullsized":"2024-05-10T09:57:11.611759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"79'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980539+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:57:13.980539+0000","last_peered":"2024-05-10T09:57:13.980539+0000","last_clean":"2024-05-10T09:57:13.980539+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:57:13.980539+0000","last_undegraded":"2024-05-10T09:57:13.980539+0000","last_fullsized":"2024-05-10T09:57:13.980539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642741+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:57:14.642741+0000","last_peered":"2024-05-10T09:57:14.642741+0000","last_clean":"2024-05-10T09:57:14.642741+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:57:14.642741+0000","last_undegraded":"2024-05-10T09:57:14.642741+0000","last_fullsized":"2024-05-10T09:57:14.642741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.091404+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:57:15.091404+0000","last_peered":"2024-05-10T09:57:15.091404+0000","last_clean":"2024-05-10T09:57:15.091404+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:57:15.091404+0000","last_undegraded":"2024-05-10T09:57:15.091404+0000","last_fullsized":"2024-05-10T09:57:15.091404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662566+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:57:14.662566+0000","last_peered":"2024-05-10T09:57:14.662566+0000","last_clean":"2024-05-10T09:57:14.662566+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:57:14.662566+0000","last_undegraded":"2024-05-10T09:57:14.662566+0000","last_fullsized":"2024-05-10T09:57:14.662566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'11","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.986587+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:57:14.986587+0000","last_peered":"2024-05-10T09:57:14.986587+0000","last_clean":"2024-05-10T09:57:14.986587+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:57:14.986587+0000","last_undegraded":"2024-05-10T09:57:14.986587+0000","last_fullsized":"2024-05-10T09:57:14.986587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36870,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662658+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:57:14.662658+0000","last_peered":"2024-05-10T09:57:14.662658+0000","last_clean":"2024-05-10T09:57:14.662658+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:57:14.662658+0000","last_undegraded":"2024-05-10T09:57:14.662658+0000","last_fullsized":"2024-05-10T09:57:14.662658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.069886+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:57:15.069886+0000","last_peered":"2024-05-10T09:57:15.069886+0000","last_clean":"2024-05-10T09:57:15.069886+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:57:15.069886+0000","last_undegraded":"2024-05-10T09:57:15.069886+0000","last_fullsized":"2024-05-10T09:57:15.069886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":36870,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613082+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:57:11.613082+0000","last_peered":"2024-05-10T09:57:11.613082+0000","last_clean":"2024-05-10T09:57:11.613082+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:57:11.613082+0000","last_undegraded":"2024-05-10T09:57:11.613082+0000","last_fullsized":"2024-05-10T09:57:11.613082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'16","reported_seq":202,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.146474+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:57:15.146474+0000","last_peered":"2024-05-10T09:57:15.146474+0000","last_clean":"2024-05-10T09:57:15.146474+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:57:15.146474+0000","last_undegraded":"2024-05-10T09:57:15.146474+0000","last_fullsized":"2024-05-10T09:57:15.146474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643012+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:57:14.643012+0000","last_peered":"2024-05-10T09:57:14.643012+0000","last_clean":"2024-05-10T09:57:14.643012+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:57:14.643012+0000","last_undegraded":"2024-05-10T09:57:14.643012+0000","last_fullsized":"2024-05-10T09:57:14.643012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.859631+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:57:14.859631+0000","last_peered":"2024-05-10T09:57:14.859631+0000","last_clean":"2024-05-10T09:57:14.859631+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:57:14.859631+0000","last_undegraded":"2024-05-10T09:57:14.859631+0000","last_fullsized":"2024-05-10T09:57:14.859631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614365+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:57:11.614365+0000","last_peered":"2024-05-10T09:57:11.614365+0000","last_clean":"2024-05-10T09:57:11.614365+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:57:11.614365+0000","last_undegraded":"2024-05-10T09:57:11.614365+0000","last_fullsized":"2024-05-10T09:57:11.614365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"79'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661113+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:57:14.661113+0000","last_peered":"2024-05-10T09:57:14.661113+0000","last_clean":"2024-05-10T09:57:14.661113+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:57:14.661113+0000","last_undegraded":"2024-05-10T09:57:14.661113+0000","last_fullsized":"2024-05-10T09:57:14.661113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":10,"num_read_kb":30722,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658372+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:57:14.658372+0000","last_peered":"2024-05-10T09:57:14.658372+0000","last_clean":"2024-05-10T09:57:14.658372+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:57:14.658372+0000","last_undegraded":"2024-05-10T09:57:14.658372+0000","last_fullsized":"2024-05-10T09:57:14.658372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'14","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.130769+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:57:15.130769+0000","last_peered":"2024-05-10T09:57:15.130769+0000","last_clean":"2024-05-10T09:57:15.130769+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:57:15.130769+0000","last_undegraded":"2024-05-10T09:57:15.130769+0000","last_fullsized":"2024-05-10T09:57:15.130769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":23,"num_read_kb":36880,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660691+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:57:14.660691+0000","last_peered":"2024-05-10T09:57:14.660691+0000","last_clean":"2024-05-10T09:57:14.660691+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:57:14.660691+0000","last_undegraded":"2024-05-10T09:57:14.660691+0000","last_fullsized":"2024-05-10T09:57:14.660691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'13","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.223039+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:57:15.223039+0000","last_peered":"2024-05-10T09:57:15.223039+0000","last_clean":"2024-05-10T09:57:15.223039+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:57:15.223039+0000","last_undegraded":"2024-05-10T09:57:15.223039+0000","last_fullsized":"2024-05-10T09:57:15.223039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":34834,"num_write":43,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644156+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:57:14.644156+0000","last_peered":"2024-05-10T09:57:14.644156+0000","last_clean":"2024-05-10T09:57:14.644156+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:57:14.644156+0000","last_undegraded":"2024-05-10T09:57:14.644156+0000","last_fullsized":"2024-05-10T09:57:14.644156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643442+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:57:14.643442+0000","last_peered":"2024-05-10T09:57:14.643442+0000","last_clean":"2024-05-10T09:57:14.643442+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:57:14.643442+0000","last_undegraded":"2024-05-10T09:57:14.643442+0000","last_fullsized":"2024-05-10T09:57:14.643442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657483+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:57:14.657483+0000","last_peered":"2024-05-10T09:57:14.657483+0000","last_clean":"2024-05-10T09:57:14.657483+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:57:14.657483+0000","last_undegraded":"2024-05-10T09:57:14.657483+0000","last_fullsized":"2024-05-10T09:57:14.657483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'14","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.974034+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:57:14.974034+0000","last_peered":"2024-05-10T09:57:14.974034+0000","last_clean":"2024-05-10T09:57:14.974034+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:57:14.974034+0000","last_undegraded":"2024-05-10T09:57:14.974034+0000","last_fullsized":"2024-05-10T09:57:14.974034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":36882,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'8","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669064+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:57:14.669064+0000","last_peered":"2024-05-10T09:57:14.669064+0000","last_clean":"2024-05-10T09:57:14.669064+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:57:14.669064+0000","last_undegraded":"2024-05-10T09:57:14.669064+0000","last_fullsized":"2024-05-10T09:57:14.669064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662569+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:57:14.662569+0000","last_peered":"2024-05-10T09:57:14.662569+0000","last_clean":"2024-05-10T09:57:14.662569+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:57:14.662569+0000","last_undegraded":"2024-05-10T09:57:14.662569+0000","last_fullsized":"2024-05-10T09:57:14.662569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'8","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980302+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:57:13.980302+0000","last_peered":"2024-05-10T09:57:13.980302+0000","last_clean":"2024-05-10T09:57:13.980302+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:57:13.980302+0000","last_undegraded":"2024-05-10T09:57:13.980302+0000","last_fullsized":"2024-05-10T09:57:13.980302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":24578,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670617+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:57:14.670617+0000","last_peered":"2024-05-10T09:57:14.670617+0000","last_clean":"2024-05-10T09:57:14.670617+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:57:14.670617+0000","last_undegraded":"2024-05-10T09:57:14.670617+0000","last_fullsized":"2024-05-10T09:57:14.670617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1081,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":198509,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":829,"num_read_kb":705,"num_write":559,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":185665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":520,"ondisk_log_size":520,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1345,"num_read_kb":996,"num_write":579,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":397,"ondisk_log_size":397,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1757413376,"num_objects":469,"num_object_clones":0,"num_object_copies":938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":469,"num_whiteouts":0,"num_read":995,"num_read_kb":2003484,"num_write":1731,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3598712832,"data_stored":3598712832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":631,"ondisk_log_size":631,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514160,"kb_used_data":482984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93857680,"statfs":{"total":96636764160,"available":96110264320,"internally_reserved":0,"allocated":494575616,"data_stored":494042106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380392,"kb_used_data":349208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93991448,"statfs":{"total":96636764160,"available":96247242752,"internally_reserved":0,"allocated":357588992,"data_stored":357108641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":620072,"kb_used_data":588888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93751768,"statfs":{"total":96636764160,"available":96001810432,"internally_reserved":0,"allocated":603021312,"data_stored":602491107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285570,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581648,"kb_used_data":549888,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":93790192,"statfs":{"total":96636764160,"available":96041156608,"internally_reserved":0,"allocated":563085312,"data_stored":562620723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":669276,"kb_used_data":633928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93702564,"statfs":{"total":96636764160,"available":95951425536,"internally_reserved":0,"allocated":649142272,"data_stored":648637245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337456,"kb_used_data":302108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94034384,"statfs":{"total":96636764160,"available":96291209216,"internally_reserved":0,"allocated":309358592,"data_stored":308888004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":632988,"kb_used_data":597652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93738852,"statfs":{"total":96636764160,"available":95988584448,"internally_reserved":0,"allocated":611995648,"data_stored":611482112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386592,"kb_used_data":351248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93985248,"statfs":{"total":96636764160,"available":96240893952,"internally_reserved":0,"allocated":359677952,"data_stored":359191327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":585105408,"data_stored":585105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":358612992,"data_stored":358612992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":241172480,"data_stored":241172480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":551550976,"data_stored":551550976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":591396864,"data_stored":591396864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":522190848,"data_stored":522190848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":301989888,"data_stored":301989888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":446693376,"data_stored":446693376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":27145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":6620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":15428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":41465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":11424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":34363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":17029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":32191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:57:16.108 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:57:16.110 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-10T09:57:16.263 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:16.264 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:16.277 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-10T09:57:16.396 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:16.396 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:16.408 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-10T09:57:16.501 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:57:16.508 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:57:16.521 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-05-10T09:57:16.239206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1758204947,"num_objects":682,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":682,"num_whiteouts":0,"num_read":3307,"num_read_kb":2005310,"num_write":3012,"num_write_kb":2050163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1749,"ondisk_log_size":1749,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4122584,"kb_used_data":3855904,"kb_used_omap":16,"kb_used_meta":266543,"kb_avail":750852136,"statfs":{"total":773094113280,"available":768872587264,"internally_reserved":0,"allocated":3948445696,"data_stored":3944461265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":272940302},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-297692676,"num_objects":-71,"num_object_clones":0,"num_object_copies":-142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-71,"num_whiteouts":0,"num_read":854,"num_read_kb":129914,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":383790261,"num_keys_recovered":37,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001867"},"pg_stats":[{"pgid":"3.3f","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.214635+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:57:15.214635+0000","last_peered":"2024-05-10T09:57:15.214635+0000","last_clean":"2024-05-10T09:57:15.214635+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:57:15.214635+0000","last_undegraded":"2024-05-10T09:57:15.214635+0000","last_fullsized":"2024-05-10T09:57:15.214635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668907+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:57:14.668907+0000","last_peered":"2024-05-10T09:57:14.668907+0000","last_clean":"2024-05-10T09:57:14.668907+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:57:14.668907+0000","last_undegraded":"2024-05-10T09:57:14.668907+0000","last_fullsized":"2024-05-10T09:57:14.668907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"77'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980308+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:57:13.980308+0000","last_peered":"2024-05-10T09:57:13.980308+0000","last_clean":"2024-05-10T09:57:13.980308+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:57:13.980308+0000","last_undegraded":"2024-05-10T09:57:13.980308+0000","last_fullsized":"2024-05-10T09:57:13.980308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":10,"num_read_kb":30722,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'31","reported_seq":172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.846819+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:57:14.846819+0000","last_peered":"2024-05-10T09:57:14.846819+0000","last_clean":"2024-05-10T09:57:14.846819+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:57:14.846819+0000","last_undegraded":"2024-05-10T09:57:14.846819+0000","last_fullsized":"2024-05-10T09:57:14.846819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":78,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.912004+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:57:14.912004+0000","last_peered":"2024-05-10T09:57:14.912004+0000","last_clean":"2024-05-10T09:57:14.912004+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:57:14.912004+0000","last_undegraded":"2024-05-10T09:57:14.912004+0000","last_fullsized":"2024-05-10T09:57:14.912004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":28686,"num_write":39,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612166+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:57:11.612166+0000","last_peered":"2024-05-10T09:57:11.612166+0000","last_clean":"2024-05-10T09:57:11.612166+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:57:11.612166+0000","last_undegraded":"2024-05-10T09:57:11.612166+0000","last_fullsized":"2024-05-10T09:57:11.612166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'11","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.076606+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:57:15.076606+0000","last_peered":"2024-05-10T09:57:15.076606+0000","last_clean":"2024-05-10T09:57:15.076606+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:57:15.076606+0000","last_undegraded":"2024-05-10T09:57:15.076606+0000","last_fullsized":"2024-05-10T09:57:15.076606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":32788,"num_write":51,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660993+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:57:14.660993+0000","last_peered":"2024-05-10T09:57:14.660993+0000","last_clean":"2024-05-10T09:57:14.660993+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:57:14.660993+0000","last_undegraded":"2024-05-10T09:57:14.660993+0000","last_fullsized":"2024-05-10T09:57:14.660993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'16","reported_seq":173,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.188502+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:57:15.188502+0000","last_peered":"2024-05-10T09:57:15.188502+0000","last_clean":"2024-05-10T09:57:15.188502+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:57:15.188502+0000","last_undegraded":"2024-05-10T09:57:15.188502+0000","last_fullsized":"2024-05-10T09:57:15.188502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":43032,"num_write":56,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663763+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:57:14.663763+0000","last_peered":"2024-05-10T09:57:14.663763+0000","last_clean":"2024-05-10T09:57:14.663763+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:57:14.663763+0000","last_undegraded":"2024-05-10T09:57:14.663763+0000","last_fullsized":"2024-05-10T09:57:14.663763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.235284+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:57:15.235284+0000","last_peered":"2024-05-10T09:57:15.235284+0000","last_clean":"2024-05-10T09:57:15.235284+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:57:15.235284+0000","last_undegraded":"2024-05-10T09:57:15.235284+0000","last_fullsized":"2024-05-10T09:57:15.235284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":16,"num_read_kb":36872,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":118,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613205+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:57:11.613205+0000","last_peered":"2024-05-10T09:57:11.613205+0000","last_clean":"2024-05-10T09:57:11.613205+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:57:11.613205+0000","last_undegraded":"2024-05-10T09:57:11.613205+0000","last_fullsized":"2024-05-10T09:57:11.613205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'6","reported_seq":114,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.179409+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:57:15.179409+0000","last_peered":"2024-05-10T09:57:15.179409+0000","last_clean":"2024-05-10T09:57:15.179409+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:57:15.179409+0000","last_undegraded":"2024-05-10T09:57:15.179409+0000","last_fullsized":"2024-05-10T09:57:15.179409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670553+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:57:14.670553+0000","last_peered":"2024-05-10T09:57:14.670553+0000","last_clean":"2024-05-10T09:57:14.670553+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:57:14.670553+0000","last_undegraded":"2024-05-10T09:57:14.670553+0000","last_fullsized":"2024-05-10T09:57:14.670553+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"78'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644172+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:57:14.644172+0000","last_peered":"2024-05-10T09:57:14.644172+0000","last_clean":"2024-05-10T09:57:14.644172+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:57:14.644172+0000","last_undegraded":"2024-05-10T09:57:14.644172+0000","last_fullsized":"2024-05-10T09:57:14.644172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643301+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:57:14.643301+0000","last_peered":"2024-05-10T09:57:14.643301+0000","last_clean":"2024-05-10T09:57:14.643301+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:57:14.643301+0000","last_undegraded":"2024-05-10T09:57:14.643301+0000","last_fullsized":"2024-05-10T09:57:14.643301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611220+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:57:11.611220+0000","last_peered":"2024-05-10T09:57:11.611220+0000","last_clean":"2024-05-10T09:57:11.611220+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:57:11.611220+0000","last_undegraded":"2024-05-10T09:57:11.611220+0000","last_fullsized":"2024-05-10T09:57:11.611220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'7","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.725154+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:57:14.725154+0000","last_peered":"2024-05-10T09:57:14.725154+0000","last_clean":"2024-05-10T09:57:14.725154+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:57:14.725154+0000","last_undegraded":"2024-05-10T09:57:14.725154+0000","last_fullsized":"2024-05-10T09:57:14.725154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":22536,"num_write":27,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658205+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:57:14.658205+0000","last_peered":"2024-05-10T09:57:14.658205+0000","last_clean":"2024-05-10T09:57:14.658205+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:57:14.658205+0000","last_undegraded":"2024-05-10T09:57:14.658205+0000","last_fullsized":"2024-05-10T09:57:14.658205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'7","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.871393+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:57:14.871393+0000","last_peered":"2024-05-10T09:57:14.871393+0000","last_clean":"2024-05-10T09:57:14.871393+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:57:14.871393+0000","last_undegraded":"2024-05-10T09:57:14.871393+0000","last_fullsized":"2024-05-10T09:57:14.871393+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'33","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.749562+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:57:14.749562+0000","last_peered":"2024-05-10T09:57:14.749562+0000","last_clean":"2024-05-10T09:57:14.749562+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:57:14.749562+0000","last_undegraded":"2024-05-10T09:57:14.749562+0000","last_fullsized":"2024-05-10T09:57:14.749562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":84,"num_write":49,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"79'5","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664024+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:57:14.664024+0000","last_peered":"2024-05-10T09:57:14.664024+0000","last_clean":"2024-05-10T09:57:14.664024+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:57:14.664024+0000","last_undegraded":"2024-05-10T09:57:14.664024+0000","last_fullsized":"2024-05-10T09:57:14.664024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642792+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:57:14.642792+0000","last_peered":"2024-05-10T09:57:14.642792+0000","last_clean":"2024-05-10T09:57:14.642792+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:57:14.642792+0000","last_undegraded":"2024-05-10T09:57:14.642792+0000","last_fullsized":"2024-05-10T09:57:14.642792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"78'18","reported_seq":148,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614041+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:57:11.614041+0000","last_peered":"2024-05-10T09:57:11.614041+0000","last_clean":"2024-05-10T09:57:11.614041+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:57:11.614041+0000","last_undegraded":"2024-05-10T09:57:11.614041+0000","last_fullsized":"2024-05-10T09:57:11.614041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":61448,"num_write":38,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"79'19","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642980+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:57:14.642980+0000","last_peered":"2024-05-10T09:57:14.642980+0000","last_clean":"2024-05-10T09:57:14.642980+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:57:14.642980+0000","last_undegraded":"2024-05-10T09:57:14.642980+0000","last_fullsized":"2024-05-10T09:57:14.642980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:28.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":49,"num_write":28,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.898427+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:57:14.898427+0000","last_peered":"2024-05-10T09:57:14.898427+0000","last_clean":"2024-05-10T09:57:14.898427+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:57:14.898427+0000","last_undegraded":"2024-05-10T09:57:14.898427+0000","last_fullsized":"2024-05-10T09:57:14.898427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612837+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:57:11.612837+0000","last_peered":"2024-05-10T09:57:11.612837+0000","last_clean":"2024-05-10T09:57:11.612837+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:57:11.612837+0000","last_undegraded":"2024-05-10T09:57:11.612837+0000","last_fullsized":"2024-05-10T09:57:11.612837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"79'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660931+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:57:14.660931+0000","last_peered":"2024-05-10T09:57:14.660931+0000","last_clean":"2024-05-10T09:57:14.660931+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:57:14.660931+0000","last_undegraded":"2024-05-10T09:57:14.660931+0000","last_fullsized":"2024-05-10T09:57:14.660931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611728+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:57:11.611728+0000","last_peered":"2024-05-10T09:57:11.611728+0000","last_clean":"2024-05-10T09:57:11.611728+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:57:11.611728+0000","last_undegraded":"2024-05-10T09:57:11.611728+0000","last_fullsized":"2024-05-10T09:57:11.611728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645981+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:57:14.645981+0000","last_peered":"2024-05-10T09:57:14.645981+0000","last_clean":"2024-05-10T09:57:14.645981+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:57:14.645981+0000","last_undegraded":"2024-05-10T09:57:14.645981+0000","last_fullsized":"2024-05-10T09:57:14.645981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'10","reported_seq":186,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.203343+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:57:15.203343+0000","last_peered":"2024-05-10T09:57:15.203343+0000","last_clean":"2024-05-10T09:57:15.203343+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:57:15.203343+0000","last_undegraded":"2024-05-10T09:57:15.203343+0000","last_fullsized":"2024-05-10T09:57:15.203343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":18442,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670164+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:57:14.670164+0000","last_peered":"2024-05-10T09:57:14.670164+0000","last_clean":"2024-05-10T09:57:14.670164+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:57:14.670164+0000","last_undegraded":"2024-05-10T09:57:14.670164+0000","last_fullsized":"2024-05-10T09:57:14.670164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"89'14","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.880793+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:57:14.880793+0000","last_peered":"2024-05-10T09:57:14.880793+0000","last_clean":"2024-05-10T09:57:14.880793+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:57:14.880793+0000","last_undegraded":"2024-05-10T09:57:14.880793+0000","last_fullsized":"2024-05-10T09:57:14.880793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659360+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:57:14.659360+0000","last_peered":"2024-05-10T09:57:14.659360+0000","last_clean":"2024-05-10T09:57:14.659360+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:57:14.659360+0000","last_undegraded":"2024-05-10T09:57:14.659360+0000","last_fullsized":"2024-05-10T09:57:14.659360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669023+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:57:14.669023+0000","last_peered":"2024-05-10T09:57:14.669023+0000","last_clean":"2024-05-10T09:57:14.669023+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:57:14.669023+0000","last_undegraded":"2024-05-10T09:57:14.669023+0000","last_fullsized":"2024-05-10T09:57:14.669023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670472+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:57:14.670472+0000","last_peered":"2024-05-10T09:57:14.670472+0000","last_clean":"2024-05-10T09:57:14.670472+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:57:14.670472+0000","last_undegraded":"2024-05-10T09:57:14.670472+0000","last_fullsized":"2024-05-10T09:57:14.670472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'11","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.966513+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:57:14.966513+0000","last_peered":"2024-05-10T09:57:14.966513+0000","last_clean":"2024-05-10T09:57:14.966513+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:57:14.966513+0000","last_undegraded":"2024-05-10T09:57:14.966513+0000","last_fullsized":"2024-05-10T09:57:14.966513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645820+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:57:14.645820+0000","last_peered":"2024-05-10T09:57:14.645820+0000","last_clean":"2024-05-10T09:57:14.645820+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:57:14.645820+0000","last_undegraded":"2024-05-10T09:57:14.645820+0000","last_fullsized":"2024-05-10T09:57:14.645820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613295+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:57:11.613295+0000","last_peered":"2024-05-10T09:57:11.613295+0000","last_clean":"2024-05-10T09:57:11.613295+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:57:11.613295+0000","last_undegraded":"2024-05-10T09:57:11.613295+0000","last_fullsized":"2024-05-10T09:57:11.613295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614538+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:57:11.614538+0000","last_peered":"2024-05-10T09:57:11.614538+0000","last_clean":"2024-05-10T09:57:11.614538+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:57:11.614538+0000","last_undegraded":"2024-05-10T09:57:11.614538+0000","last_fullsized":"2024-05-10T09:57:11.614538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660749+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:57:14.660749+0000","last_peered":"2024-05-10T09:57:14.660749+0000","last_clean":"2024-05-10T09:57:14.660749+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:57:14.660749+0000","last_undegraded":"2024-05-10T09:57:14.660749+0000","last_fullsized":"2024-05-10T09:57:14.660749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662055+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:57:14.662055+0000","last_peered":"2024-05-10T09:57:14.662055+0000","last_clean":"2024-05-10T09:57:14.662055+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:57:14.662055+0000","last_undegraded":"2024-05-10T09:57:14.662055+0000","last_fullsized":"2024-05-10T09:57:14.662055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'13","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.031023+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:57:15.031023+0000","last_peered":"2024-05-10T09:57:15.031023+0000","last_clean":"2024-05-10T09:57:15.031023+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:57:15.031023+0000","last_undegraded":"2024-05-10T09:57:15.031023+0000","last_fullsized":"2024-05-10T09:57:15.031023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646795+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:57:14.646795+0000","last_peered":"2024-05-10T09:57:14.646795+0000","last_clean":"2024-05-10T09:57:14.646795+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:57:14.646795+0000","last_undegraded":"2024-05-10T09:57:14.646795+0000","last_fullsized":"2024-05-10T09:57:14.646795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642811+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:57:14.642811+0000","last_peered":"2024-05-10T09:57:14.642811+0000","last_clean":"2024-05-10T09:57:14.642811+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:57:14.642811+0000","last_undegraded":"2024-05-10T09:57:14.642811+0000","last_fullsized":"2024-05-10T09:57:14.642811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:28.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"88'13","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658261+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:57:14.658261+0000","last_peered":"2024-05-10T09:57:14.658261+0000","last_clean":"2024-05-10T09:57:14.658261+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:57:14.658261+0000","last_undegraded":"2024-05-10T09:57:14.658261+0000","last_fullsized":"2024-05-10T09:57:14.658261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612651+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:57:11.612651+0000","last_peered":"2024-05-10T09:57:11.612651+0000","last_clean":"2024-05-10T09:57:11.612651+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:57:11.612651+0000","last_undegraded":"2024-05-10T09:57:11.612651+0000","last_fullsized":"2024-05-10T09:57:11.612651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646130+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:57:14.646130+0000","last_peered":"2024-05-10T09:57:14.646130+0000","last_clean":"2024-05-10T09:57:14.646130+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:57:14.646130+0000","last_undegraded":"2024-05-10T09:57:14.646130+0000","last_fullsized":"2024-05-10T09:57:14.646130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.828622+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:57:14.828622+0000","last_peered":"2024-05-10T09:57:14.828622+0000","last_clean":"2024-05-10T09:57:14.828622+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:57:14.828622+0000","last_undegraded":"2024-05-10T09:57:14.828622+0000","last_fullsized":"2024-05-10T09:57:14.828622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670406+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:57:14.670406+0000","last_peered":"2024-05-10T09:57:14.670406+0000","last_clean":"2024-05-10T09:57:14.670406+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:57:14.670406+0000","last_undegraded":"2024-05-10T09:57:14.670406+0000","last_fullsized":"2024-05-10T09:57:14.670406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.946203+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:57:14.946203+0000","last_peered":"2024-05-10T09:57:14.946203+0000","last_clean":"2024-05-10T09:57:14.946203+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:57:14.946203+0000","last_undegraded":"2024-05-10T09:57:14.946203+0000","last_fullsized":"2024-05-10T09:57:14.946203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645117+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:57:14.645117+0000","last_peered":"2024-05-10T09:57:14.645117+0000","last_clean":"2024-05-10T09:57:14.645117+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:57:14.645117+0000","last_undegraded":"2024-05-10T09:57:14.645117+0000","last_fullsized":"2024-05-10T09:57:14.645117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669027+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:57:14.669027+0000","last_peered":"2024-05-10T09:57:14.669027+0000","last_clean":"2024-05-10T09:57:14.669027+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:57:14.669027+0000","last_undegraded":"2024-05-10T09:57:14.669027+0000","last_fullsized":"2024-05-10T09:57:14.669027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'7","reported_seq":176,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.055149+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:57:15.055149+0000","last_peered":"2024-05-10T09:57:15.055149+0000","last_clean":"2024-05-10T09:57:15.055149+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:57:15.055149+0000","last_undegraded":"2024-05-10T09:57:15.055149+0000","last_fullsized":"2024-05-10T09:57:15.055149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":18440,"num_write":27,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657400+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:57:14.657400+0000","last_peered":"2024-05-10T09:57:14.657400+0000","last_clean":"2024-05-10T09:57:14.657400+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:57:14.657400+0000","last_undegraded":"2024-05-10T09:57:14.657400+0000","last_fullsized":"2024-05-10T09:57:14.657400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"89'23","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.736581+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:57:14.736581+0000","last_peered":"2024-05-10T09:57:14.736581+0000","last_clean":"2024-05-10T09:57:14.736581+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:57:14.736581+0000","last_undegraded":"2024-05-10T09:57:14.736581+0000","last_fullsized":"2024-05-10T09:57:14.736581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980750+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:57:13.980750+0000","last_peered":"2024-05-10T09:57:13.980750+0000","last_clean":"2024-05-10T09:57:13.980750+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:57:13.980750+0000","last_undegraded":"2024-05-10T09:57:13.980750+0000","last_fullsized":"2024-05-10T09:57:13.980750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669713+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:57:14.669713+0000","last_peered":"2024-05-10T09:57:14.669713+0000","last_clean":"2024-05-10T09:57:14.669713+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:57:14.669713+0000","last_undegraded":"2024-05-10T09:57:14.669713+0000","last_fullsized":"2024-05-10T09:57:14.669713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":120,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611357+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:57:11.611357+0000","last_peered":"2024-05-10T09:57:11.611357+0000","last_clean":"2024-05-10T09:57:11.611357+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:57:11.611357+0000","last_undegraded":"2024-05-10T09:57:11.611357+0000","last_fullsized":"2024-05-10T09:57:11.611357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'13","reported_seq":193,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.894085+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:57:14.894085+0000","last_peered":"2024-05-10T09:57:14.894085+0000","last_clean":"2024-05-10T09:57:14.894085+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:57:14.894085+0000","last_undegraded":"2024-05-10T09:57:14.894085+0000","last_fullsized":"2024-05-10T09:57:14.894085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642617+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:57:14.642617+0000","last_peered":"2024-05-10T09:57:14.642617+0000","last_clean":"2024-05-10T09:57:14.642617+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:57:14.642617+0000","last_undegraded":"2024-05-10T09:57:14.642617+0000","last_fullsized":"2024-05-10T09:57:14.642617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.746019+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:57:14.746019+0000","last_peered":"2024-05-10T09:57:14.746019+0000","last_clean":"2024-05-10T09:57:14.746019+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:57:14.746019+0000","last_undegraded":"2024-05-10T09:57:14.746019+0000","last_fullsized":"2024-05-10T09:57:14.746019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644410+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:57:14.644410+0000","last_peered":"2024-05-10T09:57:14.644410+0000","last_clean":"2024-05-10T09:57:14.644410+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:57:14.644410+0000","last_undegraded":"2024-05-10T09:57:14.644410+0000","last_fullsized":"2024-05-10T09:57:14.644410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"75'1","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663569+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:57:14.663569+0000","last_peered":"2024-05-10T09:57:14.663569+0000","last_clean":"2024-05-10T09:57:14.663569+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:57:14.663569+0000","last_undegraded":"2024-05-10T09:57:14.663569+0000","last_fullsized":"2024-05-10T09:57:14.663569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663142+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:57:14.663142+0000","last_peered":"2024-05-10T09:57:14.663142+0000","last_clean":"2024-05-10T09:57:14.663142+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:57:14.663142+0000","last_undegraded":"2024-05-10T09:57:14.663142+0000","last_fullsized":"2024-05-10T09:57:14.663142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659722+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:57:14.659722+0000","last_peered":"2024-05-10T09:57:14.659722+0000","last_clean":"2024-05-10T09:57:14.659722+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:57:14.659722+0000","last_undegraded":"2024-05-10T09:57:14.659722+0000","last_fullsized":"2024-05-10T09:57:14.659722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643136+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:57:14.643136+0000","last_peered":"2024-05-10T09:57:14.643136+0000","last_clean":"2024-05-10T09:57:14.643136+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:57:14.643136+0000","last_undegraded":"2024-05-10T09:57:14.643136+0000","last_fullsized":"2024-05-10T09:57:14.643136+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"89'18","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.685205+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:57:14.685205+0000","last_peered":"2024-05-10T09:57:14.685205+0000","last_clean":"2024-05-10T09:57:14.685205+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:57:14.685205+0000","last_undegraded":"2024-05-10T09:57:14.685205+0000","last_fullsized":"2024-05-10T09:57:14.685205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660549+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:57:14.660549+0000","last_peered":"2024-05-10T09:57:14.660549+0000","last_clean":"2024-05-10T09:57:14.660549+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:57:14.660549+0000","last_undegraded":"2024-05-10T09:57:14.660549+0000","last_fullsized":"2024-05-10T09:57:14.660549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661542+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:57:14.661542+0000","last_peered":"2024-05-10T09:57:14.661542+0000","last_clean":"2024-05-10T09:57:14.661542+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:57:14.661542+0000","last_undegraded":"2024-05-10T09:57:14.661542+0000","last_fullsized":"2024-05-10T09:57:14.661542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'41","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.170938+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:57:15.170938+0000","last_peered":"2024-05-10T09:57:15.170938+0000","last_clean":"2024-05-10T09:57:15.170938+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:57:15.170938+0000","last_undegraded":"2024-05-10T09:57:15.170938+0000","last_fullsized":"2024-05-10T09:57:15.170938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":142,"num_read_kb":104,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'14","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.123860+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:57:15.123860+0000","last_peered":"2024-05-10T09:57:15.123860+0000","last_clean":"2024-05-10T09:57:15.123860+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:57:15.123860+0000","last_undegraded":"2024-05-10T09:57:15.123860+0000","last_fullsized":"2024-05-10T09:57:15.123860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":24,"num_read_kb":49166,"num_write":44,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643601+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:57:14.643601+0000","last_peered":"2024-05-10T09:57:14.643601+0000","last_clean":"2024-05-10T09:57:14.643601+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:57:14.643601+0000","last_undegraded":"2024-05-10T09:57:14.643601+0000","last_fullsized":"2024-05-10T09:57:14.643601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:37.269066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"89'22","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.018670+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:57:15.018670+0000","last_peered":"2024-05-10T09:57:15.018670+0000","last_clean":"2024-05-10T09:57:15.018670+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:57:15.018670+0000","last_undegraded":"2024-05-10T09:57:15.018670+0000","last_fullsized":"2024-05-10T09:57:15.018670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16575,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642535+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:57:14.642535+0000","last_peered":"2024-05-10T09:57:14.642535+0000","last_clean":"2024-05-10T09:57:14.642535+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:57:14.642535+0000","last_undegraded":"2024-05-10T09:57:14.642535+0000","last_fullsized":"2024-05-10T09:57:14.642535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979533+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:57:13.979533+0000","last_peered":"2024-05-10T09:57:13.979533+0000","last_clean":"2024-05-10T09:57:13.979533+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:57:13.979533+0000","last_undegraded":"2024-05-10T09:57:13.979533+0000","last_fullsized":"2024-05-10T09:57:13.979533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614061+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:57:11.614061+0000","last_peered":"2024-05-10T09:57:11.614061+0000","last_clean":"2024-05-10T09:57:11.614061+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:57:11.614061+0000","last_undegraded":"2024-05-10T09:57:11.614061+0000","last_fullsized":"2024-05-10T09:57:11.614061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.019224+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:57:15.019224+0000","last_peered":"2024-05-10T09:57:15.019224+0000","last_clean":"2024-05-10T09:57:15.019224+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:57:15.019224+0000","last_undegraded":"2024-05-10T09:57:15.019224+0000","last_fullsized":"2024-05-10T09:57:15.019224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":28688,"num_write":49,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642798+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:57:14.642798+0000","last_peered":"2024-05-10T09:57:14.642798+0000","last_clean":"2024-05-10T09:57:14.642798+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:57:14.642798+0000","last_undegraded":"2024-05-10T09:57:14.642798+0000","last_fullsized":"2024-05-10T09:57:14.642798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'14","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614674+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:57:11.614674+0000","last_peered":"2024-05-10T09:57:11.614674+0000","last_clean":"2024-05-10T09:57:11.614674+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:57:11.614674+0000","last_undegraded":"2024-05-10T09:57:11.614674+0000","last_fullsized":"2024-05-10T09:57:11.614674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662481+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:57:14.662481+0000","last_peered":"2024-05-10T09:57:14.662481+0000","last_clean":"2024-05-10T09:57:14.662481+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:57:14.662481+0000","last_undegraded":"2024-05-10T09:57:14.662481+0000","last_fullsized":"2024-05-10T09:57:14.662481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643655+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:57:14.643655+0000","last_peered":"2024-05-10T09:57:14.643655+0000","last_clean":"2024-05-10T09:57:14.643655+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:57:14.643655+0000","last_undegraded":"2024-05-10T09:57:14.643655+0000","last_fullsized":"2024-05-10T09:57:14.643655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613227+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:57:11.613227+0000","last_peered":"2024-05-10T09:57:11.613227+0000","last_clean":"2024-05-10T09:57:11.613227+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:57:11.613227+0000","last_undegraded":"2024-05-10T09:57:11.613227+0000","last_fullsized":"2024-05-10T09:57:11.613227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'7","reported_seq":171,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.171003+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:57:15.171003+0000","last_peered":"2024-05-10T09:57:15.171003+0000","last_clean":"2024-05-10T09:57:15.171003+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:57:15.171003+0000","last_undegraded":"2024-05-10T09:57:15.171003+0000","last_fullsized":"2024-05-10T09:57:15.171003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980390+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:57:13.980390+0000","last_peered":"2024-05-10T09:57:13.980390+0000","last_clean":"2024-05-10T09:57:13.980390+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:57:13.980390+0000","last_undegraded":"2024-05-10T09:57:13.980390+0000","last_fullsized":"2024-05-10T09:57:13.980390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"89'21","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.869191+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:57:14.869191+0000","last_peered":"2024-05-10T09:57:14.869191+0000","last_clean":"2024-05-10T09:57:14.869191+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:57:14.869191+0000","last_undegraded":"2024-05-10T09:57:14.869191+0000","last_fullsized":"2024-05-10T09:57:14.869191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"88'13","reported_seq":187,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643053+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:57:14.643053+0000","last_peered":"2024-05-10T09:57:14.643053+0000","last_clean":"2024-05-10T09:57:14.643053+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:57:14.643053+0000","last_undegraded":"2024-05-10T09:57:14.643053+0000","last_fullsized":"2024-05-10T09:57:14.643053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'1","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977575+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:57:13.977575+0000","last_peered":"2024-05-10T09:57:13.977575+0000","last_clean":"2024-05-10T09:57:13.977575+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:57:13.977575+0000","last_undegraded":"2024-05-10T09:57:13.977575+0000","last_fullsized":"2024-05-10T09:57:13.977575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614297+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:57:11.614297+0000","last_peered":"2024-05-10T09:57:11.614297+0000","last_clean":"2024-05-10T09:57:11.614297+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:57:11.614297+0000","last_undegraded":"2024-05-10T09:57:11.614297+0000","last_fullsized":"2024-05-10T09:57:11.614297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"78'3","reported_seq":121,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612084+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:57:11.612084+0000","last_peered":"2024-05-10T09:57:11.612084+0000","last_clean":"2024-05-10T09:57:11.612084+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:57:11.612084+0000","last_undegraded":"2024-05-10T09:57:11.612084+0000","last_fullsized":"2024-05-10T09:57:11.612084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670534+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:57:14.670534+0000","last_peered":"2024-05-10T09:57:14.670534+0000","last_clean":"2024-05-10T09:57:14.670534+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:57:14.670534+0000","last_undegraded":"2024-05-10T09:57:14.670534+0000","last_fullsized":"2024-05-10T09:57:14.670534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645293+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:57:14.645293+0000","last_peered":"2024-05-10T09:57:14.645293+0000","last_clean":"2024-05-10T09:57:14.645293+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:57:14.645293+0000","last_undegraded":"2024-05-10T09:57:14.645293+0000","last_fullsized":"2024-05-10T09:57:14.645293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"88'13","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663712+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:57:14.663712+0000","last_peered":"2024-05-10T09:57:14.663712+0000","last_clean":"2024-05-10T09:57:14.663712+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:57:14.663712+0000","last_undegraded":"2024-05-10T09:57:14.663712+0000","last_fullsized":"2024-05-10T09:57:14.663712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612069+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:57:11.612069+0000","last_peered":"2024-05-10T09:57:11.612069+0000","last_clean":"2024-05-10T09:57:11.612069+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:57:11.612069+0000","last_undegraded":"2024-05-10T09:57:11.612069+0000","last_fullsized":"2024-05-10T09:57:11.612069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"79'23","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978687+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:57:13.978687+0000","last_peered":"2024-05-10T09:57:13.978687+0000","last_clean":"2024-05-10T09:57:13.978687+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:57:13.978687+0000","last_undegraded":"2024-05-10T09:57:13.978687+0000","last_fullsized":"2024-05-10T09:57:13.978687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":77,"num_read_kb":55,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.978093+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:57:14.978093+0000","last_peered":"2024-05-10T09:57:14.978093+0000","last_clean":"2024-05-10T09:57:14.978093+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:57:14.978093+0000","last_undegraded":"2024-05-10T09:57:14.978093+0000","last_fullsized":"2024-05-10T09:57:14.978093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":18,"num_read_kb":43016,"num_write":32,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613792+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:57:11.613792+0000","last_peered":"2024-05-10T09:57:11.613792+0000","last_clean":"2024-05-10T09:57:11.613792+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:57:11.613792+0000","last_undegraded":"2024-05-10T09:57:11.613792+0000","last_fullsized":"2024-05-10T09:57:11.613792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"89'24","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.958778+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:57:14.958778+0000","last_peered":"2024-05-10T09:57:14.958778+0000","last_clean":"2024-05-10T09:57:14.958778+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:57:14.958778+0000","last_undegraded":"2024-05-10T09:57:14.958778+0000","last_fullsized":"2024-05-10T09:57:14.958778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663509+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:57:14.663509+0000","last_peered":"2024-05-10T09:57:14.663509+0000","last_clean":"2024-05-10T09:57:14.663509+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:57:14.663509+0000","last_undegraded":"2024-05-10T09:57:14.663509+0000","last_fullsized":"2024-05-10T09:57:14.663509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977320+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:57:13.977320+0000","last_peered":"2024-05-10T09:57:13.977320+0000","last_clean":"2024-05-10T09:57:13.977320+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:57:13.977320+0000","last_undegraded":"2024-05-10T09:57:13.977320+0000","last_fullsized":"2024-05-10T09:57:13.977320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'45","reported_seq":194,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.032881+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:57:15.032881+0000","last_peered":"2024-05-10T09:57:15.032881+0000","last_clean":"2024-05-10T09:57:15.032881+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:57:15.032881+0000","last_undegraded":"2024-05-10T09:57:15.032881+0000","last_fullsized":"2024-05-10T09:57:15.032881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":156,"num_read_kb":114,"num_write":67,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":243,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658368+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:57:14.658368+0000","last_peered":"2024-05-10T09:57:14.658368+0000","last_clean":"2024-05-10T09:57:14.658368+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:57:14.658368+0000","last_undegraded":"2024-05-10T09:57:14.658368+0000","last_fullsized":"2024-05-10T09:57:14.658368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669666+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:57:14.669666+0000","last_peered":"2024-05-10T09:57:14.669666+0000","last_clean":"2024-05-10T09:57:14.669666+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:57:14.669666+0000","last_undegraded":"2024-05-10T09:57:14.669666+0000","last_fullsized":"2024-05-10T09:57:14.669666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'11","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.925227+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:57:14.925227+0000","last_peered":"2024-05-10T09:57:14.925227+0000","last_clean":"2024-05-10T09:57:14.925227+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:57:14.925227+0000","last_undegraded":"2024-05-10T09:57:14.925227+0000","last_fullsized":"2024-05-10T09:57:14.925227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658016+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:57:14.658016+0000","last_peered":"2024-05-10T09:57:14.658016+0000","last_clean":"2024-05-10T09:57:14.658016+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:57:14.658016+0000","last_undegraded":"2024-05-10T09:57:14.658016+0000","last_fullsized":"2024-05-10T09:57:14.658016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"89'30","reported_seq":172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.229354+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:57:15.229354+0000","last_peered":"2024-05-10T09:57:15.229354+0000","last_clean":"2024-05-10T09:57:15.229354+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:57:15.229354+0000","last_undegraded":"2024-05-10T09:57:15.229354+0000","last_fullsized":"2024-05-10T09:57:15.229354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18409,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661634+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:57:14.661634+0000","last_peered":"2024-05-10T09:57:14.661634+0000","last_clean":"2024-05-10T09:57:14.661634+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:57:14.661634+0000","last_undegraded":"2024-05-10T09:57:14.661634+0000","last_fullsized":"2024-05-10T09:57:14.661634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662474+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:57:14.662474+0000","last_peered":"2024-05-10T09:57:14.662474+0000","last_clean":"2024-05-10T09:57:14.662474+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:57:14.662474+0000","last_undegraded":"2024-05-10T09:57:14.662474+0000","last_fullsized":"2024-05-10T09:57:14.662474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661914+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:57:14.661914+0000","last_peered":"2024-05-10T09:57:14.661914+0000","last_clean":"2024-05-10T09:57:14.661914+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:57:14.661914+0000","last_undegraded":"2024-05-10T09:57:14.661914+0000","last_fullsized":"2024-05-10T09:57:14.661914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657868+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:57:14.657868+0000","last_peered":"2024-05-10T09:57:14.657868+0000","last_clean":"2024-05-10T09:57:14.657868+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:57:14.657868+0000","last_undegraded":"2024-05-10T09:57:14.657868+0000","last_fullsized":"2024-05-10T09:57:14.657868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'12","reported_seq":196,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660796+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:57:14.660796+0000","last_peered":"2024-05-10T09:57:14.660796+0000","last_clean":"2024-05-10T09:57:14.660796+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:57:14.660796+0000","last_undegraded":"2024-05-10T09:57:14.660796+0000","last_fullsized":"2024-05-10T09:57:14.660796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.015437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.671724+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:57:14.671724+0000","last_peered":"2024-05-10T09:57:14.671724+0000","last_clean":"2024-05-10T09:57:14.671724+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:57:14.671724+0000","last_undegraded":"2024-05-10T09:57:14.671724+0000","last_fullsized":"2024-05-10T09:57:14.671724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'32","reported_seq":209,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979027+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:57:13.979027+0000","last_peered":"2024-05-10T09:57:13.979027+0000","last_clean":"2024-05-10T09:57:13.979027+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:57:13.979027+0000","last_undegraded":"2024-05-10T09:57:13.979027+0000","last_fullsized":"2024-05-10T09:57:13.979027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658354+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:57:14.658354+0000","last_peered":"2024-05-10T09:57:14.658354+0000","last_clean":"2024-05-10T09:57:14.658354+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:57:14.658354+0000","last_undegraded":"2024-05-10T09:57:14.658354+0000","last_fullsized":"2024-05-10T09:57:14.658354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977492+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:57:13.977492+0000","last_peered":"2024-05-10T09:57:13.977492+0000","last_clean":"2024-05-10T09:57:13.977492+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:57:13.977492+0000","last_undegraded":"2024-05-10T09:57:13.977492+0000","last_fullsized":"2024-05-10T09:57:13.977492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980779+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:57:13.980779+0000","last_peered":"2024-05-10T09:57:13.980779+0000","last_clean":"2024-05-10T09:57:13.980779+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:57:13.980779+0000","last_undegraded":"2024-05-10T09:57:13.980779+0000","last_fullsized":"2024-05-10T09:57:13.980779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643785+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:57:14.643785+0000","last_peered":"2024-05-10T09:57:14.643785+0000","last_clean":"2024-05-10T09:57:14.643785+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:57:14.643785+0000","last_undegraded":"2024-05-10T09:57:14.643785+0000","last_fullsized":"2024-05-10T09:57:14.643785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978346+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:57:13.978346+0000","last_peered":"2024-05-10T09:57:13.978346+0000","last_clean":"2024-05-10T09:57:13.978346+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:57:13.978346+0000","last_undegraded":"2024-05-10T09:57:13.978346+0000","last_fullsized":"2024-05-10T09:57:13.978346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":12,"num_read_kb":26628,"num_write":28,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":134,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643210+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:57:14.643210+0000","last_peered":"2024-05-10T09:57:14.643210+0000","last_clean":"2024-05-10T09:57:14.643210+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:57:14.643210+0000","last_undegraded":"2024-05-10T09:57:14.643210+0000","last_fullsized":"2024-05-10T09:57:14.643210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658897+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:57:14.658897+0000","last_peered":"2024-05-10T09:57:14.658897+0000","last_clean":"2024-05-10T09:57:14.658897+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:57:14.658897+0000","last_undegraded":"2024-05-10T09:57:14.658897+0000","last_fullsized":"2024-05-10T09:57:14.658897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661078+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:57:14.661078+0000","last_peered":"2024-05-10T09:57:14.661078+0000","last_clean":"2024-05-10T09:57:14.661078+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:57:14.661078+0000","last_undegraded":"2024-05-10T09:57:14.661078+0000","last_fullsized":"2024-05-10T09:57:14.661078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:06.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645314+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:57:14.645314+0000","last_peered":"2024-05-10T09:57:14.645314+0000","last_clean":"2024-05-10T09:57:14.645314+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:57:14.645314+0000","last_undegraded":"2024-05-10T09:57:14.645314+0000","last_fullsized":"2024-05-10T09:57:14.645314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977515+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:57:13.977515+0000","last_peered":"2024-05-10T09:57:13.977515+0000","last_clean":"2024-05-10T09:57:13.977515+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:57:13.977515+0000","last_undegraded":"2024-05-10T09:57:13.977515+0000","last_fullsized":"2024-05-10T09:57:13.977515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669739+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:57:14.669739+0000","last_peered":"2024-05-10T09:57:14.669739+0000","last_clean":"2024-05-10T09:57:14.669739+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:57:14.669739+0000","last_undegraded":"2024-05-10T09:57:14.669739+0000","last_fullsized":"2024-05-10T09:57:14.669739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"79'8","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612044+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:57:11.612044+0000","last_peered":"2024-05-10T09:57:11.612044+0000","last_clean":"2024-05-10T09:57:11.612044+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:57:11.612044+0000","last_undegraded":"2024-05-10T09:57:11.612044+0000","last_fullsized":"2024-05-10T09:57:11.612044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":12,"num_read_kb":24580,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661261+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:57:14.661261+0000","last_peered":"2024-05-10T09:57:14.661261+0000","last_clean":"2024-05-10T09:57:14.661261+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:57:14.661261+0000","last_undegraded":"2024-05-10T09:57:14.661261+0000","last_fullsized":"2024-05-10T09:57:14.661261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645918+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:57:14.645918+0000","last_peered":"2024-05-10T09:57:14.645918+0000","last_clean":"2024-05-10T09:57:14.645918+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:57:14.645918+0000","last_undegraded":"2024-05-10T09:57:14.645918+0000","last_fullsized":"2024-05-10T09:57:14.645918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663991+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:57:14.663991+0000","last_peered":"2024-05-10T09:57:14.663991+0000","last_clean":"2024-05-10T09:57:14.663991+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:57:14.663991+0000","last_undegraded":"2024-05-10T09:57:14.663991+0000","last_fullsized":"2024-05-10T09:57:14.663991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668718+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:57:14.668718+0000","last_peered":"2024-05-10T09:57:14.668718+0000","last_clean":"2024-05-10T09:57:14.668718+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:57:14.668718+0000","last_undegraded":"2024-05-10T09:57:14.668718+0000","last_fullsized":"2024-05-10T09:57:14.668718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979564+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:57:13.979564+0000","last_peered":"2024-05-10T09:57:13.979564+0000","last_clean":"2024-05-10T09:57:13.979564+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:57:13.979564+0000","last_undegraded":"2024-05-10T09:57:13.979564+0000","last_fullsized":"2024-05-10T09:57:13.979564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'13","reported_seq":166,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.817255+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:57:14.817255+0000","last_peered":"2024-05-10T09:57:14.817255+0000","last_clean":"2024-05-10T09:57:14.817255+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:57:14.817255+0000","last_undegraded":"2024-05-10T09:57:14.817255+0000","last_fullsized":"2024-05-10T09:57:14.817255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":19,"num_read_kb":45064,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979878+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:57:13.979878+0000","last_peered":"2024-05-10T09:57:13.979878+0000","last_clean":"2024-05-10T09:57:13.979878+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:57:13.979878+0000","last_undegraded":"2024-05-10T09:57:13.979878+0000","last_fullsized":"2024-05-10T09:57:13.979878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661037+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:57:14.661037+0000","last_peered":"2024-05-10T09:57:14.661037+0000","last_clean":"2024-05-10T09:57:14.661037+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:57:14.661037+0000","last_undegraded":"2024-05-10T09:57:14.661037+0000","last_fullsized":"2024-05-10T09:57:14.661037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"89'25","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.028912+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:57:15.028912+0000","last_peered":"2024-05-10T09:57:15.028912+0000","last_clean":"2024-05-10T09:57:15.028912+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:57:15.028912+0000","last_undegraded":"2024-05-10T09:57:15.028912+0000","last_fullsized":"2024-05-10T09:57:15.028912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9860,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613125+0000","last_change":"2024-05-10T09:57:09.652257+0000","last_active":"2024-05-10T09:57:11.613125+0000","last_peered":"2024-05-10T09:57:11.613125+0000","last_clean":"2024-05-10T09:57:11.613125+0000","last_became_active":"2024-05-10T09:57:09.648476+0000","last_became_peered":"2024-05-10T09:57:09.648476+0000","last_unstale":"2024-05-10T09:57:11.613125+0000","last_undegraded":"2024-05-10T09:57:11.613125+0000","last_fullsized":"2024-05-10T09:57:11.613125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:20.904851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661288+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:57:14.661288+0000","last_peered":"2024-05-10T09:57:14.661288+0000","last_clean":"2024-05-10T09:57:14.661288+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:57:14.661288+0000","last_undegraded":"2024-05-10T09:57:14.661288+0000","last_fullsized":"2024-05-10T09:57:14.661288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'37","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.798413+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:57:14.798413+0000","last_peered":"2024-05-10T09:57:14.798413+0000","last_clean":"2024-05-10T09:57:14.798413+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:57:14.798413+0000","last_undegraded":"2024-05-10T09:57:14.798413+0000","last_fullsized":"2024-05-10T09:57:14.798413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":94,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"77'3","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979612+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:57:13.979612+0000","last_peered":"2024-05-10T09:57:13.979612+0000","last_clean":"2024-05-10T09:57:13.979612+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:57:13.979612+0000","last_undegraded":"2024-05-10T09:57:13.979612+0000","last_fullsized":"2024-05-10T09:57:13.979612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659830+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:57:14.659830+0000","last_peered":"2024-05-10T09:57:14.659830+0000","last_clean":"2024-05-10T09:57:14.659830+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:57:14.659830+0000","last_undegraded":"2024-05-10T09:57:14.659830+0000","last_fullsized":"2024-05-10T09:57:14.659830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663017+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:57:14.663017+0000","last_peered":"2024-05-10T09:57:14.663017+0000","last_clean":"2024-05-10T09:57:14.663017+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:57:14.663017+0000","last_undegraded":"2024-05-10T09:57:14.663017+0000","last_fullsized":"2024-05-10T09:57:14.663017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978748+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:57:13.978748+0000","last_peered":"2024-05-10T09:57:13.978748+0000","last_clean":"2024-05-10T09:57:13.978748+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:57:13.978748+0000","last_undegraded":"2024-05-10T09:57:13.978748+0000","last_fullsized":"2024-05-10T09:57:13.978748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"88'13","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668905+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:57:14.668905+0000","last_peered":"2024-05-10T09:57:14.668905+0000","last_clean":"2024-05-10T09:57:14.668905+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:57:14.668905+0000","last_undegraded":"2024-05-10T09:57:14.668905+0000","last_fullsized":"2024-05-10T09:57:14.668905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646585+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:57:14.646585+0000","last_peered":"2024-05-10T09:57:14.646585+0000","last_clean":"2024-05-10T09:57:14.646585+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:57:14.646585+0000","last_undegraded":"2024-05-10T09:57:14.646585+0000","last_fullsized":"2024-05-10T09:57:14.646585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643947+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:57:14.643947+0000","last_peered":"2024-05-10T09:57:14.643947+0000","last_clean":"2024-05-10T09:57:14.643947+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:57:14.643947+0000","last_undegraded":"2024-05-10T09:57:14.643947+0000","last_fullsized":"2024-05-10T09:57:14.643947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"79'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645761+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:57:14.645761+0000","last_peered":"2024-05-10T09:57:14.645761+0000","last_clean":"2024-05-10T09:57:14.645761+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:57:14.645761+0000","last_undegraded":"2024-05-10T09:57:14.645761+0000","last_fullsized":"2024-05-10T09:57:14.645761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":12,"num_read_kb":38914,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978019+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:57:13.978019+0000","last_peered":"2024-05-10T09:57:13.978019+0000","last_clean":"2024-05-10T09:57:13.978019+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:57:13.978019+0000","last_undegraded":"2024-05-10T09:57:13.978019+0000","last_fullsized":"2024-05-10T09:57:13.978019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612834+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:57:11.612834+0000","last_peered":"2024-05-10T09:57:11.612834+0000","last_clean":"2024-05-10T09:57:11.612834+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:57:11.612834+0000","last_undegraded":"2024-05-10T09:57:11.612834+0000","last_fullsized":"2024-05-10T09:57:11.612834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614782+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:57:11.614782+0000","last_peered":"2024-05-10T09:57:11.614782+0000","last_clean":"2024-05-10T09:57:11.614782+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:57:11.614782+0000","last_undegraded":"2024-05-10T09:57:11.614782+0000","last_fullsized":"2024-05-10T09:57:11.614782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645993+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:57:14.645993+0000","last_peered":"2024-05-10T09:57:14.645993+0000","last_clean":"2024-05-10T09:57:14.645993+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:57:14.645993+0000","last_undegraded":"2024-05-10T09:57:14.645993+0000","last_fullsized":"2024-05-10T09:57:14.645993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"75'4","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.697706+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:57:14.697706+0000","last_peered":"2024-05-10T09:57:14.697706+0000","last_clean":"2024-05-10T09:57:14.697706+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:57:14.697706+0000","last_undegraded":"2024-05-10T09:57:14.697706+0000","last_fullsized":"2024-05-10T09:57:14.697706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"79'38","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612363+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:57:11.612363+0000","last_peered":"2024-05-10T09:57:11.612363+0000","last_clean":"2024-05-10T09:57:11.612363+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:57:11.612363+0000","last_undegraded":"2024-05-10T09:57:11.612363+0000","last_fullsized":"2024-05-10T09:57:11.612363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":56,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'19","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.010777+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:57:15.010777+0000","last_peered":"2024-05-10T09:57:15.010777+0000","last_clean":"2024-05-10T09:57:15.010777+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:57:15.010777+0000","last_undegraded":"2024-05-10T09:57:15.010777+0000","last_fullsized":"2024-05-10T09:57:15.010777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":35,"num_read_kb":59414,"num_write":69,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664373+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:57:14.664373+0000","last_peered":"2024-05-10T09:57:14.664373+0000","last_clean":"2024-05-10T09:57:14.664373+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:57:14.664373+0000","last_undegraded":"2024-05-10T09:57:14.664373+0000","last_fullsized":"2024-05-10T09:57:14.664373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643866+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:57:14.643866+0000","last_peered":"2024-05-10T09:57:14.643866+0000","last_clean":"2024-05-10T09:57:14.643866+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:57:14.643866+0000","last_undegraded":"2024-05-10T09:57:14.643866+0000","last_fullsized":"2024-05-10T09:57:14.643866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"89'30","reported_seq":176,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.069438+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:57:15.069438+0000","last_peered":"2024-05-10T09:57:15.069438+0000","last_clean":"2024-05-10T09:57:15.069438+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:57:15.069438+0000","last_undegraded":"2024-05-10T09:57:15.069438+0000","last_fullsized":"2024-05-10T09:57:15.069438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644605+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:57:14.644605+0000","last_peered":"2024-05-10T09:57:14.644605+0000","last_clean":"2024-05-10T09:57:14.644605+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:57:14.644605+0000","last_undegraded":"2024-05-10T09:57:14.644605+0000","last_fullsized":"2024-05-10T09:57:14.644605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669634+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:57:14.669634+0000","last_peered":"2024-05-10T09:57:14.669634+0000","last_clean":"2024-05-10T09:57:14.669634+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:57:14.669634+0000","last_undegraded":"2024-05-10T09:57:14.669634+0000","last_fullsized":"2024-05-10T09:57:14.669634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662340+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:57:14.662340+0000","last_peered":"2024-05-10T09:57:14.662340+0000","last_clean":"2024-05-10T09:57:14.662340+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:57:14.662340+0000","last_undegraded":"2024-05-10T09:57:14.662340+0000","last_fullsized":"2024-05-10T09:57:14.662340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612528+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:57:11.612528+0000","last_peered":"2024-05-10T09:57:11.612528+0000","last_clean":"2024-05-10T09:57:11.612528+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:57:11.612528+0000","last_undegraded":"2024-05-10T09:57:11.612528+0000","last_fullsized":"2024-05-10T09:57:11.612528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"79'7","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612013+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:57:11.612013+0000","last_peered":"2024-05-10T09:57:11.612013+0000","last_clean":"2024-05-10T09:57:11.612013+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:57:11.612013+0000","last_undegraded":"2024-05-10T09:57:11.612013+0000","last_fullsized":"2024-05-10T09:57:11.612013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":130,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980011+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:57:13.980011+0000","last_peered":"2024-05-10T09:57:13.980011+0000","last_clean":"2024-05-10T09:57:13.980011+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:57:13.980011+0000","last_undegraded":"2024-05-10T09:57:13.980011+0000","last_fullsized":"2024-05-10T09:57:13.980011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"89'15","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.682121+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:57:14.682121+0000","last_peered":"2024-05-10T09:57:14.682121+0000","last_clean":"2024-05-10T09:57:14.682121+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:57:14.682121+0000","last_undegraded":"2024-05-10T09:57:14.682121+0000","last_fullsized":"2024-05-10T09:57:14.682121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643726+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:57:14.643726+0000","last_peered":"2024-05-10T09:57:14.643726+0000","last_clean":"2024-05-10T09:57:14.643726+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:57:14.643726+0000","last_undegraded":"2024-05-10T09:57:14.643726+0000","last_fullsized":"2024-05-10T09:57:14.643726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"75'5","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645418+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:57:14.645418+0000","last_peered":"2024-05-10T09:57:14.645418+0000","last_clean":"2024-05-10T09:57:14.645418+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:57:14.645418+0000","last_undegraded":"2024-05-10T09:57:14.645418+0000","last_fullsized":"2024-05-10T09:57:14.645418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977014+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:57:13.977014+0000","last_peered":"2024-05-10T09:57:13.977014+0000","last_clean":"2024-05-10T09:57:13.977014+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:57:13.977014+0000","last_undegraded":"2024-05-10T09:57:13.977014+0000","last_fullsized":"2024-05-10T09:57:13.977014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.156571+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:57:15.156571+0000","last_peered":"2024-05-10T09:57:15.156571+0000","last_clean":"2024-05-10T09:57:15.156571+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:57:15.156571+0000","last_undegraded":"2024-05-10T09:57:15.156571+0000","last_fullsized":"2024-05-10T09:57:15.156571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":30738,"num_write":42,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645204+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:57:14.645204+0000","last_peered":"2024-05-10T09:57:14.645204+0000","last_clean":"2024-05-10T09:57:14.645204+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:57:14.645204+0000","last_undegraded":"2024-05-10T09:57:14.645204+0000","last_fullsized":"2024-05-10T09:57:14.645204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660626+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:57:14.660626+0000","last_peered":"2024-05-10T09:57:14.660626+0000","last_clean":"2024-05-10T09:57:14.660626+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:57:14.660626+0000","last_undegraded":"2024-05-10T09:57:14.660626+0000","last_fullsized":"2024-05-10T09:57:14.660626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657605+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:57:14.657605+0000","last_peered":"2024-05-10T09:57:14.657605+0000","last_clean":"2024-05-10T09:57:14.657605+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:57:14.657605+0000","last_undegraded":"2024-05-10T09:57:14.657605+0000","last_fullsized":"2024-05-10T09:57:14.657605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661135+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:57:14.661135+0000","last_peered":"2024-05-10T09:57:14.661135+0000","last_clean":"2024-05-10T09:57:14.661135+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:57:14.661135+0000","last_undegraded":"2024-05-10T09:57:14.661135+0000","last_fullsized":"2024-05-10T09:57:14.661135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644304+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:57:14.644304+0000","last_peered":"2024-05-10T09:57:14.644304+0000","last_clean":"2024-05-10T09:57:14.644304+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:57:14.644304+0000","last_undegraded":"2024-05-10T09:57:14.644304+0000","last_fullsized":"2024-05-10T09:57:14.644304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'9","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.822711+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:57:14.822711+0000","last_peered":"2024-05-10T09:57:14.822711+0000","last_clean":"2024-05-10T09:57:14.822711+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:57:14.822711+0000","last_undegraded":"2024-05-10T09:57:14.822711+0000","last_fullsized":"2024-05-10T09:57:14.822711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657037+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:57:14.657037+0000","last_peered":"2024-05-10T09:57:14.657037+0000","last_clean":"2024-05-10T09:57:14.657037+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:57:14.657037+0000","last_undegraded":"2024-05-10T09:57:14.657037+0000","last_fullsized":"2024-05-10T09:57:14.657037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"89'17","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.809194+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:57:14.809194+0000","last_peered":"2024-05-10T09:57:14.809194+0000","last_clean":"2024-05-10T09:57:14.809194+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:57:14.809194+0000","last_undegraded":"2024-05-10T09:57:14.809194+0000","last_fullsized":"2024-05-10T09:57:14.809194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11369,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662896+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:57:14.662896+0000","last_peered":"2024-05-10T09:57:14.662896+0000","last_clean":"2024-05-10T09:57:14.662896+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:57:14.662896+0000","last_undegraded":"2024-05-10T09:57:14.662896+0000","last_fullsized":"2024-05-10T09:57:14.662896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669643+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:57:14.669643+0000","last_peered":"2024-05-10T09:57:14.669643+0000","last_clean":"2024-05-10T09:57:14.669643+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:57:14.669643+0000","last_undegraded":"2024-05-10T09:57:14.669643+0000","last_fullsized":"2024-05-10T09:57:14.669643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644113+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:57:14.644113+0000","last_peered":"2024-05-10T09:57:14.644113+0000","last_clean":"2024-05-10T09:57:14.644113+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:57:14.644113+0000","last_undegraded":"2024-05-10T09:57:14.644113+0000","last_fullsized":"2024-05-10T09:57:14.644113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.161242+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:57:15.161242+0000","last_peered":"2024-05-10T09:57:15.161242+0000","last_clean":"2024-05-10T09:57:15.161242+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:57:15.161242+0000","last_undegraded":"2024-05-10T09:57:15.161242+0000","last_fullsized":"2024-05-10T09:57:15.161242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":20,"num_read_kb":40970,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662834+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:57:14.662834+0000","last_peered":"2024-05-10T09:57:14.662834+0000","last_clean":"2024-05-10T09:57:14.662834+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:57:14.662834+0000","last_undegraded":"2024-05-10T09:57:14.662834+0000","last_fullsized":"2024-05-10T09:57:14.662834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"89'15","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.777248+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:57:14.777248+0000","last_peered":"2024-05-10T09:57:14.777248+0000","last_clean":"2024-05-10T09:57:14.777248+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:57:14.777248+0000","last_undegraded":"2024-05-10T09:57:14.777248+0000","last_fullsized":"2024-05-10T09:57:14.777248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660860+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:57:14.660860+0000","last_peered":"2024-05-10T09:57:14.660860+0000","last_clean":"2024-05-10T09:57:14.660860+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:57:14.660860+0000","last_undegraded":"2024-05-10T09:57:14.660860+0000","last_fullsized":"2024-05-10T09:57:14.660860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664331+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:57:14.664331+0000","last_peered":"2024-05-10T09:57:14.664331+0000","last_clean":"2024-05-10T09:57:14.664331+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:57:14.664331+0000","last_undegraded":"2024-05-10T09:57:14.664331+0000","last_fullsized":"2024-05-10T09:57:14.664331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.712733+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:57:14.712733+0000","last_peered":"2024-05-10T09:57:14.712733+0000","last_clean":"2024-05-10T09:57:14.712733+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:57:14.712733+0000","last_undegraded":"2024-05-10T09:57:14.712733+0000","last_fullsized":"2024-05-10T09:57:14.712733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":18440,"num_write":26,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661713+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:57:14.661713+0000","last_peered":"2024-05-10T09:57:14.661713+0000","last_clean":"2024-05-10T09:57:14.661713+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:57:14.661713+0000","last_undegraded":"2024-05-10T09:57:14.661713+0000","last_fullsized":"2024-05-10T09:57:14.661713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'14","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979138+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:57:13.979138+0000","last_peered":"2024-05-10T09:57:13.979138+0000","last_clean":"2024-05-10T09:57:13.979138+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:57:13.979138+0000","last_undegraded":"2024-05-10T09:57:13.979138+0000","last_fullsized":"2024-05-10T09:57:13.979138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669821+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:57:14.669821+0000","last_peered":"2024-05-10T09:57:14.669821+0000","last_clean":"2024-05-10T09:57:14.669821+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:57:14.669821+0000","last_undegraded":"2024-05-10T09:57:14.669821+0000","last_fullsized":"2024-05-10T09:57:14.669821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644862+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:57:14.644862+0000","last_peered":"2024-05-10T09:57:14.644862+0000","last_clean":"2024-05-10T09:57:14.644862+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:57:14.644862+0000","last_undegraded":"2024-05-10T09:57:14.644862+0000","last_fullsized":"2024-05-10T09:57:14.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661829+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:57:14.661829+0000","last_peered":"2024-05-10T09:57:14.661829+0000","last_clean":"2024-05-10T09:57:14.661829+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:57:14.661829+0000","last_undegraded":"2024-05-10T09:57:14.661829+0000","last_fullsized":"2024-05-10T09:57:14.661829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":163,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980549+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:57:13.980549+0000","last_peered":"2024-05-10T09:57:13.980549+0000","last_clean":"2024-05-10T09:57:13.980549+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:57:13.980549+0000","last_undegraded":"2024-05-10T09:57:13.980549+0000","last_fullsized":"2024-05-10T09:57:13.980549+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":12,"num_read_kb":30722,"num_write":20,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664106+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:57:14.664106+0000","last_peered":"2024-05-10T09:57:14.664106+0000","last_clean":"2024-05-10T09:57:14.664106+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:57:14.664106+0000","last_undegraded":"2024-05-10T09:57:14.664106+0000","last_fullsized":"2024-05-10T09:57:14.664106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"89'20","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.084219+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:57:15.084219+0000","last_peered":"2024-05-10T09:57:15.084219+0000","last_clean":"2024-05-10T09:57:15.084219+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:57:15.084219+0000","last_undegraded":"2024-05-10T09:57:15.084219+0000","last_fullsized":"2024-05-10T09:57:15.084219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979746+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:57:13.979746+0000","last_peered":"2024-05-10T09:57:13.979746+0000","last_clean":"2024-05-10T09:57:13.979746+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:57:13.979746+0000","last_undegraded":"2024-05-10T09:57:13.979746+0000","last_fullsized":"2024-05-10T09:57:13.979746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662741+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:57:14.662741+0000","last_peered":"2024-05-10T09:57:14.662741+0000","last_clean":"2024-05-10T09:57:14.662741+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:57:14.662741+0000","last_undegraded":"2024-05-10T09:57:14.662741+0000","last_fullsized":"2024-05-10T09:57:14.662741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645473+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:57:14.645473+0000","last_peered":"2024-05-10T09:57:14.645473+0000","last_clean":"2024-05-10T09:57:14.645473+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:57:14.645473+0000","last_undegraded":"2024-05-10T09:57:14.645473+0000","last_fullsized":"2024-05-10T09:57:14.645473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"78'6","reported_seq":127,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611612+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:57:11.611612+0000","last_peered":"2024-05-10T09:57:11.611612+0000","last_clean":"2024-05-10T09:57:11.611612+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:57:11.611612+0000","last_undegraded":"2024-05-10T09:57:11.611612+0000","last_fullsized":"2024-05-10T09:57:11.611612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":18434,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612963+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:57:11.612963+0000","last_peered":"2024-05-10T09:57:11.612963+0000","last_clean":"2024-05-10T09:57:11.612963+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:57:11.612963+0000","last_undegraded":"2024-05-10T09:57:11.612963+0000","last_fullsized":"2024-05-10T09:57:11.612963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"89'15","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646841+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:57:14.646841+0000","last_peered":"2024-05-10T09:57:14.646841+0000","last_clean":"2024-05-10T09:57:14.646841+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:57:14.646841+0000","last_undegraded":"2024-05-10T09:57:14.646841+0000","last_fullsized":"2024-05-10T09:57:14.646841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979463+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:57:13.979463+0000","last_peered":"2024-05-10T09:57:13.979463+0000","last_clean":"2024-05-10T09:57:13.979463+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:57:13.979463+0000","last_undegraded":"2024-05-10T09:57:13.979463+0000","last_fullsized":"2024-05-10T09:57:13.979463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669089+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:57:14.669089+0000","last_peered":"2024-05-10T09:57:14.669089+0000","last_clean":"2024-05-10T09:57:14.669089+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:57:14.669089+0000","last_undegraded":"2024-05-10T09:57:14.669089+0000","last_fullsized":"2024-05-10T09:57:14.669089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'37","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.897854+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:57:14.897854+0000","last_peered":"2024-05-10T09:57:14.897854+0000","last_clean":"2024-05-10T09:57:14.897854+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:57:14.897854+0000","last_undegraded":"2024-05-10T09:57:14.897854+0000","last_fullsized":"2024-05-10T09:57:14.897854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":94,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"79'11","reported_seq":191,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660922+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:57:14.660922+0000","last_peered":"2024-05-10T09:57:14.660922+0000","last_clean":"2024-05-10T09:57:14.660922+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:57:14.660922+0000","last_undegraded":"2024-05-10T09:57:14.660922+0000","last_fullsized":"2024-05-10T09:57:14.660922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:36.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980205+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:57:13.980205+0000","last_peered":"2024-05-10T09:57:13.980205+0000","last_clean":"2024-05-10T09:57:13.980205+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:57:13.980205+0000","last_undegraded":"2024-05-10T09:57:13.980205+0000","last_fullsized":"2024-05-10T09:57:13.980205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614029+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:57:11.614029+0000","last_peered":"2024-05-10T09:57:11.614029+0000","last_clean":"2024-05-10T09:57:11.614029+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:57:11.614029+0000","last_undegraded":"2024-05-10T09:57:11.614029+0000","last_fullsized":"2024-05-10T09:57:11.614029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"88'15","reported_seq":182,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663795+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:57:14.663795+0000","last_peered":"2024-05-10T09:57:14.663795+0000","last_clean":"2024-05-10T09:57:14.663795+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:57:14.663795+0000","last_undegraded":"2024-05-10T09:57:14.663795+0000","last_fullsized":"2024-05-10T09:57:14.663795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657041+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:57:14.657041+0000","last_peered":"2024-05-10T09:57:14.657041+0000","last_clean":"2024-05-10T09:57:14.657041+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:57:14.657041+0000","last_undegraded":"2024-05-10T09:57:14.657041+0000","last_fullsized":"2024-05-10T09:57:14.657041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979034+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:57:13.979034+0000","last_peered":"2024-05-10T09:57:13.979034+0000","last_clean":"2024-05-10T09:57:13.979034+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:57:13.979034+0000","last_undegraded":"2024-05-10T09:57:13.979034+0000","last_fullsized":"2024-05-10T09:57:13.979034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"89'7","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.139712+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:57:15.139712+0000","last_peered":"2024-05-10T09:57:15.139712+0000","last_clean":"2024-05-10T09:57:15.139712+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:57:15.139712+0000","last_undegraded":"2024-05-10T09:57:15.139712+0000","last_fullsized":"2024-05-10T09:57:15.139712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18442,"num_write":37,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657721+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:57:14.657721+0000","last_peered":"2024-05-10T09:57:14.657721+0000","last_clean":"2024-05-10T09:57:14.657721+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:57:14.657721+0000","last_undegraded":"2024-05-10T09:57:14.657721+0000","last_fullsized":"2024-05-10T09:57:14.657721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"89'19","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.123342+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:57:15.123342+0000","last_peered":"2024-05-10T09:57:15.123342+0000","last_clean":"2024-05-10T09:57:15.123342+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:57:15.123342+0000","last_undegraded":"2024-05-10T09:57:15.123342+0000","last_fullsized":"2024-05-10T09:57:15.123342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660473+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:57:14.660473+0000","last_peered":"2024-05-10T09:57:14.660473+0000","last_clean":"2024-05-10T09:57:14.660473+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:57:14.660473+0000","last_undegraded":"2024-05-10T09:57:14.660473+0000","last_fullsized":"2024-05-10T09:57:14.660473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660334+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:57:14.660334+0000","last_peered":"2024-05-10T09:57:14.660334+0000","last_clean":"2024-05-10T09:57:14.660334+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:57:14.660334+0000","last_undegraded":"2024-05-10T09:57:14.660334+0000","last_fullsized":"2024-05-10T09:57:14.660334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614677+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:57:11.614677+0000","last_peered":"2024-05-10T09:57:11.614677+0000","last_clean":"2024-05-10T09:57:11.614677+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:57:11.614677+0000","last_undegraded":"2024-05-10T09:57:11.614677+0000","last_fullsized":"2024-05-10T09:57:11.614677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"89'9","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.865306+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:57:14.865306+0000","last_peered":"2024-05-10T09:57:14.865306+0000","last_clean":"2024-05-10T09:57:14.865306+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:57:14.865306+0000","last_undegraded":"2024-05-10T09:57:14.865306+0000","last_fullsized":"2024-05-10T09:57:14.865306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669591+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:57:14.669591+0000","last_peered":"2024-05-10T09:57:14.669591+0000","last_clean":"2024-05-10T09:57:14.669591+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:57:14.669591+0000","last_undegraded":"2024-05-10T09:57:14.669591+0000","last_fullsized":"2024-05-10T09:57:14.669591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.722985+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:57:14.722985+0000","last_peered":"2024-05-10T09:57:14.722985+0000","last_clean":"2024-05-10T09:57:14.722985+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:57:14.722985+0000","last_undegraded":"2024-05-10T09:57:14.722985+0000","last_fullsized":"2024-05-10T09:57:14.722985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662705+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:57:14.662705+0000","last_peered":"2024-05-10T09:57:14.662705+0000","last_clean":"2024-05-10T09:57:14.662705+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:57:14.662705+0000","last_undegraded":"2024-05-10T09:57:14.662705+0000","last_fullsized":"2024-05-10T09:57:14.662705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645636+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:57:14.645636+0000","last_peered":"2024-05-10T09:57:14.645636+0000","last_clean":"2024-05-10T09:57:14.645636+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:57:14.645636+0000","last_undegraded":"2024-05-10T09:57:14.645636+0000","last_fullsized":"2024-05-10T09:57:14.645636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644409+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:57:14.644409+0000","last_peered":"2024-05-10T09:57:14.644409+0000","last_clean":"2024-05-10T09:57:14.644409+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:57:14.644409+0000","last_undegraded":"2024-05-10T09:57:14.644409+0000","last_fullsized":"2024-05-10T09:57:14.644409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'7","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.045324+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:57:15.045324+0000","last_peered":"2024-05-10T09:57:15.045324+0000","last_clean":"2024-05-10T09:57:15.045324+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:57:15.045324+0000","last_undegraded":"2024-05-10T09:57:15.045324+0000","last_fullsized":"2024-05-10T09:57:15.045324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611725+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:57:11.611725+0000","last_peered":"2024-05-10T09:57:11.611725+0000","last_clean":"2024-05-10T09:57:11.611725+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:57:11.611725+0000","last_undegraded":"2024-05-10T09:57:11.611725+0000","last_fullsized":"2024-05-10T09:57:11.611725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"89'8","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.044920+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:57:15.044920+0000","last_peered":"2024-05-10T09:57:15.044920+0000","last_clean":"2024-05-10T09:57:15.044920+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:57:15.044920+0000","last_undegraded":"2024-05-10T09:57:15.044920+0000","last_fullsized":"2024-05-10T09:57:15.044920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614956+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:57:11.614956+0000","last_peered":"2024-05-10T09:57:11.614956+0000","last_clean":"2024-05-10T09:57:11.614956+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:57:11.614956+0000","last_undegraded":"2024-05-10T09:57:11.614956+0000","last_fullsized":"2024-05-10T09:57:11.614956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658786+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:57:14.658786+0000","last_peered":"2024-05-10T09:57:14.658786+0000","last_clean":"2024-05-10T09:57:14.658786+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:57:14.658786+0000","last_undegraded":"2024-05-10T09:57:14.658786+0000","last_fullsized":"2024-05-10T09:57:14.658786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611206+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:57:11.611206+0000","last_peered":"2024-05-10T09:57:11.611206+0000","last_clean":"2024-05-10T09:57:11.611206+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:57:11.611206+0000","last_undegraded":"2024-05-10T09:57:11.611206+0000","last_fullsized":"2024-05-10T09:57:11.611206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'14","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.113881+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:57:15.113881+0000","last_peered":"2024-05-10T09:57:15.113881+0000","last_clean":"2024-05-10T09:57:15.113881+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:57:15.113881+0000","last_undegraded":"2024-05-10T09:57:15.113881+0000","last_fullsized":"2024-05-10T09:57:15.113881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978862+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:57:13.978862+0000","last_peered":"2024-05-10T09:57:13.978862+0000","last_clean":"2024-05-10T09:57:13.978862+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:57:13.978862+0000","last_undegraded":"2024-05-10T09:57:13.978862+0000","last_fullsized":"2024-05-10T09:57:13.978862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'11","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614627+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:57:11.614627+0000","last_peered":"2024-05-10T09:57:11.614627+0000","last_clean":"2024-05-10T09:57:11.614627+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:57:11.614627+0000","last_undegraded":"2024-05-10T09:57:11.614627+0000","last_fullsized":"2024-05-10T09:57:11.614627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660673+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:57:14.660673+0000","last_peered":"2024-05-10T09:57:14.660673+0000","last_clean":"2024-05-10T09:57:14.660673+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:57:14.660673+0000","last_undegraded":"2024-05-10T09:57:14.660673+0000","last_fullsized":"2024-05-10T09:57:14.660673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613323+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:57:11.613323+0000","last_peered":"2024-05-10T09:57:11.613323+0000","last_clean":"2024-05-10T09:57:11.613323+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:57:11.613323+0000","last_undegraded":"2024-05-10T09:57:11.613323+0000","last_fullsized":"2024-05-10T09:57:11.613323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979108+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:57:13.979108+0000","last_peered":"2024-05-10T09:57:13.979108+0000","last_clean":"2024-05-10T09:57:13.979108+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:57:13.979108+0000","last_undegraded":"2024-05-10T09:57:13.979108+0000","last_fullsized":"2024-05-10T09:57:13.979108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.754927+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:57:14.754927+0000","last_peered":"2024-05-10T09:57:14.754927+0000","last_clean":"2024-05-10T09:57:14.754927+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:57:14.754927+0000","last_undegraded":"2024-05-10T09:57:14.754927+0000","last_fullsized":"2024-05-10T09:57:14.754927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978145+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:57:13.978145+0000","last_peered":"2024-05-10T09:57:13.978145+0000","last_clean":"2024-05-10T09:57:13.978145+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:57:13.978145+0000","last_undegraded":"2024-05-10T09:57:13.978145+0000","last_fullsized":"2024-05-10T09:57:13.978145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'14","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.194965+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:57:15.194965+0000","last_peered":"2024-05-10T09:57:15.194965+0000","last_clean":"2024-05-10T09:57:15.194965+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:57:15.194965+0000","last_undegraded":"2024-05-10T09:57:15.194965+0000","last_fullsized":"2024-05-10T09:57:15.194965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'33","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.092894+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:57:15.092894+0000","last_peered":"2024-05-10T09:57:15.092894+0000","last_clean":"2024-05-10T09:57:15.092894+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:57:15.092894+0000","last_undegraded":"2024-05-10T09:57:15.092894+0000","last_fullsized":"2024-05-10T09:57:15.092894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":84,"num_write":49,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"79'6","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669696+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:57:14.669696+0000","last_peered":"2024-05-10T09:57:14.669696+0000","last_clean":"2024-05-10T09:57:14.669696+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:57:14.669696+0000","last_undegraded":"2024-05-10T09:57:14.669696+0000","last_fullsized":"2024-05-10T09:57:14.669696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977880+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:57:13.977880+0000","last_peered":"2024-05-10T09:57:13.977880+0000","last_clean":"2024-05-10T09:57:13.977880+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:57:13.977880+0000","last_undegraded":"2024-05-10T09:57:13.977880+0000","last_fullsized":"2024-05-10T09:57:13.977880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'21","reported_seq":183,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.083034+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:57:15.083034+0000","last_peered":"2024-05-10T09:57:15.083034+0000","last_clean":"2024-05-10T09:57:15.083034+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:57:15.083034+0000","last_undegraded":"2024-05-10T09:57:15.083034+0000","last_fullsized":"2024-05-10T09:57:15.083034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":29,"num_read_kb":71692,"num_write":41,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645409+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:57:14.645409+0000","last_peered":"2024-05-10T09:57:14.645409+0000","last_clean":"2024-05-10T09:57:14.645409+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:57:14.645409+0000","last_undegraded":"2024-05-10T09:57:14.645409+0000","last_fullsized":"2024-05-10T09:57:14.645409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646233+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:57:14.646233+0000","last_peered":"2024-05-10T09:57:14.646233+0000","last_clean":"2024-05-10T09:57:14.646233+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:57:14.646233+0000","last_undegraded":"2024-05-10T09:57:14.646233+0000","last_fullsized":"2024-05-10T09:57:14.646233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":14338,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611759+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:57:11.611759+0000","last_peered":"2024-05-10T09:57:11.611759+0000","last_clean":"2024-05-10T09:57:11.611759+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:57:11.611759+0000","last_undegraded":"2024-05-10T09:57:11.611759+0000","last_fullsized":"2024-05-10T09:57:11.611759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"79'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980539+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:57:13.980539+0000","last_peered":"2024-05-10T09:57:13.980539+0000","last_clean":"2024-05-10T09:57:13.980539+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:57:13.980539+0000","last_undegraded":"2024-05-10T09:57:13.980539+0000","last_fullsized":"2024-05-10T09:57:13.980539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642741+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:57:14.642741+0000","last_peered":"2024-05-10T09:57:14.642741+0000","last_clean":"2024-05-10T09:57:14.642741+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:57:14.642741+0000","last_undegraded":"2024-05-10T09:57:14.642741+0000","last_fullsized":"2024-05-10T09:57:14.642741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.091404+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:57:15.091404+0000","last_peered":"2024-05-10T09:57:15.091404+0000","last_clean":"2024-05-10T09:57:15.091404+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:57:15.091404+0000","last_undegraded":"2024-05-10T09:57:15.091404+0000","last_fullsized":"2024-05-10T09:57:15.091404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662566+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:57:14.662566+0000","last_peered":"2024-05-10T09:57:14.662566+0000","last_clean":"2024-05-10T09:57:14.662566+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:57:14.662566+0000","last_undegraded":"2024-05-10T09:57:14.662566+0000","last_fullsized":"2024-05-10T09:57:14.662566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'11","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.986587+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:57:14.986587+0000","last_peered":"2024-05-10T09:57:14.986587+0000","last_clean":"2024-05-10T09:57:14.986587+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:57:14.986587+0000","last_undegraded":"2024-05-10T09:57:14.986587+0000","last_fullsized":"2024-05-10T09:57:14.986587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36870,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662658+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:57:14.662658+0000","last_peered":"2024-05-10T09:57:14.662658+0000","last_clean":"2024-05-10T09:57:14.662658+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:57:14.662658+0000","last_undegraded":"2024-05-10T09:57:14.662658+0000","last_fullsized":"2024-05-10T09:57:14.662658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.069886+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:57:15.069886+0000","last_peered":"2024-05-10T09:57:15.069886+0000","last_clean":"2024-05-10T09:57:15.069886+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:57:15.069886+0000","last_undegraded":"2024-05-10T09:57:15.069886+0000","last_fullsized":"2024-05-10T09:57:15.069886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":36870,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613082+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:57:11.613082+0000","last_peered":"2024-05-10T09:57:11.613082+0000","last_clean":"2024-05-10T09:57:11.613082+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:57:11.613082+0000","last_undegraded":"2024-05-10T09:57:11.613082+0000","last_fullsized":"2024-05-10T09:57:11.613082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'16","reported_seq":202,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.146474+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:57:15.146474+0000","last_peered":"2024-05-10T09:57:15.146474+0000","last_clean":"2024-05-10T09:57:15.146474+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:57:15.146474+0000","last_undegraded":"2024-05-10T09:57:15.146474+0000","last_fullsized":"2024-05-10T09:57:15.146474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643012+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:57:14.643012+0000","last_peered":"2024-05-10T09:57:14.643012+0000","last_clean":"2024-05-10T09:57:14.643012+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:57:14.643012+0000","last_undegraded":"2024-05-10T09:57:14.643012+0000","last_fullsized":"2024-05-10T09:57:14.643012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.859631+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:57:14.859631+0000","last_peered":"2024-05-10T09:57:14.859631+0000","last_clean":"2024-05-10T09:57:14.859631+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:57:14.859631+0000","last_undegraded":"2024-05-10T09:57:14.859631+0000","last_fullsized":"2024-05-10T09:57:14.859631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614365+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:57:11.614365+0000","last_peered":"2024-05-10T09:57:11.614365+0000","last_clean":"2024-05-10T09:57:11.614365+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:57:11.614365+0000","last_undegraded":"2024-05-10T09:57:11.614365+0000","last_fullsized":"2024-05-10T09:57:11.614365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"79'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661113+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:57:14.661113+0000","last_peered":"2024-05-10T09:57:14.661113+0000","last_clean":"2024-05-10T09:57:14.661113+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:57:14.661113+0000","last_undegraded":"2024-05-10T09:57:14.661113+0000","last_fullsized":"2024-05-10T09:57:14.661113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":10,"num_read_kb":30722,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658372+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:57:14.658372+0000","last_peered":"2024-05-10T09:57:14.658372+0000","last_clean":"2024-05-10T09:57:14.658372+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:57:14.658372+0000","last_undegraded":"2024-05-10T09:57:14.658372+0000","last_fullsized":"2024-05-10T09:57:14.658372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'14","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.130769+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:57:15.130769+0000","last_peered":"2024-05-10T09:57:15.130769+0000","last_clean":"2024-05-10T09:57:15.130769+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:57:15.130769+0000","last_undegraded":"2024-05-10T09:57:15.130769+0000","last_fullsized":"2024-05-10T09:57:15.130769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":23,"num_read_kb":36880,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660691+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:57:14.660691+0000","last_peered":"2024-05-10T09:57:14.660691+0000","last_clean":"2024-05-10T09:57:14.660691+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:57:14.660691+0000","last_undegraded":"2024-05-10T09:57:14.660691+0000","last_fullsized":"2024-05-10T09:57:14.660691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'13","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.223039+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:57:15.223039+0000","last_peered":"2024-05-10T09:57:15.223039+0000","last_clean":"2024-05-10T09:57:15.223039+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:57:15.223039+0000","last_undegraded":"2024-05-10T09:57:15.223039+0000","last_fullsized":"2024-05-10T09:57:15.223039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":34834,"num_write":43,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644156+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:57:14.644156+0000","last_peered":"2024-05-10T09:57:14.644156+0000","last_clean":"2024-05-10T09:57:14.644156+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:57:14.644156+0000","last_undegraded":"2024-05-10T09:57:14.644156+0000","last_fullsized":"2024-05-10T09:57:14.644156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643442+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:57:14.643442+0000","last_peered":"2024-05-10T09:57:14.643442+0000","last_clean":"2024-05-10T09:57:14.643442+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:57:14.643442+0000","last_undegraded":"2024-05-10T09:57:14.643442+0000","last_fullsized":"2024-05-10T09:57:14.643442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657483+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:57:14.657483+0000","last_peered":"2024-05-10T09:57:14.657483+0000","last_clean":"2024-05-10T09:57:14.657483+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:57:14.657483+0000","last_undegraded":"2024-05-10T09:57:14.657483+0000","last_fullsized":"2024-05-10T09:57:14.657483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'14","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.974034+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:57:14.974034+0000","last_peered":"2024-05-10T09:57:14.974034+0000","last_clean":"2024-05-10T09:57:14.974034+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:57:14.974034+0000","last_undegraded":"2024-05-10T09:57:14.974034+0000","last_fullsized":"2024-05-10T09:57:14.974034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":36882,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'8","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669064+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:57:14.669064+0000","last_peered":"2024-05-10T09:57:14.669064+0000","last_clean":"2024-05-10T09:57:14.669064+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:57:14.669064+0000","last_undegraded":"2024-05-10T09:57:14.669064+0000","last_fullsized":"2024-05-10T09:57:14.669064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662569+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:57:14.662569+0000","last_peered":"2024-05-10T09:57:14.662569+0000","last_clean":"2024-05-10T09:57:14.662569+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:57:14.662569+0000","last_undegraded":"2024-05-10T09:57:14.662569+0000","last_fullsized":"2024-05-10T09:57:14.662569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'8","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980302+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:57:13.980302+0000","last_peered":"2024-05-10T09:57:13.980302+0000","last_clean":"2024-05-10T09:57:13.980302+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:57:13.980302+0000","last_undegraded":"2024-05-10T09:57:13.980302+0000","last_fullsized":"2024-05-10T09:57:13.980302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":24578,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670617+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:57:14.670617+0000","last_peered":"2024-05-10T09:57:14.670617+0000","last_clean":"2024-05-10T09:57:14.670617+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:57:14.670617+0000","last_undegraded":"2024-05-10T09:57:14.670617+0000","last_fullsized":"2024-05-10T09:57:14.670617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1081,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":198509,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":829,"num_read_kb":705,"num_write":559,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":185665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":520,"ondisk_log_size":520,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1345,"num_read_kb":996,"num_write":579,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":397,"ondisk_log_size":397,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1757413376,"num_objects":469,"num_object_clones":0,"num_object_copies":938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":469,"num_whiteouts":0,"num_read":995,"num_read_kb":2003484,"num_write":1731,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3598712832,"data_stored":3598712832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":631,"ondisk_log_size":631,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514160,"kb_used_data":482984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93857680,"statfs":{"total":96636764160,"available":96110264320,"internally_reserved":0,"allocated":494575616,"data_stored":494042106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380392,"kb_used_data":349208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93991448,"statfs":{"total":96636764160,"available":96247242752,"internally_reserved":0,"allocated":357588992,"data_stored":357108641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":620072,"kb_used_data":588888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93751768,"statfs":{"total":96636764160,"available":96001810432,"internally_reserved":0,"allocated":603021312,"data_stored":602491107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285570,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581648,"kb_used_data":549888,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":93790192,"statfs":{"total":96636764160,"available":96041156608,"internally_reserved":0,"allocated":563085312,"data_stored":562620723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":669276,"kb_used_data":633928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93702564,"statfs":{"total":96636764160,"available":95951425536,"internally_reserved":0,"allocated":649142272,"data_stored":648637245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337456,"kb_used_data":302108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94034384,"statfs":{"total":96636764160,"available":96291209216,"internally_reserved":0,"allocated":309358592,"data_stored":308888004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":632988,"kb_used_data":597652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93738852,"statfs":{"total":96636764160,"available":95988584448,"internally_reserved":0,"allocated":611995648,"data_stored":611482112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386592,"kb_used_data":351248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93985248,"statfs":{"total":96636764160,"available":96240893952,"internally_reserved":0,"allocated":359677952,"data_stored":359191327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":585105408,"data_stored":585105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":358612992,"data_stored":358612992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":241172480,"data_stored":241172480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":551550976,"data_stored":551550976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":591396864,"data_stored":591396864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":522190848,"data_stored":522190848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":301989888,"data_stored":301989888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":446693376,"data_stored":446693376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":27145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":6620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":15428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":41465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":11424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":34363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":17029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":32191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:57:16.530 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-10T09:57:16.530 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-10T09:57:16.530 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-10T09:57:16.531 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-10T09:57:16.531 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:16.531 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:16.545 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-10T09:57:16.657 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is set 2024-05-10T09:57:16.721 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:16.721 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:16.734 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-10T09:57:16.846 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:57:16.846 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "epoch": 91, 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "fsid": "7e1d9b5a-9708-485a-8c63-703e41c4a829", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "created": "2024-05-10T09:54:13.508887+0000", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "modified": "2024-05-10T09:57:16.650462+0000", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "last_up_change": "2024-05-10T09:57:08.584897+0000", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "last_in_change": "2024-05-10T09:54:15.752492+0000", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_num": 5806080, 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_set": [ 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "nodeep-scrub", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "noscrub", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "pglog_hardlimit", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "purged_snapdirs", 2024-05-10T09:57:16.847 INFO:teuthology.orchestra.run.smithi042.stdout: "recovery_deletes", 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "sortbitwise" 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_version": 6, 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "full_ratio": 0.94999998807907104, 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_snapshot": "", 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_max": 8, 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "max_osd": 8, 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "require_min_compat_client": "luminous", 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "min_compat_client": "luminous", 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "require_osd_release": "squid", 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "allow_crimson": false, 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: "pools": [ 2024-05-10T09:57:16.848 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 1, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": ".mgr", 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:26.214148+0000", 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:57:16.849 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 1, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 1, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 1, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 1, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 1, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:57:16.850 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "19", 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:57:16.851 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:57:16.852 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "options": { 2024-05-10T09:57:16.853 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_max": 32, 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_min": 1 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "mgr": {} 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 8, 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 8, 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 0.25, 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 2, 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 2, 2024-05-10T09:57:16.854 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 2, 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "rbd", 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:31.575111+0000", 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:57:16.855 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 8, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 8, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 8, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 8, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 8, 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:57:16.856 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "22", 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:57:16.857 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:57:16.858 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:57:16.859 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "rbd": {} 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.9900000095367432, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.9900000095367432, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 0.87999999523162842, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.75, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.75, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:57:16.860 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 3, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.buckets.data", 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:38.369592+0000", 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:57:16.861 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 64, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 64, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 64, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 64, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 64, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:57:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "25", 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:57:16.863 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:57:16.864 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:57:16.865 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.5, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.5, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.5, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.5, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.866 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 4, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.buckets.index", 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:39.953615+0000", 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:57:16.867 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 64, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 64, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 64, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 64, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 64, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "27", 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:57:16.868 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:57:16.869 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:57:16.870 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.871 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.8799999952316284, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.8799999952316284, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.8799999952316284, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.8799999952316284, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 5, 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": ".rgw.root", 2024-05-10T09:57:16.872 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:41.893433+0000", 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:57:16.873 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 32, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 32, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 32, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 32, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 32, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:57:16.874 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "29", 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:57:16.875 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:57:16.876 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:57:16.877 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.25, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.25, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.25, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.25, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 6, 2024-05-10T09:57:16.878 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.log", 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:43.804869+0000", 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 32, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 32, 2024-05-10T09:57:16.879 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 32, 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 32, 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 32, 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "31", 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:57:16.880 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:57:16.881 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:57:16.882 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:57:16.883 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.75, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.75, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.75, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.75, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.884 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 7, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.control", 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:45.696998+0000", 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:57:16.885 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 32, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 32, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 32, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 32, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 32, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:57:16.886 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "33", 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:57:16.887 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:57:16.888 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "options": {}, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.889 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.75, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.75, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.75, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.75, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "pool": 8, 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_name": "default.rgw.meta", 2024-05-10T09:57:16.890 INFO:teuthology.orchestra.run.smithi042.stdout: "create_time": "2024-05-10T09:54:47.845498+0000", 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "flags": 1, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "flags_names": "hashpspool", 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "type": 1, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "size": 2, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "min_size": 1, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_rule": 0, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_count": 0, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_target": 0, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_barrier": 0, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "object_hash": 2, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_mode": "off", 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num": 32, 2024-05-10T09:57:16.891 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num": 32, 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_placement_num_target": 32, 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_target": 32, 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_num_pending": 32, 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "last_pg_merge_meta": { 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "source_pgid": "0.0", 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "ready_epoch": 0, 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_started": 0, 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "last_epoch_clean": 0, 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "source_version": "0'0", 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "target_version": "0'0" 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "last_change": "35", 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend": "0", 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-10T09:57:16.892 INFO:teuthology.orchestra.run.smithi042.stdout: "last_force_op_resend_preluminous": "0", 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "auid": 0, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_mode": "selfmanaged", 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_seq": 0, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "snap_epoch": 0, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "pool_snaps": [], 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps": "[]", 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_bytes": 0, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "quota_max_objects": 0, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "tiers": [], 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "tier_of": -1, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "read_tier": -1, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "write_tier": -1, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_mode": "none", 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_bytes": 0, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "target_max_objects": 0, 2024-05-10T09:57:16.893 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_flush_age": 0, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "cache_min_evict_age": 0, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profile": "", 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_params": { 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "none" 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_period": 0, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_count": 0, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "use_gmt_hitset": true, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "min_read_recency_for_promote": 0, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "min_write_recency_for_promote": 0, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_grade_decay_rate": 0, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "hit_set_search_last_n": 0, 2024-05-10T09:57:16.894 INFO:teuthology.orchestra.run.smithi042.stdout: "grade_table": [], 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "stripe_width": 0, 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "expected_num_objects": 0, 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "fast_read": false, 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "options": { 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_autoscale_bias": 4 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "application_metadata": { 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "rgw": {} 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "read_balance": { 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "score_type": "Fair distribution", 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "score_acting": 1.5, 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "score_stable": 1.5, 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "optimal_score": 1, 2024-05-10T09:57:16.895 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_acting": 1.5, 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "raw_score_stable": 1.5, 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity_weighted": 1, 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity": 1, 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "average_primary_affinity_weighted": 1 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "osds": [ 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 0, 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "897c58ab-70e9-4a8d-b51f-cf9dc6cedd29", 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:57:16.896 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 83, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6800", 2024-05-10T09:57:16.897 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6801", 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6802", 2024-05-10T09:57:16.898 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6803", 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6806", 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:57:16.899 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6807", 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6804", 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.900 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6805", 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3913515164 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.42:6801/3913515164", 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.42:6803/3913515164", 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.42:6807/3913515164", 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.42:6805/3913515164", 2024-05-10T09:57:16.901 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:57:16.902 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:57:16.902 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:57:16.902 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.902 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.902 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.902 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 1, 2024-05-10T09:57:16.902 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "fc75a63e-e69c-4efb-89cb-b599f6ded234", 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 14, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 83, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.903 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6809", 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6811", 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6813", 2024-05-10T09:57:16.904 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6815", 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6821", 2024-05-10T09:57:16.905 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6823", 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6817", 2024-05-10T09:57:16.906 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6819", 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2743871003 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.42:6811/2743871003", 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.42:6815/2743871003", 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.42:6823/2743871003", 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.42:6819/2743871003", 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:57:16.907 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 2, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "18889f8e-3a4e-4ea7-b9b6-af9547e84e85", 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 83, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:57:16.908 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6808", 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6810", 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.909 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6812", 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6814", 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:57:16.910 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6820", 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6822", 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6816", 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6818", 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3683869396 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.42:6810/3683869396", 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.42:6814/3683869396", 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.42:6822/3683869396", 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.42:6818/3683869396", 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:57:16.912 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 3, 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "a2720077-7595-48e4-9f86-60cd449b0d90", 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:57:16.913 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 83, 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6824", 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.914 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6825", 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6826", 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.915 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6827", 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6830", 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.916 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6831", 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6828", 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.42:6829", 2024-05-10T09:57:16.917 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 125865404 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.42:6825/125865404", 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.42:6827/125865404", 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.42:6831/125865404", 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.42:6829/125865404", 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.918 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 4, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "c271ae7d-8d4d-46a6-9273-8a52de33dd30", 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 15, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 69, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 83, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 83, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 70, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.919 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6823", 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3297710412 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6825", 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3297710412 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.920 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6826", 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3297710412 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6827", 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3297710412 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.921 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6830", 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3297710412 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6831", 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3297710412 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.922 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6828", 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3297710412 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6829", 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3297710412 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.181:6825/3297710412", 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.181:6827/3297710412", 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.181:6831/3297710412", 2024-05-10T09:57:16.923 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.181:6829/3297710412", 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 5, 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b", 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:57:16.924 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 83, 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6809", 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6812", 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:57:16.925 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6814", 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6816", 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.926 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6822", 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6824", 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.927 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6819", 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6821", 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 893112190 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.928 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.181:6812/893112190", 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.181:6816/893112190", 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.181:6824/893112190", 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.181:6821/893112190", 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 6, 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "6fa08610-ff9d-41d0-af8a-06d46f3388d7", 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:57:16.929 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 83, 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6800", 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:57:16.930 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6802", 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6804", 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:57:16.931 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6807", 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6817", 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.932 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6820", 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6810", 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.933 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6813", 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 1622048387 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.181:6802/1622048387", 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.181:6807/1622048387", 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.181:6820/1622048387", 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.181:6813/1622048387", 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.934 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 7, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "uuid": "86869483-0d84-4d13-b78e-3bac8ac2ff03", 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "up": 1, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "in": 1, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "weight": 1, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_affinity": 1, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_begin": 0, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "last_clean_end": 0, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "up_from": 15, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "up_thru": 83, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "down_at": 0, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "lost_at": 0, 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addrs": { 2024-05-10T09:57:16.935 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6801", 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6803", 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addrs": { 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6805", 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6806", 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addrs": { 2024-05-10T09:57:16.937 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6815", 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6818", 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addrs": { 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: "addrvec": [ 2024-05-10T09:57:16.938 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v2", 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6808", 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "172.21.15.181:6811", 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 3508953868 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "public_addr": "172.21.15.181:6803/3508953868", 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_addr": "172.21.15.181:6806/3508953868", 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_back_addr": "172.21.15.181:6818/3508953868", 2024-05-10T09:57:16.939 INFO:teuthology.orchestra.run.smithi042.stdout: "heartbeat_front_addr": "172.21.15.181:6811/3508953868", 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "state": [ 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "exists", 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "up" 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_xinfo": [ 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 0, 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:57:16.940 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.309797+0000", 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 1, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:20.776872+0000", 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 2, 2024-05-10T09:57:16.941 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.163014+0000", 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 3, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:57:16.942 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.344100+0000", 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 4, 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.292805+0000", 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 70 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.943 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 5, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.412990+0000", 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 6, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:57:16.944 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.456741+0000", 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "osd": 7, 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "down_stamp": "0.000000", 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_probability": 0, 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "laggy_interval": 0, 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "features": 4540701547738038271, 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "old_weight": 0, 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "last_purged_snaps_scrub": "2024-05-10T09:54:21.437150+0000", 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "dead_epoch": 0 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_upmap": [ 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.945 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "4.1b", 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: "osds": [ 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: 1, 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: 5 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_upmap_items": [ 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "3.19", 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 3, 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.946 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "3.21", 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 5, 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 1 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "3.36", 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:57:16.947 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 5, 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "3.39", 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 7, 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.948 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "4.9", 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 1, 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 5 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "4.21", 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 3, 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.949 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: "pgid": "4.3e", 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: "mappings": [ 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: "from": 1, 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: "to": 2 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: ], 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_upmap_primaries": [], 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: "pg_temp": [], 2024-05-10T09:57:16.950 INFO:teuthology.orchestra.run.smithi042.stdout: "primary_temp": [], 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "blocklist": {}, 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "range_blocklist": {}, 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "erasure_code_profiles": { 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "default": { 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "crush-failure-domain": "osd", 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "k": "2", 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "m": "1", 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "plugin": "jerasure", 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "technique": "reed_sol_van" 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "removed_snaps_queue": [], 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "new_removed_snaps": [], 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "new_purged_snaps": [], 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "crush_node_flags": {}, 2024-05-10T09:57:16.951 INFO:teuthology.orchestra.run.smithi042.stdout: "device_class_flags": {}, 2024-05-10T09:57:16.952 INFO:teuthology.orchestra.run.smithi042.stdout: "stretch_mode": { 2024-05-10T09:57:16.952 INFO:teuthology.orchestra.run.smithi042.stdout: "stretch_mode_enabled": false, 2024-05-10T09:57:16.952 INFO:teuthology.orchestra.run.smithi042.stdout: "stretch_bucket_count": 0, 2024-05-10T09:57:16.952 INFO:teuthology.orchestra.run.smithi042.stdout: "degraded_stretch_mode": 0, 2024-05-10T09:57:16.952 INFO:teuthology.orchestra.run.smithi042.stdout: "recovering_stretch_mode": 0, 2024-05-10T09:57:16.952 INFO:teuthology.orchestra.run.smithi042.stdout: "stretch_mode_bucket": 0 2024-05-10T09:57:16.952 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-05-10T09:57:16.952 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:57:16.954 INFO:tasks.thrashosds.thrasher:j is {'epoch': 91, 'fsid': '7e1d9b5a-9708-485a-8c63-703e41c4a829', 'created': '2024-05-10T09:54:13.508887+0000', 'modified': '2024-05-10T09:57:16.650462+0000', 'last_up_change': '2024-05-10T09:57:08.584897+0000', 'last_in_change': '2024-05-10T09:54:15.752492+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T09:54:26.214148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-10T09:54:31.575111+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-05-10T09:54:38.369592+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-05-10T09:54:39.953615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-05-10T09:54:41.893433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-05-10T09:54:43.804869+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-05-10T09:54:45.696998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-05-10T09:54:47.845498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '897c58ab-70e9-4a8d-b51f-cf9dc6cedd29', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6800', 'nonce': 3913515164}, {'type': 'v1', 'addr': '172.21.15.42:6801', 'nonce': 3913515164}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6802', 'nonce': 3913515164}, {'type': 'v1', 'addr': '172.21.15.42:6803', 'nonce': 3913515164}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6806', 'nonce': 3913515164}, {'type': 'v1', 'addr': '172.21.15.42:6807', 'nonce': 3913515164}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6804', 'nonce': 3913515164}, {'type': 'v1', 'addr': '172.21.15.42:6805', 'nonce': 3913515164}]}, 'public_addr': '172.21.15.42:6801/3913515164', 'cluster_addr': '172.21.15.42:6803/3913515164', 'heartbeat_back_addr': '172.21.15.42:6807/3913515164', 'heartbeat_front_addr': '172.21.15.42:6805/3913515164', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'fc75a63e-e69c-4efb-89cb-b599f6ded234', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6809', 'nonce': 2743871003}, {'type': 'v1', 'addr': '172.21.15.42:6811', 'nonce': 2743871003}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6813', 'nonce': 2743871003}, {'type': 'v1', 'addr': '172.21.15.42:6815', 'nonce': 2743871003}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6821', 'nonce': 2743871003}, {'type': 'v1', 'addr': '172.21.15.42:6823', 'nonce': 2743871003}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6817', 'nonce': 2743871003}, {'type': 'v1', 'addr': '172.21.15.42:6819', 'nonce': 2743871003}]}, 'public_addr': '172.21.15.42:6811/2743871003', 'cluster_addr': '172.21.15.42:6815/2743871003', 'heartbeat_back_addr': '172.21.15.42:6823/2743871003', 'heartbeat_front_addr': '172.21.15.42:6819/2743871003', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '18889f8e-3a4e-4ea7-b9b6-af9547e84e85', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6808', 'nonce': 3683869396}, {'type': 'v1', 'addr': '172.21.15.42:6810', 'nonce': 3683869396}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6812', 'nonce': 3683869396}, {'type': 'v1', 'addr': '172.21.15.42:6814', 'nonce': 3683869396}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6820', 'nonce': 3683869396}, {'type': 'v1', 'addr': '172.21.15.42:6822', 'nonce': 3683869396}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6816', 'nonce': 3683869396}, {'type': 'v1', 'addr': '172.21.15.42:6818', 'nonce': 3683869396}]}, 'public_addr': '172.21.15.42:6810/3683869396', 'cluster_addr': '172.21.15.42:6814/3683869396', 'heartbeat_back_addr': '172.21.15.42:6822/3683869396', 'heartbeat_front_addr': '172.21.15.42:6818/3683869396', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'a2720077-7595-48e4-9f86-60cd449b0d90', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6824', 'nonce': 125865404}, {'type': 'v1', 'addr': '172.21.15.42:6825', 'nonce': 125865404}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6826', 'nonce': 125865404}, {'type': 'v1', 'addr': '172.21.15.42:6827', 'nonce': 125865404}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6830', 'nonce': 125865404}, {'type': 'v1', 'addr': '172.21.15.42:6831', 'nonce': 125865404}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6828', 'nonce': 125865404}, {'type': 'v1', 'addr': '172.21.15.42:6829', 'nonce': 125865404}]}, 'public_addr': '172.21.15.42:6825/125865404', 'cluster_addr': '172.21.15.42:6827/125865404', 'heartbeat_back_addr': '172.21.15.42:6831/125865404', 'heartbeat_front_addr': '172.21.15.42:6829/125865404', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c271ae7d-8d4d-46a6-9273-8a52de33dd30', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 15, 'last_clean_end': 69, 'up_from': 83, 'up_thru': 83, 'down_at': 70, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6823', 'nonce': 3297710412}, {'type': 'v1', 'addr': '172.21.15.181:6825', 'nonce': 3297710412}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6826', 'nonce': 3297710412}, {'type': 'v1', 'addr': '172.21.15.181:6827', 'nonce': 3297710412}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6830', 'nonce': 3297710412}, {'type': 'v1', 'addr': '172.21.15.181:6831', 'nonce': 3297710412}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6828', 'nonce': 3297710412}, {'type': 'v1', 'addr': '172.21.15.181:6829', 'nonce': 3297710412}]}, 'public_addr': '172.21.15.181:6825/3297710412', 'cluster_addr': '172.21.15.181:6827/3297710412', 'heartbeat_back_addr': '172.21.15.181:6831/3297710412', 'heartbeat_front_addr': '172.21.15.181:6829/3297710412', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6809', 'nonce': 893112190}, {'type': 'v1', 'addr': '172.21.15.181:6812', 'nonce': 893112190}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6814', 'nonce': 893112190}, {'type': 'v1', 'addr': '172.21.15.181:6816', 'nonce': 893112190}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6822', 'nonce': 893112190}, {'type': 'v1', 'addr': '172.21.15.181:6824', 'nonce': 893112190}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6819', 'nonce': 893112190}, {'type': 'v1', 'addr': '172.21.15.181:6821', 'nonce': 893112190}]}, 'public_addr': '172.21.15.181:6812/893112190', 'cluster_addr': '172.21.15.181:6816/893112190', 'heartbeat_back_addr': '172.21.15.181:6824/893112190', 'heartbeat_front_addr': '172.21.15.181:6821/893112190', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6fa08610-ff9d-41d0-af8a-06d46f3388d7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6800', 'nonce': 1622048387}, {'type': 'v1', 'addr': '172.21.15.181:6802', 'nonce': 1622048387}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6804', 'nonce': 1622048387}, {'type': 'v1', 'addr': '172.21.15.181:6807', 'nonce': 1622048387}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6817', 'nonce': 1622048387}, {'type': 'v1', 'addr': '172.21.15.181:6820', 'nonce': 1622048387}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6810', 'nonce': 1622048387}, {'type': 'v1', 'addr': '172.21.15.181:6813', 'nonce': 1622048387}]}, 'public_addr': '172.21.15.181:6802/1622048387', 'cluster_addr': '172.21.15.181:6807/1622048387', 'heartbeat_back_addr': '172.21.15.181:6820/1622048387', 'heartbeat_front_addr': '172.21.15.181:6813/1622048387', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '86869483-0d84-4d13-b78e-3bac8ac2ff03', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 83, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6801', 'nonce': 3508953868}, {'type': 'v1', 'addr': '172.21.15.181:6803', 'nonce': 3508953868}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6805', 'nonce': 3508953868}, {'type': 'v1', 'addr': '172.21.15.181:6806', 'nonce': 3508953868}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6815', 'nonce': 3508953868}, {'type': 'v1', 'addr': '172.21.15.181:6818', 'nonce': 3508953868}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6808', 'nonce': 3508953868}, {'type': 'v1', 'addr': '172.21.15.181:6811', 'nonce': 3508953868}]}, 'public_addr': '172.21.15.181:6803/3508953868', 'cluster_addr': '172.21.15.181:6806/3508953868', 'heartbeat_back_addr': '172.21.15.181:6818/3508953868', 'heartbeat_front_addr': '172.21.15.181:6811/3508953868', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.309797+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:20.776872+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.163014+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.344100+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.292805+0000', 'dead_epoch': 70}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.412990+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.456741+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-10T09:54:21.437150+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.1b', 'osds': [1, 5]}], 'pg_upmap_items': [{'pgid': '3.19', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.21', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.36', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.39', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.9', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.21', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.3e', 'mappings': [{'from': 1, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-10T09:57:16.954 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:57:16.955 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:16.955 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:16.956 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-10T09:57:17.119 INFO:teuthology.orchestra.run.smithi042.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:17.119 INFO:teuthology.orchestra.run.smithi042.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:17.132 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-10T09:57:17.263 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:17.263 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:17.277 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-10T09:57:17.321 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:57:17.329 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:57:17.343 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-05-10T09:57:16.661462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1758204947,"num_objects":682,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":682,"num_whiteouts":0,"num_read":3307,"num_read_kb":2005310,"num_write":3012,"num_write_kb":2050163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1749,"ondisk_log_size":1749,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4122584,"kb_used_data":3855904,"kb_used_omap":16,"kb_used_meta":266543,"kb_avail":750852136,"statfs":{"total":773094113280,"available":768872587264,"internally_reserved":0,"allocated":3948445696,"data_stored":3944461265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":272940302},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-297692676,"num_objects":-71,"num_object_clones":0,"num_object_copies":-142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-133,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-71,"num_whiteouts":0,"num_read":854,"num_read_kb":129914,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":383790261,"num_keys_recovered":37,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.042097"},"pg_stats":[{"pgid":"3.3f","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.214635+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:57:15.214635+0000","last_peered":"2024-05-10T09:57:15.214635+0000","last_clean":"2024-05-10T09:57:15.214635+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:57:15.214635+0000","last_undegraded":"2024-05-10T09:57:15.214635+0000","last_fullsized":"2024-05-10T09:57:15.214635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668907+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:57:14.668907+0000","last_peered":"2024-05-10T09:57:14.668907+0000","last_clean":"2024-05-10T09:57:14.668907+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:57:14.668907+0000","last_undegraded":"2024-05-10T09:57:14.668907+0000","last_fullsized":"2024-05-10T09:57:14.668907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"77'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980308+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:57:13.980308+0000","last_peered":"2024-05-10T09:57:13.980308+0000","last_clean":"2024-05-10T09:57:13.980308+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:57:13.980308+0000","last_undegraded":"2024-05-10T09:57:13.980308+0000","last_fullsized":"2024-05-10T09:57:13.980308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":10,"num_read_kb":30722,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'31","reported_seq":172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.846819+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:57:14.846819+0000","last_peered":"2024-05-10T09:57:14.846819+0000","last_clean":"2024-05-10T09:57:14.846819+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:57:14.846819+0000","last_undegraded":"2024-05-10T09:57:14.846819+0000","last_fullsized":"2024-05-10T09:57:14.846819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":78,"num_write":45,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.912004+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:57:14.912004+0000","last_peered":"2024-05-10T09:57:14.912004+0000","last_clean":"2024-05-10T09:57:14.912004+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:57:14.912004+0000","last_undegraded":"2024-05-10T09:57:14.912004+0000","last_fullsized":"2024-05-10T09:57:14.912004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":28686,"num_write":39,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612166+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:57:11.612166+0000","last_peered":"2024-05-10T09:57:11.612166+0000","last_clean":"2024-05-10T09:57:11.612166+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:57:11.612166+0000","last_undegraded":"2024-05-10T09:57:11.612166+0000","last_fullsized":"2024-05-10T09:57:11.612166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'11","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.076606+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:57:15.076606+0000","last_peered":"2024-05-10T09:57:15.076606+0000","last_clean":"2024-05-10T09:57:15.076606+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:57:15.076606+0000","last_undegraded":"2024-05-10T09:57:15.076606+0000","last_fullsized":"2024-05-10T09:57:15.076606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":32788,"num_write":51,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660993+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:57:14.660993+0000","last_peered":"2024-05-10T09:57:14.660993+0000","last_clean":"2024-05-10T09:57:14.660993+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:57:14.660993+0000","last_undegraded":"2024-05-10T09:57:14.660993+0000","last_fullsized":"2024-05-10T09:57:14.660993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'16","reported_seq":173,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.188502+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:57:15.188502+0000","last_peered":"2024-05-10T09:57:15.188502+0000","last_clean":"2024-05-10T09:57:15.188502+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:57:15.188502+0000","last_undegraded":"2024-05-10T09:57:15.188502+0000","last_fullsized":"2024-05-10T09:57:15.188502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":43032,"num_write":56,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663763+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:57:14.663763+0000","last_peered":"2024-05-10T09:57:14.663763+0000","last_clean":"2024-05-10T09:57:14.663763+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:57:14.663763+0000","last_undegraded":"2024-05-10T09:57:14.663763+0000","last_fullsized":"2024-05-10T09:57:14.663763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.235284+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:57:15.235284+0000","last_peered":"2024-05-10T09:57:15.235284+0000","last_clean":"2024-05-10T09:57:15.235284+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:57:15.235284+0000","last_undegraded":"2024-05-10T09:57:15.235284+0000","last_fullsized":"2024-05-10T09:57:15.235284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":16,"num_read_kb":36872,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":118,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613205+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:57:11.613205+0000","last_peered":"2024-05-10T09:57:11.613205+0000","last_clean":"2024-05-10T09:57:11.613205+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:57:11.613205+0000","last_undegraded":"2024-05-10T09:57:11.613205+0000","last_fullsized":"2024-05-10T09:57:11.613205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'6","reported_seq":114,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.179409+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:57:15.179409+0000","last_peered":"2024-05-10T09:57:15.179409+0000","last_clean":"2024-05-10T09:57:15.179409+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:57:15.179409+0000","last_undegraded":"2024-05-10T09:57:15.179409+0000","last_fullsized":"2024-05-10T09:57:15.179409+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670553+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:57:14.670553+0000","last_peered":"2024-05-10T09:57:14.670553+0000","last_clean":"2024-05-10T09:57:14.670553+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:57:14.670553+0000","last_undegraded":"2024-05-10T09:57:14.670553+0000","last_fullsized":"2024-05-10T09:57:14.670553+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"78'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644172+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:57:14.644172+0000","last_peered":"2024-05-10T09:57:14.644172+0000","last_clean":"2024-05-10T09:57:14.644172+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:57:14.644172+0000","last_undegraded":"2024-05-10T09:57:14.644172+0000","last_fullsized":"2024-05-10T09:57:14.644172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643301+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:57:14.643301+0000","last_peered":"2024-05-10T09:57:14.643301+0000","last_clean":"2024-05-10T09:57:14.643301+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:57:14.643301+0000","last_undegraded":"2024-05-10T09:57:14.643301+0000","last_fullsized":"2024-05-10T09:57:14.643301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611220+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:57:11.611220+0000","last_peered":"2024-05-10T09:57:11.611220+0000","last_clean":"2024-05-10T09:57:11.611220+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:57:11.611220+0000","last_undegraded":"2024-05-10T09:57:11.611220+0000","last_fullsized":"2024-05-10T09:57:11.611220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'7","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.725154+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:57:14.725154+0000","last_peered":"2024-05-10T09:57:14.725154+0000","last_clean":"2024-05-10T09:57:14.725154+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:57:14.725154+0000","last_undegraded":"2024-05-10T09:57:14.725154+0000","last_fullsized":"2024-05-10T09:57:14.725154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":22536,"num_write":27,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658205+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:57:14.658205+0000","last_peered":"2024-05-10T09:57:14.658205+0000","last_clean":"2024-05-10T09:57:14.658205+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:57:14.658205+0000","last_undegraded":"2024-05-10T09:57:14.658205+0000","last_fullsized":"2024-05-10T09:57:14.658205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'7","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.871393+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:57:14.871393+0000","last_peered":"2024-05-10T09:57:14.871393+0000","last_clean":"2024-05-10T09:57:14.871393+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:57:14.871393+0000","last_undegraded":"2024-05-10T09:57:14.871393+0000","last_fullsized":"2024-05-10T09:57:14.871393+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'33","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.749562+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:57:14.749562+0000","last_peered":"2024-05-10T09:57:14.749562+0000","last_clean":"2024-05-10T09:57:14.749562+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:57:14.749562+0000","last_undegraded":"2024-05-10T09:57:14.749562+0000","last_fullsized":"2024-05-10T09:57:14.749562+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":84,"num_write":49,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"79'5","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664024+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:57:14.664024+0000","last_peered":"2024-05-10T09:57:14.664024+0000","last_clean":"2024-05-10T09:57:14.664024+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:57:14.664024+0000","last_undegraded":"2024-05-10T09:57:14.664024+0000","last_fullsized":"2024-05-10T09:57:14.664024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642792+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:57:14.642792+0000","last_peered":"2024-05-10T09:57:14.642792+0000","last_clean":"2024-05-10T09:57:14.642792+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:57:14.642792+0000","last_undegraded":"2024-05-10T09:57:14.642792+0000","last_fullsized":"2024-05-10T09:57:14.642792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"78'18","reported_seq":148,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614041+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:57:11.614041+0000","last_peered":"2024-05-10T09:57:11.614041+0000","last_clean":"2024-05-10T09:57:11.614041+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:57:11.614041+0000","last_undegraded":"2024-05-10T09:57:11.614041+0000","last_fullsized":"2024-05-10T09:57:11.614041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":61448,"num_write":38,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"79'19","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642980+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:57:14.642980+0000","last_peered":"2024-05-10T09:57:14.642980+0000","last_clean":"2024-05-10T09:57:14.642980+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:57:14.642980+0000","last_undegraded":"2024-05-10T09:57:14.642980+0000","last_fullsized":"2024-05-10T09:57:14.642980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:28.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":65,"num_read_kb":49,"num_write":28,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.898427+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:57:14.898427+0000","last_peered":"2024-05-10T09:57:14.898427+0000","last_clean":"2024-05-10T09:57:14.898427+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:57:14.898427+0000","last_undegraded":"2024-05-10T09:57:14.898427+0000","last_fullsized":"2024-05-10T09:57:14.898427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612837+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:57:11.612837+0000","last_peered":"2024-05-10T09:57:11.612837+0000","last_clean":"2024-05-10T09:57:11.612837+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:57:11.612837+0000","last_undegraded":"2024-05-10T09:57:11.612837+0000","last_fullsized":"2024-05-10T09:57:11.612837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"79'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660931+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:57:14.660931+0000","last_peered":"2024-05-10T09:57:14.660931+0000","last_clean":"2024-05-10T09:57:14.660931+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:57:14.660931+0000","last_undegraded":"2024-05-10T09:57:14.660931+0000","last_fullsized":"2024-05-10T09:57:14.660931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611728+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:57:11.611728+0000","last_peered":"2024-05-10T09:57:11.611728+0000","last_clean":"2024-05-10T09:57:11.611728+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:57:11.611728+0000","last_undegraded":"2024-05-10T09:57:11.611728+0000","last_fullsized":"2024-05-10T09:57:11.611728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645981+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:57:14.645981+0000","last_peered":"2024-05-10T09:57:14.645981+0000","last_clean":"2024-05-10T09:57:14.645981+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:57:14.645981+0000","last_undegraded":"2024-05-10T09:57:14.645981+0000","last_fullsized":"2024-05-10T09:57:14.645981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'10","reported_seq":186,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.203343+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:57:15.203343+0000","last_peered":"2024-05-10T09:57:15.203343+0000","last_clean":"2024-05-10T09:57:15.203343+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:57:15.203343+0000","last_undegraded":"2024-05-10T09:57:15.203343+0000","last_fullsized":"2024-05-10T09:57:15.203343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":18442,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670164+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:57:14.670164+0000","last_peered":"2024-05-10T09:57:14.670164+0000","last_clean":"2024-05-10T09:57:14.670164+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:57:14.670164+0000","last_undegraded":"2024-05-10T09:57:14.670164+0000","last_fullsized":"2024-05-10T09:57:14.670164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"89'14","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.880793+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:57:14.880793+0000","last_peered":"2024-05-10T09:57:14.880793+0000","last_clean":"2024-05-10T09:57:14.880793+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:57:14.880793+0000","last_undegraded":"2024-05-10T09:57:14.880793+0000","last_fullsized":"2024-05-10T09:57:14.880793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659360+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:57:14.659360+0000","last_peered":"2024-05-10T09:57:14.659360+0000","last_clean":"2024-05-10T09:57:14.659360+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:57:14.659360+0000","last_undegraded":"2024-05-10T09:57:14.659360+0000","last_fullsized":"2024-05-10T09:57:14.659360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669023+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:57:14.669023+0000","last_peered":"2024-05-10T09:57:14.669023+0000","last_clean":"2024-05-10T09:57:14.669023+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:57:14.669023+0000","last_undegraded":"2024-05-10T09:57:14.669023+0000","last_fullsized":"2024-05-10T09:57:14.669023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670472+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:57:14.670472+0000","last_peered":"2024-05-10T09:57:14.670472+0000","last_clean":"2024-05-10T09:57:14.670472+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:57:14.670472+0000","last_undegraded":"2024-05-10T09:57:14.670472+0000","last_fullsized":"2024-05-10T09:57:14.670472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'11","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.966513+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:57:14.966513+0000","last_peered":"2024-05-10T09:57:14.966513+0000","last_clean":"2024-05-10T09:57:14.966513+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:57:14.966513+0000","last_undegraded":"2024-05-10T09:57:14.966513+0000","last_fullsized":"2024-05-10T09:57:14.966513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645820+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:57:14.645820+0000","last_peered":"2024-05-10T09:57:14.645820+0000","last_clean":"2024-05-10T09:57:14.645820+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:57:14.645820+0000","last_undegraded":"2024-05-10T09:57:14.645820+0000","last_fullsized":"2024-05-10T09:57:14.645820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613295+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:57:11.613295+0000","last_peered":"2024-05-10T09:57:11.613295+0000","last_clean":"2024-05-10T09:57:11.613295+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:57:11.613295+0000","last_undegraded":"2024-05-10T09:57:11.613295+0000","last_fullsized":"2024-05-10T09:57:11.613295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614538+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:57:11.614538+0000","last_peered":"2024-05-10T09:57:11.614538+0000","last_clean":"2024-05-10T09:57:11.614538+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:57:11.614538+0000","last_undegraded":"2024-05-10T09:57:11.614538+0000","last_fullsized":"2024-05-10T09:57:11.614538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660749+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:57:14.660749+0000","last_peered":"2024-05-10T09:57:14.660749+0000","last_clean":"2024-05-10T09:57:14.660749+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:57:14.660749+0000","last_undegraded":"2024-05-10T09:57:14.660749+0000","last_fullsized":"2024-05-10T09:57:14.660749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662055+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:57:14.662055+0000","last_peered":"2024-05-10T09:57:14.662055+0000","last_clean":"2024-05-10T09:57:14.662055+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:57:14.662055+0000","last_undegraded":"2024-05-10T09:57:14.662055+0000","last_fullsized":"2024-05-10T09:57:14.662055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'13","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.031023+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:57:15.031023+0000","last_peered":"2024-05-10T09:57:15.031023+0000","last_clean":"2024-05-10T09:57:15.031023+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:57:15.031023+0000","last_undegraded":"2024-05-10T09:57:15.031023+0000","last_fullsized":"2024-05-10T09:57:15.031023+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646795+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:57:14.646795+0000","last_peered":"2024-05-10T09:57:14.646795+0000","last_clean":"2024-05-10T09:57:14.646795+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:57:14.646795+0000","last_undegraded":"2024-05-10T09:57:14.646795+0000","last_fullsized":"2024-05-10T09:57:14.646795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642811+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:57:14.642811+0000","last_peered":"2024-05-10T09:57:14.642811+0000","last_clean":"2024-05-10T09:57:14.642811+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:57:14.642811+0000","last_undegraded":"2024-05-10T09:57:14.642811+0000","last_fullsized":"2024-05-10T09:57:14.642811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:28.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"88'13","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658261+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:57:14.658261+0000","last_peered":"2024-05-10T09:57:14.658261+0000","last_clean":"2024-05-10T09:57:14.658261+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:57:14.658261+0000","last_undegraded":"2024-05-10T09:57:14.658261+0000","last_fullsized":"2024-05-10T09:57:14.658261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612651+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:57:11.612651+0000","last_peered":"2024-05-10T09:57:11.612651+0000","last_clean":"2024-05-10T09:57:11.612651+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:57:11.612651+0000","last_undegraded":"2024-05-10T09:57:11.612651+0000","last_fullsized":"2024-05-10T09:57:11.612651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646130+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:57:14.646130+0000","last_peered":"2024-05-10T09:57:14.646130+0000","last_clean":"2024-05-10T09:57:14.646130+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:57:14.646130+0000","last_undegraded":"2024-05-10T09:57:14.646130+0000","last_fullsized":"2024-05-10T09:57:14.646130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.828622+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:57:14.828622+0000","last_peered":"2024-05-10T09:57:14.828622+0000","last_clean":"2024-05-10T09:57:14.828622+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:57:14.828622+0000","last_undegraded":"2024-05-10T09:57:14.828622+0000","last_fullsized":"2024-05-10T09:57:14.828622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670406+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:57:14.670406+0000","last_peered":"2024-05-10T09:57:14.670406+0000","last_clean":"2024-05-10T09:57:14.670406+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:57:14.670406+0000","last_undegraded":"2024-05-10T09:57:14.670406+0000","last_fullsized":"2024-05-10T09:57:14.670406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.946203+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:57:14.946203+0000","last_peered":"2024-05-10T09:57:14.946203+0000","last_clean":"2024-05-10T09:57:14.946203+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:57:14.946203+0000","last_undegraded":"2024-05-10T09:57:14.946203+0000","last_fullsized":"2024-05-10T09:57:14.946203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645117+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:57:14.645117+0000","last_peered":"2024-05-10T09:57:14.645117+0000","last_clean":"2024-05-10T09:57:14.645117+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:57:14.645117+0000","last_undegraded":"2024-05-10T09:57:14.645117+0000","last_fullsized":"2024-05-10T09:57:14.645117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669027+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:57:14.669027+0000","last_peered":"2024-05-10T09:57:14.669027+0000","last_clean":"2024-05-10T09:57:14.669027+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:57:14.669027+0000","last_undegraded":"2024-05-10T09:57:14.669027+0000","last_fullsized":"2024-05-10T09:57:14.669027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'7","reported_seq":176,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.055149+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:57:15.055149+0000","last_peered":"2024-05-10T09:57:15.055149+0000","last_clean":"2024-05-10T09:57:15.055149+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:57:15.055149+0000","last_undegraded":"2024-05-10T09:57:15.055149+0000","last_fullsized":"2024-05-10T09:57:15.055149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":18440,"num_write":27,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657400+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:57:14.657400+0000","last_peered":"2024-05-10T09:57:14.657400+0000","last_clean":"2024-05-10T09:57:14.657400+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:57:14.657400+0000","last_undegraded":"2024-05-10T09:57:14.657400+0000","last_fullsized":"2024-05-10T09:57:14.657400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"89'23","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.736581+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:57:14.736581+0000","last_peered":"2024-05-10T09:57:14.736581+0000","last_clean":"2024-05-10T09:57:14.736581+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:57:14.736581+0000","last_undegraded":"2024-05-10T09:57:14.736581+0000","last_fullsized":"2024-05-10T09:57:14.736581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980750+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:57:13.980750+0000","last_peered":"2024-05-10T09:57:13.980750+0000","last_clean":"2024-05-10T09:57:13.980750+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:57:13.980750+0000","last_undegraded":"2024-05-10T09:57:13.980750+0000","last_fullsized":"2024-05-10T09:57:13.980750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":127,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669713+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:57:14.669713+0000","last_peered":"2024-05-10T09:57:14.669713+0000","last_clean":"2024-05-10T09:57:14.669713+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:57:14.669713+0000","last_undegraded":"2024-05-10T09:57:14.669713+0000","last_fullsized":"2024-05-10T09:57:14.669713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":120,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611357+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:57:11.611357+0000","last_peered":"2024-05-10T09:57:11.611357+0000","last_clean":"2024-05-10T09:57:11.611357+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:57:11.611357+0000","last_undegraded":"2024-05-10T09:57:11.611357+0000","last_fullsized":"2024-05-10T09:57:11.611357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'13","reported_seq":193,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.894085+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:57:14.894085+0000","last_peered":"2024-05-10T09:57:14.894085+0000","last_clean":"2024-05-10T09:57:14.894085+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:57:14.894085+0000","last_undegraded":"2024-05-10T09:57:14.894085+0000","last_fullsized":"2024-05-10T09:57:14.894085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642617+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:57:14.642617+0000","last_peered":"2024-05-10T09:57:14.642617+0000","last_clean":"2024-05-10T09:57:14.642617+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:57:14.642617+0000","last_undegraded":"2024-05-10T09:57:14.642617+0000","last_fullsized":"2024-05-10T09:57:14.642617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.746019+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:57:14.746019+0000","last_peered":"2024-05-10T09:57:14.746019+0000","last_clean":"2024-05-10T09:57:14.746019+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:57:14.746019+0000","last_undegraded":"2024-05-10T09:57:14.746019+0000","last_fullsized":"2024-05-10T09:57:14.746019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644410+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:57:14.644410+0000","last_peered":"2024-05-10T09:57:14.644410+0000","last_clean":"2024-05-10T09:57:14.644410+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:57:14.644410+0000","last_undegraded":"2024-05-10T09:57:14.644410+0000","last_fullsized":"2024-05-10T09:57:14.644410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"75'1","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663569+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:57:14.663569+0000","last_peered":"2024-05-10T09:57:14.663569+0000","last_clean":"2024-05-10T09:57:14.663569+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:57:14.663569+0000","last_undegraded":"2024-05-10T09:57:14.663569+0000","last_fullsized":"2024-05-10T09:57:14.663569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663142+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:57:14.663142+0000","last_peered":"2024-05-10T09:57:14.663142+0000","last_clean":"2024-05-10T09:57:14.663142+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:57:14.663142+0000","last_undegraded":"2024-05-10T09:57:14.663142+0000","last_fullsized":"2024-05-10T09:57:14.663142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659722+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:57:14.659722+0000","last_peered":"2024-05-10T09:57:14.659722+0000","last_clean":"2024-05-10T09:57:14.659722+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:57:14.659722+0000","last_undegraded":"2024-05-10T09:57:14.659722+0000","last_fullsized":"2024-05-10T09:57:14.659722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643136+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:57:14.643136+0000","last_peered":"2024-05-10T09:57:14.643136+0000","last_clean":"2024-05-10T09:57:14.643136+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:57:14.643136+0000","last_undegraded":"2024-05-10T09:57:14.643136+0000","last_fullsized":"2024-05-10T09:57:14.643136+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"89'18","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.685205+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:57:14.685205+0000","last_peered":"2024-05-10T09:57:14.685205+0000","last_clean":"2024-05-10T09:57:14.685205+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:57:14.685205+0000","last_undegraded":"2024-05-10T09:57:14.685205+0000","last_fullsized":"2024-05-10T09:57:14.685205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660549+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:57:14.660549+0000","last_peered":"2024-05-10T09:57:14.660549+0000","last_clean":"2024-05-10T09:57:14.660549+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:57:14.660549+0000","last_undegraded":"2024-05-10T09:57:14.660549+0000","last_fullsized":"2024-05-10T09:57:14.660549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661542+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:57:14.661542+0000","last_peered":"2024-05-10T09:57:14.661542+0000","last_clean":"2024-05-10T09:57:14.661542+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:57:14.661542+0000","last_undegraded":"2024-05-10T09:57:14.661542+0000","last_fullsized":"2024-05-10T09:57:14.661542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'41","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.170938+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:57:15.170938+0000","last_peered":"2024-05-10T09:57:15.170938+0000","last_clean":"2024-05-10T09:57:15.170938+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:57:15.170938+0000","last_undegraded":"2024-05-10T09:57:15.170938+0000","last_fullsized":"2024-05-10T09:57:15.170938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":142,"num_read_kb":104,"num_write":61,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'14","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.123860+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:57:15.123860+0000","last_peered":"2024-05-10T09:57:15.123860+0000","last_clean":"2024-05-10T09:57:15.123860+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:57:15.123860+0000","last_undegraded":"2024-05-10T09:57:15.123860+0000","last_fullsized":"2024-05-10T09:57:15.123860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":24,"num_read_kb":49166,"num_write":44,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643601+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:57:14.643601+0000","last_peered":"2024-05-10T09:57:14.643601+0000","last_clean":"2024-05-10T09:57:14.643601+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:57:14.643601+0000","last_undegraded":"2024-05-10T09:57:14.643601+0000","last_fullsized":"2024-05-10T09:57:14.643601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:37.269066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"89'22","reported_seq":162,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.018670+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:57:15.018670+0000","last_peered":"2024-05-10T09:57:15.018670+0000","last_clean":"2024-05-10T09:57:15.018670+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:57:15.018670+0000","last_undegraded":"2024-05-10T09:57:15.018670+0000","last_fullsized":"2024-05-10T09:57:15.018670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16575,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642535+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:57:14.642535+0000","last_peered":"2024-05-10T09:57:14.642535+0000","last_clean":"2024-05-10T09:57:14.642535+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:57:14.642535+0000","last_undegraded":"2024-05-10T09:57:14.642535+0000","last_fullsized":"2024-05-10T09:57:14.642535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979533+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:57:13.979533+0000","last_peered":"2024-05-10T09:57:13.979533+0000","last_clean":"2024-05-10T09:57:13.979533+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:57:13.979533+0000","last_undegraded":"2024-05-10T09:57:13.979533+0000","last_fullsized":"2024-05-10T09:57:13.979533+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614061+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:57:11.614061+0000","last_peered":"2024-05-10T09:57:11.614061+0000","last_clean":"2024-05-10T09:57:11.614061+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:57:11.614061+0000","last_undegraded":"2024-05-10T09:57:11.614061+0000","last_fullsized":"2024-05-10T09:57:11.614061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.019224+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:57:15.019224+0000","last_peered":"2024-05-10T09:57:15.019224+0000","last_clean":"2024-05-10T09:57:15.019224+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:57:15.019224+0000","last_undegraded":"2024-05-10T09:57:15.019224+0000","last_fullsized":"2024-05-10T09:57:15.019224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":28688,"num_write":49,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642798+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:57:14.642798+0000","last_peered":"2024-05-10T09:57:14.642798+0000","last_clean":"2024-05-10T09:57:14.642798+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:57:14.642798+0000","last_undegraded":"2024-05-10T09:57:14.642798+0000","last_fullsized":"2024-05-10T09:57:14.642798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"76'14","reported_seq":61,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614674+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:57:11.614674+0000","last_peered":"2024-05-10T09:57:11.614674+0000","last_clean":"2024-05-10T09:57:11.614674+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:57:11.614674+0000","last_undegraded":"2024-05-10T09:57:11.614674+0000","last_fullsized":"2024-05-10T09:57:11.614674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":16,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662481+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:57:14.662481+0000","last_peered":"2024-05-10T09:57:14.662481+0000","last_clean":"2024-05-10T09:57:14.662481+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:57:14.662481+0000","last_undegraded":"2024-05-10T09:57:14.662481+0000","last_fullsized":"2024-05-10T09:57:14.662481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643655+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:57:14.643655+0000","last_peered":"2024-05-10T09:57:14.643655+0000","last_clean":"2024-05-10T09:57:14.643655+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:57:14.643655+0000","last_undegraded":"2024-05-10T09:57:14.643655+0000","last_fullsized":"2024-05-10T09:57:14.643655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613227+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:57:11.613227+0000","last_peered":"2024-05-10T09:57:11.613227+0000","last_clean":"2024-05-10T09:57:11.613227+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:57:11.613227+0000","last_undegraded":"2024-05-10T09:57:11.613227+0000","last_fullsized":"2024-05-10T09:57:11.613227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'7","reported_seq":171,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.171003+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:57:15.171003+0000","last_peered":"2024-05-10T09:57:15.171003+0000","last_clean":"2024-05-10T09:57:15.171003+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:57:15.171003+0000","last_undegraded":"2024-05-10T09:57:15.171003+0000","last_fullsized":"2024-05-10T09:57:15.171003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980390+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:57:13.980390+0000","last_peered":"2024-05-10T09:57:13.980390+0000","last_clean":"2024-05-10T09:57:13.980390+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:57:13.980390+0000","last_undegraded":"2024-05-10T09:57:13.980390+0000","last_fullsized":"2024-05-10T09:57:13.980390+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"89'21","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.869191+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:57:14.869191+0000","last_peered":"2024-05-10T09:57:14.869191+0000","last_clean":"2024-05-10T09:57:14.869191+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:57:14.869191+0000","last_undegraded":"2024-05-10T09:57:14.869191+0000","last_fullsized":"2024-05-10T09:57:14.869191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"88'13","reported_seq":187,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643053+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:57:14.643053+0000","last_peered":"2024-05-10T09:57:14.643053+0000","last_clean":"2024-05-10T09:57:14.643053+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:57:14.643053+0000","last_undegraded":"2024-05-10T09:57:14.643053+0000","last_fullsized":"2024-05-10T09:57:14.643053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"75'1","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977575+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:57:13.977575+0000","last_peered":"2024-05-10T09:57:13.977575+0000","last_clean":"2024-05-10T09:57:13.977575+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:57:13.977575+0000","last_undegraded":"2024-05-10T09:57:13.977575+0000","last_fullsized":"2024-05-10T09:57:13.977575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614297+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:57:11.614297+0000","last_peered":"2024-05-10T09:57:11.614297+0000","last_clean":"2024-05-10T09:57:11.614297+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:57:11.614297+0000","last_undegraded":"2024-05-10T09:57:11.614297+0000","last_fullsized":"2024-05-10T09:57:11.614297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"78'3","reported_seq":121,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612084+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:57:11.612084+0000","last_peered":"2024-05-10T09:57:11.612084+0000","last_clean":"2024-05-10T09:57:11.612084+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:57:11.612084+0000","last_undegraded":"2024-05-10T09:57:11.612084+0000","last_fullsized":"2024-05-10T09:57:11.612084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670534+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:57:14.670534+0000","last_peered":"2024-05-10T09:57:14.670534+0000","last_clean":"2024-05-10T09:57:14.670534+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:57:14.670534+0000","last_undegraded":"2024-05-10T09:57:14.670534+0000","last_fullsized":"2024-05-10T09:57:14.670534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645293+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:57:14.645293+0000","last_peered":"2024-05-10T09:57:14.645293+0000","last_clean":"2024-05-10T09:57:14.645293+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:57:14.645293+0000","last_undegraded":"2024-05-10T09:57:14.645293+0000","last_fullsized":"2024-05-10T09:57:14.645293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"88'13","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663712+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:57:14.663712+0000","last_peered":"2024-05-10T09:57:14.663712+0000","last_clean":"2024-05-10T09:57:14.663712+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:57:14.663712+0000","last_undegraded":"2024-05-10T09:57:14.663712+0000","last_fullsized":"2024-05-10T09:57:14.663712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612069+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:57:11.612069+0000","last_peered":"2024-05-10T09:57:11.612069+0000","last_clean":"2024-05-10T09:57:11.612069+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:57:11.612069+0000","last_undegraded":"2024-05-10T09:57:11.612069+0000","last_fullsized":"2024-05-10T09:57:11.612069+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"79'23","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978687+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:57:13.978687+0000","last_peered":"2024-05-10T09:57:13.978687+0000","last_clean":"2024-05-10T09:57:13.978687+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:57:13.978687+0000","last_undegraded":"2024-05-10T09:57:13.978687+0000","last_fullsized":"2024-05-10T09:57:13.978687+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":77,"num_read_kb":55,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.978093+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:57:14.978093+0000","last_peered":"2024-05-10T09:57:14.978093+0000","last_clean":"2024-05-10T09:57:14.978093+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:57:14.978093+0000","last_undegraded":"2024-05-10T09:57:14.978093+0000","last_fullsized":"2024-05-10T09:57:14.978093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":18,"num_read_kb":43016,"num_write":32,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613792+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:57:11.613792+0000","last_peered":"2024-05-10T09:57:11.613792+0000","last_clean":"2024-05-10T09:57:11.613792+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:57:11.613792+0000","last_undegraded":"2024-05-10T09:57:11.613792+0000","last_fullsized":"2024-05-10T09:57:11.613792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"89'24","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.958778+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:57:14.958778+0000","last_peered":"2024-05-10T09:57:14.958778+0000","last_clean":"2024-05-10T09:57:14.958778+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:57:14.958778+0000","last_undegraded":"2024-05-10T09:57:14.958778+0000","last_fullsized":"2024-05-10T09:57:14.958778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663509+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:57:14.663509+0000","last_peered":"2024-05-10T09:57:14.663509+0000","last_clean":"2024-05-10T09:57:14.663509+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:57:14.663509+0000","last_undegraded":"2024-05-10T09:57:14.663509+0000","last_fullsized":"2024-05-10T09:57:14.663509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977320+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:57:13.977320+0000","last_peered":"2024-05-10T09:57:13.977320+0000","last_clean":"2024-05-10T09:57:13.977320+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:57:13.977320+0000","last_undegraded":"2024-05-10T09:57:13.977320+0000","last_fullsized":"2024-05-10T09:57:13.977320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'45","reported_seq":194,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.032881+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:57:15.032881+0000","last_peered":"2024-05-10T09:57:15.032881+0000","last_clean":"2024-05-10T09:57:15.032881+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:57:15.032881+0000","last_undegraded":"2024-05-10T09:57:15.032881+0000","last_fullsized":"2024-05-10T09:57:15.032881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":156,"num_read_kb":114,"num_write":67,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":243,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658368+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:57:14.658368+0000","last_peered":"2024-05-10T09:57:14.658368+0000","last_clean":"2024-05-10T09:57:14.658368+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:57:14.658368+0000","last_undegraded":"2024-05-10T09:57:14.658368+0000","last_fullsized":"2024-05-10T09:57:14.658368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669666+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:57:14.669666+0000","last_peered":"2024-05-10T09:57:14.669666+0000","last_clean":"2024-05-10T09:57:14.669666+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:57:14.669666+0000","last_undegraded":"2024-05-10T09:57:14.669666+0000","last_fullsized":"2024-05-10T09:57:14.669666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'11","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.925227+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:57:14.925227+0000","last_peered":"2024-05-10T09:57:14.925227+0000","last_clean":"2024-05-10T09:57:14.925227+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:57:14.925227+0000","last_undegraded":"2024-05-10T09:57:14.925227+0000","last_fullsized":"2024-05-10T09:57:14.925227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658016+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:57:14.658016+0000","last_peered":"2024-05-10T09:57:14.658016+0000","last_clean":"2024-05-10T09:57:14.658016+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:57:14.658016+0000","last_undegraded":"2024-05-10T09:57:14.658016+0000","last_fullsized":"2024-05-10T09:57:14.658016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"89'30","reported_seq":172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.229354+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:57:15.229354+0000","last_peered":"2024-05-10T09:57:15.229354+0000","last_clean":"2024-05-10T09:57:15.229354+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:57:15.229354+0000","last_undegraded":"2024-05-10T09:57:15.229354+0000","last_fullsized":"2024-05-10T09:57:15.229354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18409,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661634+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:57:14.661634+0000","last_peered":"2024-05-10T09:57:14.661634+0000","last_clean":"2024-05-10T09:57:14.661634+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:57:14.661634+0000","last_undegraded":"2024-05-10T09:57:14.661634+0000","last_fullsized":"2024-05-10T09:57:14.661634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662474+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:57:14.662474+0000","last_peered":"2024-05-10T09:57:14.662474+0000","last_clean":"2024-05-10T09:57:14.662474+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:57:14.662474+0000","last_undegraded":"2024-05-10T09:57:14.662474+0000","last_fullsized":"2024-05-10T09:57:14.662474+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661914+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:57:14.661914+0000","last_peered":"2024-05-10T09:57:14.661914+0000","last_clean":"2024-05-10T09:57:14.661914+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:57:14.661914+0000","last_undegraded":"2024-05-10T09:57:14.661914+0000","last_fullsized":"2024-05-10T09:57:14.661914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657868+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:57:14.657868+0000","last_peered":"2024-05-10T09:57:14.657868+0000","last_clean":"2024-05-10T09:57:14.657868+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:57:14.657868+0000","last_undegraded":"2024-05-10T09:57:14.657868+0000","last_fullsized":"2024-05-10T09:57:14.657868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'12","reported_seq":196,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660796+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:57:14.660796+0000","last_peered":"2024-05-10T09:57:14.660796+0000","last_clean":"2024-05-10T09:57:14.660796+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:57:14.660796+0000","last_undegraded":"2024-05-10T09:57:14.660796+0000","last_fullsized":"2024-05-10T09:57:14.660796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.015437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.671724+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:57:14.671724+0000","last_peered":"2024-05-10T09:57:14.671724+0000","last_clean":"2024-05-10T09:57:14.671724+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:57:14.671724+0000","last_undegraded":"2024-05-10T09:57:14.671724+0000","last_fullsized":"2024-05-10T09:57:14.671724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'32","reported_seq":209,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979027+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:57:13.979027+0000","last_peered":"2024-05-10T09:57:13.979027+0000","last_clean":"2024-05-10T09:57:13.979027+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:57:13.979027+0000","last_undegraded":"2024-05-10T09:57:13.979027+0000","last_fullsized":"2024-05-10T09:57:13.979027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658354+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:57:14.658354+0000","last_peered":"2024-05-10T09:57:14.658354+0000","last_clean":"2024-05-10T09:57:14.658354+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:57:14.658354+0000","last_undegraded":"2024-05-10T09:57:14.658354+0000","last_fullsized":"2024-05-10T09:57:14.658354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977492+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:57:13.977492+0000","last_peered":"2024-05-10T09:57:13.977492+0000","last_clean":"2024-05-10T09:57:13.977492+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:57:13.977492+0000","last_undegraded":"2024-05-10T09:57:13.977492+0000","last_fullsized":"2024-05-10T09:57:13.977492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980779+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:57:13.980779+0000","last_peered":"2024-05-10T09:57:13.980779+0000","last_clean":"2024-05-10T09:57:13.980779+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:57:13.980779+0000","last_undegraded":"2024-05-10T09:57:13.980779+0000","last_fullsized":"2024-05-10T09:57:13.980779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643785+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:57:14.643785+0000","last_peered":"2024-05-10T09:57:14.643785+0000","last_clean":"2024-05-10T09:57:14.643785+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:57:14.643785+0000","last_undegraded":"2024-05-10T09:57:14.643785+0000","last_fullsized":"2024-05-10T09:57:14.643785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978346+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:57:13.978346+0000","last_peered":"2024-05-10T09:57:13.978346+0000","last_clean":"2024-05-10T09:57:13.978346+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:57:13.978346+0000","last_undegraded":"2024-05-10T09:57:13.978346+0000","last_fullsized":"2024-05-10T09:57:13.978346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":12,"num_read_kb":26628,"num_write":28,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":134,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643210+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:57:14.643210+0000","last_peered":"2024-05-10T09:57:14.643210+0000","last_clean":"2024-05-10T09:57:14.643210+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:57:14.643210+0000","last_undegraded":"2024-05-10T09:57:14.643210+0000","last_fullsized":"2024-05-10T09:57:14.643210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":180,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658897+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:57:14.658897+0000","last_peered":"2024-05-10T09:57:14.658897+0000","last_clean":"2024-05-10T09:57:14.658897+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:57:14.658897+0000","last_undegraded":"2024-05-10T09:57:14.658897+0000","last_fullsized":"2024-05-10T09:57:14.658897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661078+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:57:14.661078+0000","last_peered":"2024-05-10T09:57:14.661078+0000","last_clean":"2024-05-10T09:57:14.661078+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:57:14.661078+0000","last_undegraded":"2024-05-10T09:57:14.661078+0000","last_fullsized":"2024-05-10T09:57:14.661078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:06.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645314+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:57:14.645314+0000","last_peered":"2024-05-10T09:57:14.645314+0000","last_clean":"2024-05-10T09:57:14.645314+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:57:14.645314+0000","last_undegraded":"2024-05-10T09:57:14.645314+0000","last_fullsized":"2024-05-10T09:57:14.645314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977515+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:57:13.977515+0000","last_peered":"2024-05-10T09:57:13.977515+0000","last_clean":"2024-05-10T09:57:13.977515+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:57:13.977515+0000","last_undegraded":"2024-05-10T09:57:13.977515+0000","last_fullsized":"2024-05-10T09:57:13.977515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669739+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:57:14.669739+0000","last_peered":"2024-05-10T09:57:14.669739+0000","last_clean":"2024-05-10T09:57:14.669739+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:57:14.669739+0000","last_undegraded":"2024-05-10T09:57:14.669739+0000","last_fullsized":"2024-05-10T09:57:14.669739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"79'8","reported_seq":128,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612044+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:57:11.612044+0000","last_peered":"2024-05-10T09:57:11.612044+0000","last_clean":"2024-05-10T09:57:11.612044+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:57:11.612044+0000","last_undegraded":"2024-05-10T09:57:11.612044+0000","last_fullsized":"2024-05-10T09:57:11.612044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":12,"num_read_kb":24580,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661261+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:57:14.661261+0000","last_peered":"2024-05-10T09:57:14.661261+0000","last_clean":"2024-05-10T09:57:14.661261+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:57:14.661261+0000","last_undegraded":"2024-05-10T09:57:14.661261+0000","last_fullsized":"2024-05-10T09:57:14.661261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645918+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:57:14.645918+0000","last_peered":"2024-05-10T09:57:14.645918+0000","last_clean":"2024-05-10T09:57:14.645918+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:57:14.645918+0000","last_undegraded":"2024-05-10T09:57:14.645918+0000","last_fullsized":"2024-05-10T09:57:14.645918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663991+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:57:14.663991+0000","last_peered":"2024-05-10T09:57:14.663991+0000","last_clean":"2024-05-10T09:57:14.663991+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:57:14.663991+0000","last_undegraded":"2024-05-10T09:57:14.663991+0000","last_fullsized":"2024-05-10T09:57:14.663991+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668718+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:57:14.668718+0000","last_peered":"2024-05-10T09:57:14.668718+0000","last_clean":"2024-05-10T09:57:14.668718+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:57:14.668718+0000","last_undegraded":"2024-05-10T09:57:14.668718+0000","last_fullsized":"2024-05-10T09:57:14.668718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979564+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:57:13.979564+0000","last_peered":"2024-05-10T09:57:13.979564+0000","last_clean":"2024-05-10T09:57:13.979564+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:57:13.979564+0000","last_undegraded":"2024-05-10T09:57:13.979564+0000","last_fullsized":"2024-05-10T09:57:13.979564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'13","reported_seq":166,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.817255+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:57:14.817255+0000","last_peered":"2024-05-10T09:57:14.817255+0000","last_clean":"2024-05-10T09:57:14.817255+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:57:14.817255+0000","last_undegraded":"2024-05-10T09:57:14.817255+0000","last_fullsized":"2024-05-10T09:57:14.817255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":19,"num_read_kb":45064,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979878+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:57:13.979878+0000","last_peered":"2024-05-10T09:57:13.979878+0000","last_clean":"2024-05-10T09:57:13.979878+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:57:13.979878+0000","last_undegraded":"2024-05-10T09:57:13.979878+0000","last_fullsized":"2024-05-10T09:57:13.979878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661037+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:57:14.661037+0000","last_peered":"2024-05-10T09:57:14.661037+0000","last_clean":"2024-05-10T09:57:14.661037+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:57:14.661037+0000","last_undegraded":"2024-05-10T09:57:14.661037+0000","last_fullsized":"2024-05-10T09:57:14.661037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"89'25","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.028912+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:57:15.028912+0000","last_peered":"2024-05-10T09:57:15.028912+0000","last_clean":"2024-05-10T09:57:15.028912+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:57:15.028912+0000","last_undegraded":"2024-05-10T09:57:15.028912+0000","last_fullsized":"2024-05-10T09:57:15.028912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9860,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613125+0000","last_change":"2024-05-10T09:57:09.652257+0000","last_active":"2024-05-10T09:57:11.613125+0000","last_peered":"2024-05-10T09:57:11.613125+0000","last_clean":"2024-05-10T09:57:11.613125+0000","last_became_active":"2024-05-10T09:57:09.648476+0000","last_became_peered":"2024-05-10T09:57:09.648476+0000","last_unstale":"2024-05-10T09:57:11.613125+0000","last_undegraded":"2024-05-10T09:57:11.613125+0000","last_fullsized":"2024-05-10T09:57:11.613125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:20.904851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661288+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:57:14.661288+0000","last_peered":"2024-05-10T09:57:14.661288+0000","last_clean":"2024-05-10T09:57:14.661288+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:57:14.661288+0000","last_undegraded":"2024-05-10T09:57:14.661288+0000","last_fullsized":"2024-05-10T09:57:14.661288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'37","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.798413+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:57:14.798413+0000","last_peered":"2024-05-10T09:57:14.798413+0000","last_clean":"2024-05-10T09:57:14.798413+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:57:14.798413+0000","last_undegraded":"2024-05-10T09:57:14.798413+0000","last_fullsized":"2024-05-10T09:57:14.798413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":94,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"77'3","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979612+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:57:13.979612+0000","last_peered":"2024-05-10T09:57:13.979612+0000","last_clean":"2024-05-10T09:57:13.979612+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:57:13.979612+0000","last_undegraded":"2024-05-10T09:57:13.979612+0000","last_fullsized":"2024-05-10T09:57:13.979612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.659830+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:57:14.659830+0000","last_peered":"2024-05-10T09:57:14.659830+0000","last_clean":"2024-05-10T09:57:14.659830+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:57:14.659830+0000","last_undegraded":"2024-05-10T09:57:14.659830+0000","last_fullsized":"2024-05-10T09:57:14.659830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663017+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:57:14.663017+0000","last_peered":"2024-05-10T09:57:14.663017+0000","last_clean":"2024-05-10T09:57:14.663017+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:57:14.663017+0000","last_undegraded":"2024-05-10T09:57:14.663017+0000","last_fullsized":"2024-05-10T09:57:14.663017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978748+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:57:13.978748+0000","last_peered":"2024-05-10T09:57:13.978748+0000","last_clean":"2024-05-10T09:57:13.978748+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:57:13.978748+0000","last_undegraded":"2024-05-10T09:57:13.978748+0000","last_fullsized":"2024-05-10T09:57:13.978748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"88'13","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.668905+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:57:14.668905+0000","last_peered":"2024-05-10T09:57:14.668905+0000","last_clean":"2024-05-10T09:57:14.668905+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:57:14.668905+0000","last_undegraded":"2024-05-10T09:57:14.668905+0000","last_fullsized":"2024-05-10T09:57:14.668905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646585+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:57:14.646585+0000","last_peered":"2024-05-10T09:57:14.646585+0000","last_clean":"2024-05-10T09:57:14.646585+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:57:14.646585+0000","last_undegraded":"2024-05-10T09:57:14.646585+0000","last_fullsized":"2024-05-10T09:57:14.646585+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643947+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:57:14.643947+0000","last_peered":"2024-05-10T09:57:14.643947+0000","last_clean":"2024-05-10T09:57:14.643947+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:57:14.643947+0000","last_undegraded":"2024-05-10T09:57:14.643947+0000","last_fullsized":"2024-05-10T09:57:14.643947+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"79'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645761+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:57:14.645761+0000","last_peered":"2024-05-10T09:57:14.645761+0000","last_clean":"2024-05-10T09:57:14.645761+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:57:14.645761+0000","last_undegraded":"2024-05-10T09:57:14.645761+0000","last_fullsized":"2024-05-10T09:57:14.645761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":12,"num_read_kb":38914,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978019+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:57:13.978019+0000","last_peered":"2024-05-10T09:57:13.978019+0000","last_clean":"2024-05-10T09:57:13.978019+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:57:13.978019+0000","last_undegraded":"2024-05-10T09:57:13.978019+0000","last_fullsized":"2024-05-10T09:57:13.978019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612834+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:57:11.612834+0000","last_peered":"2024-05-10T09:57:11.612834+0000","last_clean":"2024-05-10T09:57:11.612834+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:57:11.612834+0000","last_undegraded":"2024-05-10T09:57:11.612834+0000","last_fullsized":"2024-05-10T09:57:11.612834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614782+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:57:11.614782+0000","last_peered":"2024-05-10T09:57:11.614782+0000","last_clean":"2024-05-10T09:57:11.614782+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:57:11.614782+0000","last_undegraded":"2024-05-10T09:57:11.614782+0000","last_fullsized":"2024-05-10T09:57:11.614782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"88'13","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645993+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:57:14.645993+0000","last_peered":"2024-05-10T09:57:14.645993+0000","last_clean":"2024-05-10T09:57:14.645993+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:57:14.645993+0000","last_undegraded":"2024-05-10T09:57:14.645993+0000","last_fullsized":"2024-05-10T09:57:14.645993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"75'4","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.697706+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:57:14.697706+0000","last_peered":"2024-05-10T09:57:14.697706+0000","last_clean":"2024-05-10T09:57:14.697706+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:57:14.697706+0000","last_undegraded":"2024-05-10T09:57:14.697706+0000","last_fullsized":"2024-05-10T09:57:14.697706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"79'38","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612363+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:57:11.612363+0000","last_peered":"2024-05-10T09:57:11.612363+0000","last_clean":"2024-05-10T09:57:11.612363+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:57:11.612363+0000","last_undegraded":"2024-05-10T09:57:11.612363+0000","last_fullsized":"2024-05-10T09:57:11.612363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":90,"num_write":56,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'19","reported_seq":179,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.010777+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:57:15.010777+0000","last_peered":"2024-05-10T09:57:15.010777+0000","last_clean":"2024-05-10T09:57:15.010777+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:57:15.010777+0000","last_undegraded":"2024-05-10T09:57:15.010777+0000","last_fullsized":"2024-05-10T09:57:15.010777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":35,"num_read_kb":59414,"num_write":69,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664373+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:57:14.664373+0000","last_peered":"2024-05-10T09:57:14.664373+0000","last_clean":"2024-05-10T09:57:14.664373+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:57:14.664373+0000","last_undegraded":"2024-05-10T09:57:14.664373+0000","last_fullsized":"2024-05-10T09:57:14.664373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643866+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:57:14.643866+0000","last_peered":"2024-05-10T09:57:14.643866+0000","last_clean":"2024-05-10T09:57:14.643866+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:57:14.643866+0000","last_undegraded":"2024-05-10T09:57:14.643866+0000","last_fullsized":"2024-05-10T09:57:14.643866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"89'30","reported_seq":176,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.069438+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:57:15.069438+0000","last_peered":"2024-05-10T09:57:15.069438+0000","last_clean":"2024-05-10T09:57:15.069438+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:57:15.069438+0000","last_undegraded":"2024-05-10T09:57:15.069438+0000","last_fullsized":"2024-05-10T09:57:15.069438+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":41,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644605+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:57:14.644605+0000","last_peered":"2024-05-10T09:57:14.644605+0000","last_clean":"2024-05-10T09:57:14.644605+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:57:14.644605+0000","last_undegraded":"2024-05-10T09:57:14.644605+0000","last_fullsized":"2024-05-10T09:57:14.644605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669634+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:57:14.669634+0000","last_peered":"2024-05-10T09:57:14.669634+0000","last_clean":"2024-05-10T09:57:14.669634+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:57:14.669634+0000","last_undegraded":"2024-05-10T09:57:14.669634+0000","last_fullsized":"2024-05-10T09:57:14.669634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662340+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:57:14.662340+0000","last_peered":"2024-05-10T09:57:14.662340+0000","last_clean":"2024-05-10T09:57:14.662340+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:57:14.662340+0000","last_undegraded":"2024-05-10T09:57:14.662340+0000","last_fullsized":"2024-05-10T09:57:14.662340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612528+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:57:11.612528+0000","last_peered":"2024-05-10T09:57:11.612528+0000","last_clean":"2024-05-10T09:57:11.612528+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:57:11.612528+0000","last_undegraded":"2024-05-10T09:57:11.612528+0000","last_fullsized":"2024-05-10T09:57:11.612528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"79'7","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612013+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:57:11.612013+0000","last_peered":"2024-05-10T09:57:11.612013+0000","last_clean":"2024-05-10T09:57:11.612013+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:57:11.612013+0000","last_undegraded":"2024-05-10T09:57:11.612013+0000","last_fullsized":"2024-05-10T09:57:11.612013+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":130,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980011+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:57:13.980011+0000","last_peered":"2024-05-10T09:57:13.980011+0000","last_clean":"2024-05-10T09:57:13.980011+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:57:13.980011+0000","last_undegraded":"2024-05-10T09:57:13.980011+0000","last_fullsized":"2024-05-10T09:57:13.980011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"89'15","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.682121+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:57:14.682121+0000","last_peered":"2024-05-10T09:57:14.682121+0000","last_clean":"2024-05-10T09:57:14.682121+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:57:14.682121+0000","last_undegraded":"2024-05-10T09:57:14.682121+0000","last_fullsized":"2024-05-10T09:57:14.682121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643726+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:57:14.643726+0000","last_peered":"2024-05-10T09:57:14.643726+0000","last_clean":"2024-05-10T09:57:14.643726+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:57:14.643726+0000","last_undegraded":"2024-05-10T09:57:14.643726+0000","last_fullsized":"2024-05-10T09:57:14.643726+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"75'5","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645418+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:57:14.645418+0000","last_peered":"2024-05-10T09:57:14.645418+0000","last_clean":"2024-05-10T09:57:14.645418+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:57:14.645418+0000","last_undegraded":"2024-05-10T09:57:14.645418+0000","last_fullsized":"2024-05-10T09:57:14.645418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977014+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:57:13.977014+0000","last_peered":"2024-05-10T09:57:13.977014+0000","last_clean":"2024-05-10T09:57:13.977014+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:57:13.977014+0000","last_undegraded":"2024-05-10T09:57:13.977014+0000","last_fullsized":"2024-05-10T09:57:13.977014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.156571+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:57:15.156571+0000","last_peered":"2024-05-10T09:57:15.156571+0000","last_clean":"2024-05-10T09:57:15.156571+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:57:15.156571+0000","last_undegraded":"2024-05-10T09:57:15.156571+0000","last_fullsized":"2024-05-10T09:57:15.156571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":30738,"num_write":42,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645204+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:57:14.645204+0000","last_peered":"2024-05-10T09:57:14.645204+0000","last_clean":"2024-05-10T09:57:14.645204+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:57:14.645204+0000","last_undegraded":"2024-05-10T09:57:14.645204+0000","last_fullsized":"2024-05-10T09:57:14.645204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660626+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:57:14.660626+0000","last_peered":"2024-05-10T09:57:14.660626+0000","last_clean":"2024-05-10T09:57:14.660626+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:57:14.660626+0000","last_undegraded":"2024-05-10T09:57:14.660626+0000","last_fullsized":"2024-05-10T09:57:14.660626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657605+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:57:14.657605+0000","last_peered":"2024-05-10T09:57:14.657605+0000","last_clean":"2024-05-10T09:57:14.657605+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:57:14.657605+0000","last_undegraded":"2024-05-10T09:57:14.657605+0000","last_fullsized":"2024-05-10T09:57:14.657605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661135+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:57:14.661135+0000","last_peered":"2024-05-10T09:57:14.661135+0000","last_clean":"2024-05-10T09:57:14.661135+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:57:14.661135+0000","last_undegraded":"2024-05-10T09:57:14.661135+0000","last_fullsized":"2024-05-10T09:57:14.661135+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644304+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:57:14.644304+0000","last_peered":"2024-05-10T09:57:14.644304+0000","last_clean":"2024-05-10T09:57:14.644304+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:57:14.644304+0000","last_undegraded":"2024-05-10T09:57:14.644304+0000","last_fullsized":"2024-05-10T09:57:14.644304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'9","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.822711+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:57:14.822711+0000","last_peered":"2024-05-10T09:57:14.822711+0000","last_clean":"2024-05-10T09:57:14.822711+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:57:14.822711+0000","last_undegraded":"2024-05-10T09:57:14.822711+0000","last_fullsized":"2024-05-10T09:57:14.822711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657037+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:57:14.657037+0000","last_peered":"2024-05-10T09:57:14.657037+0000","last_clean":"2024-05-10T09:57:14.657037+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:57:14.657037+0000","last_undegraded":"2024-05-10T09:57:14.657037+0000","last_fullsized":"2024-05-10T09:57:14.657037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"89'17","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.809194+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:57:14.809194+0000","last_peered":"2024-05-10T09:57:14.809194+0000","last_clean":"2024-05-10T09:57:14.809194+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:57:14.809194+0000","last_undegraded":"2024-05-10T09:57:14.809194+0000","last_fullsized":"2024-05-10T09:57:14.809194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11369,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662896+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:57:14.662896+0000","last_peered":"2024-05-10T09:57:14.662896+0000","last_clean":"2024-05-10T09:57:14.662896+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:57:14.662896+0000","last_undegraded":"2024-05-10T09:57:14.662896+0000","last_fullsized":"2024-05-10T09:57:14.662896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669643+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:57:14.669643+0000","last_peered":"2024-05-10T09:57:14.669643+0000","last_clean":"2024-05-10T09:57:14.669643+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:57:14.669643+0000","last_undegraded":"2024-05-10T09:57:14.669643+0000","last_fullsized":"2024-05-10T09:57:14.669643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644113+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:57:14.644113+0000","last_peered":"2024-05-10T09:57:14.644113+0000","last_clean":"2024-05-10T09:57:14.644113+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:57:14.644113+0000","last_undegraded":"2024-05-10T09:57:14.644113+0000","last_fullsized":"2024-05-10T09:57:14.644113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'12","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.161242+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:57:15.161242+0000","last_peered":"2024-05-10T09:57:15.161242+0000","last_clean":"2024-05-10T09:57:15.161242+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:57:15.161242+0000","last_undegraded":"2024-05-10T09:57:15.161242+0000","last_fullsized":"2024-05-10T09:57:15.161242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":20,"num_read_kb":40970,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662834+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:57:14.662834+0000","last_peered":"2024-05-10T09:57:14.662834+0000","last_clean":"2024-05-10T09:57:14.662834+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:57:14.662834+0000","last_undegraded":"2024-05-10T09:57:14.662834+0000","last_fullsized":"2024-05-10T09:57:14.662834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"89'15","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.777248+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:57:14.777248+0000","last_peered":"2024-05-10T09:57:14.777248+0000","last_clean":"2024-05-10T09:57:14.777248+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:57:14.777248+0000","last_undegraded":"2024-05-10T09:57:14.777248+0000","last_fullsized":"2024-05-10T09:57:14.777248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660860+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:57:14.660860+0000","last_peered":"2024-05-10T09:57:14.660860+0000","last_clean":"2024-05-10T09:57:14.660860+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:57:14.660860+0000","last_undegraded":"2024-05-10T09:57:14.660860+0000","last_fullsized":"2024-05-10T09:57:14.660860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664331+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:57:14.664331+0000","last_peered":"2024-05-10T09:57:14.664331+0000","last_clean":"2024-05-10T09:57:14.664331+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:57:14.664331+0000","last_undegraded":"2024-05-10T09:57:14.664331+0000","last_fullsized":"2024-05-10T09:57:14.664331+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.712733+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:57:14.712733+0000","last_peered":"2024-05-10T09:57:14.712733+0000","last_clean":"2024-05-10T09:57:14.712733+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:57:14.712733+0000","last_undegraded":"2024-05-10T09:57:14.712733+0000","last_fullsized":"2024-05-10T09:57:14.712733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":18440,"num_write":26,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661713+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:57:14.661713+0000","last_peered":"2024-05-10T09:57:14.661713+0000","last_clean":"2024-05-10T09:57:14.661713+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:57:14.661713+0000","last_undegraded":"2024-05-10T09:57:14.661713+0000","last_fullsized":"2024-05-10T09:57:14.661713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'14","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979138+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:57:13.979138+0000","last_peered":"2024-05-10T09:57:13.979138+0000","last_clean":"2024-05-10T09:57:13.979138+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:57:13.979138+0000","last_undegraded":"2024-05-10T09:57:13.979138+0000","last_fullsized":"2024-05-10T09:57:13.979138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":123,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669821+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:57:14.669821+0000","last_peered":"2024-05-10T09:57:14.669821+0000","last_clean":"2024-05-10T09:57:14.669821+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:57:14.669821+0000","last_undegraded":"2024-05-10T09:57:14.669821+0000","last_fullsized":"2024-05-10T09:57:14.669821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644862+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:57:14.644862+0000","last_peered":"2024-05-10T09:57:14.644862+0000","last_clean":"2024-05-10T09:57:14.644862+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:57:14.644862+0000","last_undegraded":"2024-05-10T09:57:14.644862+0000","last_fullsized":"2024-05-10T09:57:14.644862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661829+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:57:14.661829+0000","last_peered":"2024-05-10T09:57:14.661829+0000","last_clean":"2024-05-10T09:57:14.661829+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:57:14.661829+0000","last_undegraded":"2024-05-10T09:57:14.661829+0000","last_fullsized":"2024-05-10T09:57:14.661829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"79'10","reported_seq":163,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980549+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:57:13.980549+0000","last_peered":"2024-05-10T09:57:13.980549+0000","last_clean":"2024-05-10T09:57:13.980549+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:57:13.980549+0000","last_undegraded":"2024-05-10T09:57:13.980549+0000","last_fullsized":"2024-05-10T09:57:13.980549+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":12,"num_read_kb":30722,"num_write":20,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.664106+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:57:14.664106+0000","last_peered":"2024-05-10T09:57:14.664106+0000","last_clean":"2024-05-10T09:57:14.664106+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:57:14.664106+0000","last_undegraded":"2024-05-10T09:57:14.664106+0000","last_fullsized":"2024-05-10T09:57:14.664106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"89'20","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.084219+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:57:15.084219+0000","last_peered":"2024-05-10T09:57:15.084219+0000","last_clean":"2024-05-10T09:57:15.084219+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:57:15.084219+0000","last_undegraded":"2024-05-10T09:57:15.084219+0000","last_fullsized":"2024-05-10T09:57:15.084219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10813,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979746+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:57:13.979746+0000","last_peered":"2024-05-10T09:57:13.979746+0000","last_clean":"2024-05-10T09:57:13.979746+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:57:13.979746+0000","last_undegraded":"2024-05-10T09:57:13.979746+0000","last_fullsized":"2024-05-10T09:57:13.979746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662741+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:57:14.662741+0000","last_peered":"2024-05-10T09:57:14.662741+0000","last_clean":"2024-05-10T09:57:14.662741+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:57:14.662741+0000","last_undegraded":"2024-05-10T09:57:14.662741+0000","last_fullsized":"2024-05-10T09:57:14.662741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645473+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:57:14.645473+0000","last_peered":"2024-05-10T09:57:14.645473+0000","last_clean":"2024-05-10T09:57:14.645473+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:57:14.645473+0000","last_undegraded":"2024-05-10T09:57:14.645473+0000","last_fullsized":"2024-05-10T09:57:14.645473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"78'6","reported_seq":127,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611612+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:57:11.611612+0000","last_peered":"2024-05-10T09:57:11.611612+0000","last_clean":"2024-05-10T09:57:11.611612+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:57:11.611612+0000","last_undegraded":"2024-05-10T09:57:11.611612+0000","last_fullsized":"2024-05-10T09:57:11.611612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":18434,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.612963+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:57:11.612963+0000","last_peered":"2024-05-10T09:57:11.612963+0000","last_clean":"2024-05-10T09:57:11.612963+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:57:11.612963+0000","last_undegraded":"2024-05-10T09:57:11.612963+0000","last_fullsized":"2024-05-10T09:57:11.612963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"89'15","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646841+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:57:14.646841+0000","last_peered":"2024-05-10T09:57:14.646841+0000","last_clean":"2024-05-10T09:57:14.646841+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:57:14.646841+0000","last_undegraded":"2024-05-10T09:57:14.646841+0000","last_fullsized":"2024-05-10T09:57:14.646841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979463+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:57:13.979463+0000","last_peered":"2024-05-10T09:57:13.979463+0000","last_clean":"2024-05-10T09:57:13.979463+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:57:13.979463+0000","last_undegraded":"2024-05-10T09:57:13.979463+0000","last_fullsized":"2024-05-10T09:57:13.979463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":120,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669089+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:57:14.669089+0000","last_peered":"2024-05-10T09:57:14.669089+0000","last_clean":"2024-05-10T09:57:14.669089+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:57:14.669089+0000","last_undegraded":"2024-05-10T09:57:14.669089+0000","last_fullsized":"2024-05-10T09:57:14.669089+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'37","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.897854+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:57:14.897854+0000","last_peered":"2024-05-10T09:57:14.897854+0000","last_clean":"2024-05-10T09:57:14.897854+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:57:14.897854+0000","last_undegraded":"2024-05-10T09:57:14.897854+0000","last_fullsized":"2024-05-10T09:57:14.897854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":128,"num_read_kb":94,"num_write":55,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"79'11","reported_seq":191,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660922+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:57:14.660922+0000","last_peered":"2024-05-10T09:57:14.660922+0000","last_clean":"2024-05-10T09:57:14.660922+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:57:14.660922+0000","last_undegraded":"2024-05-10T09:57:14.660922+0000","last_fullsized":"2024-05-10T09:57:14.660922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:36.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980205+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:57:13.980205+0000","last_peered":"2024-05-10T09:57:13.980205+0000","last_clean":"2024-05-10T09:57:13.980205+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:57:13.980205+0000","last_undegraded":"2024-05-10T09:57:13.980205+0000","last_fullsized":"2024-05-10T09:57:13.980205+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614029+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:57:11.614029+0000","last_peered":"2024-05-10T09:57:11.614029+0000","last_clean":"2024-05-10T09:57:11.614029+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:57:11.614029+0000","last_undegraded":"2024-05-10T09:57:11.614029+0000","last_fullsized":"2024-05-10T09:57:11.614029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"88'15","reported_seq":182,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.663795+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:57:14.663795+0000","last_peered":"2024-05-10T09:57:14.663795+0000","last_clean":"2024-05-10T09:57:14.663795+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:57:14.663795+0000","last_undegraded":"2024-05-10T09:57:14.663795+0000","last_fullsized":"2024-05-10T09:57:14.663795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657041+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:57:14.657041+0000","last_peered":"2024-05-10T09:57:14.657041+0000","last_clean":"2024-05-10T09:57:14.657041+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:57:14.657041+0000","last_undegraded":"2024-05-10T09:57:14.657041+0000","last_fullsized":"2024-05-10T09:57:14.657041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":87,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979034+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:57:13.979034+0000","last_peered":"2024-05-10T09:57:13.979034+0000","last_clean":"2024-05-10T09:57:13.979034+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:57:13.979034+0000","last_undegraded":"2024-05-10T09:57:13.979034+0000","last_fullsized":"2024-05-10T09:57:13.979034+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"89'7","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.139712+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:57:15.139712+0000","last_peered":"2024-05-10T09:57:15.139712+0000","last_clean":"2024-05-10T09:57:15.139712+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:57:15.139712+0000","last_undegraded":"2024-05-10T09:57:15.139712+0000","last_fullsized":"2024-05-10T09:57:15.139712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18442,"num_write":37,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657721+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:57:14.657721+0000","last_peered":"2024-05-10T09:57:14.657721+0000","last_clean":"2024-05-10T09:57:14.657721+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:57:14.657721+0000","last_undegraded":"2024-05-10T09:57:14.657721+0000","last_fullsized":"2024-05-10T09:57:14.657721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"89'19","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.123342+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:57:15.123342+0000","last_peered":"2024-05-10T09:57:15.123342+0000","last_clean":"2024-05-10T09:57:15.123342+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:57:15.123342+0000","last_undegraded":"2024-05-10T09:57:15.123342+0000","last_fullsized":"2024-05-10T09:57:15.123342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660473+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:57:14.660473+0000","last_peered":"2024-05-10T09:57:14.660473+0000","last_clean":"2024-05-10T09:57:14.660473+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:57:14.660473+0000","last_undegraded":"2024-05-10T09:57:14.660473+0000","last_fullsized":"2024-05-10T09:57:14.660473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660334+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:57:14.660334+0000","last_peered":"2024-05-10T09:57:14.660334+0000","last_clean":"2024-05-10T09:57:14.660334+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:57:14.660334+0000","last_undegraded":"2024-05-10T09:57:14.660334+0000","last_fullsized":"2024-05-10T09:57:14.660334+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614677+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:57:11.614677+0000","last_peered":"2024-05-10T09:57:11.614677+0000","last_clean":"2024-05-10T09:57:11.614677+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:57:11.614677+0000","last_undegraded":"2024-05-10T09:57:11.614677+0000","last_fullsized":"2024-05-10T09:57:11.614677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"89'9","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.865306+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:57:14.865306+0000","last_peered":"2024-05-10T09:57:14.865306+0000","last_clean":"2024-05-10T09:57:14.865306+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:57:14.865306+0000","last_undegraded":"2024-05-10T09:57:14.865306+0000","last_fullsized":"2024-05-10T09:57:14.865306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669591+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:57:14.669591+0000","last_peered":"2024-05-10T09:57:14.669591+0000","last_clean":"2024-05-10T09:57:14.669591+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:57:14.669591+0000","last_undegraded":"2024-05-10T09:57:14.669591+0000","last_fullsized":"2024-05-10T09:57:14.669591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"89'13","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.722985+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:57:14.722985+0000","last_peered":"2024-05-10T09:57:14.722985+0000","last_clean":"2024-05-10T09:57:14.722985+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:57:14.722985+0000","last_undegraded":"2024-05-10T09:57:14.722985+0000","last_fullsized":"2024-05-10T09:57:14.722985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662705+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:57:14.662705+0000","last_peered":"2024-05-10T09:57:14.662705+0000","last_clean":"2024-05-10T09:57:14.662705+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:57:14.662705+0000","last_undegraded":"2024-05-10T09:57:14.662705+0000","last_fullsized":"2024-05-10T09:57:14.662705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645636+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:57:14.645636+0000","last_peered":"2024-05-10T09:57:14.645636+0000","last_clean":"2024-05-10T09:57:14.645636+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:57:14.645636+0000","last_undegraded":"2024-05-10T09:57:14.645636+0000","last_fullsized":"2024-05-10T09:57:14.645636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644409+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:57:14.644409+0000","last_peered":"2024-05-10T09:57:14.644409+0000","last_clean":"2024-05-10T09:57:14.644409+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:57:14.644409+0000","last_undegraded":"2024-05-10T09:57:14.644409+0000","last_fullsized":"2024-05-10T09:57:14.644409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'7","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.045324+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:57:15.045324+0000","last_peered":"2024-05-10T09:57:15.045324+0000","last_clean":"2024-05-10T09:57:15.045324+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:57:15.045324+0000","last_undegraded":"2024-05-10T09:57:15.045324+0000","last_fullsized":"2024-05-10T09:57:15.045324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611725+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:57:11.611725+0000","last_peered":"2024-05-10T09:57:11.611725+0000","last_clean":"2024-05-10T09:57:11.611725+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:57:11.611725+0000","last_undegraded":"2024-05-10T09:57:11.611725+0000","last_fullsized":"2024-05-10T09:57:11.611725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"89'8","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.044920+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:57:15.044920+0000","last_peered":"2024-05-10T09:57:15.044920+0000","last_clean":"2024-05-10T09:57:15.044920+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:57:15.044920+0000","last_undegraded":"2024-05-10T09:57:15.044920+0000","last_fullsized":"2024-05-10T09:57:15.044920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614956+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:57:11.614956+0000","last_peered":"2024-05-10T09:57:11.614956+0000","last_clean":"2024-05-10T09:57:11.614956+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:57:11.614956+0000","last_undegraded":"2024-05-10T09:57:11.614956+0000","last_fullsized":"2024-05-10T09:57:11.614956+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":121,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658786+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:57:14.658786+0000","last_peered":"2024-05-10T09:57:14.658786+0000","last_clean":"2024-05-10T09:57:14.658786+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:57:14.658786+0000","last_undegraded":"2024-05-10T09:57:14.658786+0000","last_fullsized":"2024-05-10T09:57:14.658786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611206+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:57:11.611206+0000","last_peered":"2024-05-10T09:57:11.611206+0000","last_clean":"2024-05-10T09:57:11.611206+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:57:11.611206+0000","last_undegraded":"2024-05-10T09:57:11.611206+0000","last_fullsized":"2024-05-10T09:57:11.611206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'14","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.113881+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:57:15.113881+0000","last_peered":"2024-05-10T09:57:15.113881+0000","last_clean":"2024-05-10T09:57:15.113881+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:57:15.113881+0000","last_undegraded":"2024-05-10T09:57:15.113881+0000","last_fullsized":"2024-05-10T09:57:15.113881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978862+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:57:13.978862+0000","last_peered":"2024-05-10T09:57:13.978862+0000","last_clean":"2024-05-10T09:57:13.978862+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:57:13.978862+0000","last_undegraded":"2024-05-10T09:57:13.978862+0000","last_fullsized":"2024-05-10T09:57:13.978862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'11","reported_seq":56,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614627+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:57:11.614627+0000","last_peered":"2024-05-10T09:57:11.614627+0000","last_clean":"2024-05-10T09:57:11.614627+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:57:11.614627+0000","last_undegraded":"2024-05-10T09:57:11.614627+0000","last_fullsized":"2024-05-10T09:57:11.614627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":124,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660673+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:57:14.660673+0000","last_peered":"2024-05-10T09:57:14.660673+0000","last_clean":"2024-05-10T09:57:14.660673+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:57:14.660673+0000","last_undegraded":"2024-05-10T09:57:14.660673+0000","last_fullsized":"2024-05-10T09:57:14.660673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613323+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:57:11.613323+0000","last_peered":"2024-05-10T09:57:11.613323+0000","last_clean":"2024-05-10T09:57:11.613323+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:57:11.613323+0000","last_undegraded":"2024-05-10T09:57:11.613323+0000","last_fullsized":"2024-05-10T09:57:11.613323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.979108+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:57:13.979108+0000","last_peered":"2024-05-10T09:57:13.979108+0000","last_clean":"2024-05-10T09:57:13.979108+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:57:13.979108+0000","last_undegraded":"2024-05-10T09:57:13.979108+0000","last_fullsized":"2024-05-10T09:57:13.979108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'10","reported_seq":161,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.754927+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:57:14.754927+0000","last_peered":"2024-05-10T09:57:14.754927+0000","last_clean":"2024-05-10T09:57:14.754927+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:57:14.754927+0000","last_undegraded":"2024-05-10T09:57:14.754927+0000","last_fullsized":"2024-05-10T09:57:14.754927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.978145+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:57:13.978145+0000","last_peered":"2024-05-10T09:57:13.978145+0000","last_clean":"2024-05-10T09:57:13.978145+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:57:13.978145+0000","last_undegraded":"2024-05-10T09:57:13.978145+0000","last_fullsized":"2024-05-10T09:57:13.978145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'14","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.194965+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:57:15.194965+0000","last_peered":"2024-05-10T09:57:15.194965+0000","last_clean":"2024-05-10T09:57:15.194965+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:57:15.194965+0000","last_undegraded":"2024-05-10T09:57:15.194965+0000","last_fullsized":"2024-05-10T09:57:15.194965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'33","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.092894+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:57:15.092894+0000","last_peered":"2024-05-10T09:57:15.092894+0000","last_clean":"2024-05-10T09:57:15.092894+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:57:15.092894+0000","last_undegraded":"2024-05-10T09:57:15.092894+0000","last_fullsized":"2024-05-10T09:57:15.092894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":84,"num_write":49,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"79'6","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669696+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:57:14.669696+0000","last_peered":"2024-05-10T09:57:14.669696+0000","last_clean":"2024-05-10T09:57:14.669696+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:57:14.669696+0000","last_undegraded":"2024-05-10T09:57:14.669696+0000","last_fullsized":"2024-05-10T09:57:14.669696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.977880+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:57:13.977880+0000","last_peered":"2024-05-10T09:57:13.977880+0000","last_clean":"2024-05-10T09:57:13.977880+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:57:13.977880+0000","last_undegraded":"2024-05-10T09:57:13.977880+0000","last_fullsized":"2024-05-10T09:57:13.977880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'21","reported_seq":183,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.083034+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:57:15.083034+0000","last_peered":"2024-05-10T09:57:15.083034+0000","last_clean":"2024-05-10T09:57:15.083034+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:57:15.083034+0000","last_undegraded":"2024-05-10T09:57:15.083034+0000","last_fullsized":"2024-05-10T09:57:15.083034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":29,"num_read_kb":71692,"num_write":41,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":155,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.645409+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:57:14.645409+0000","last_peered":"2024-05-10T09:57:14.645409+0000","last_clean":"2024-05-10T09:57:14.645409+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:57:14.645409+0000","last_undegraded":"2024-05-10T09:57:14.645409+0000","last_fullsized":"2024-05-10T09:57:14.645409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.646233+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:57:14.646233+0000","last_peered":"2024-05-10T09:57:14.646233+0000","last_clean":"2024-05-10T09:57:14.646233+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:57:14.646233+0000","last_undegraded":"2024-05-10T09:57:14.646233+0000","last_fullsized":"2024-05-10T09:57:14.646233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":14338,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.611759+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:57:11.611759+0000","last_peered":"2024-05-10T09:57:11.611759+0000","last_clean":"2024-05-10T09:57:11.611759+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:57:11.611759+0000","last_undegraded":"2024-05-10T09:57:11.611759+0000","last_fullsized":"2024-05-10T09:57:11.611759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"79'8","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980539+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:57:13.980539+0000","last_peered":"2024-05-10T09:57:13.980539+0000","last_clean":"2024-05-10T09:57:13.980539+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:57:13.980539+0000","last_undegraded":"2024-05-10T09:57:13.980539+0000","last_fullsized":"2024-05-10T09:57:13.980539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":102,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.642741+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:57:14.642741+0000","last_peered":"2024-05-10T09:57:14.642741+0000","last_clean":"2024-05-10T09:57:14.642741+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:57:14.642741+0000","last_undegraded":"2024-05-10T09:57:14.642741+0000","last_fullsized":"2024-05-10T09:57:14.642741+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"89'6","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.091404+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:57:15.091404+0000","last_peered":"2024-05-10T09:57:15.091404+0000","last_clean":"2024-05-10T09:57:15.091404+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:57:15.091404+0000","last_undegraded":"2024-05-10T09:57:15.091404+0000","last_fullsized":"2024-05-10T09:57:15.091404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662566+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:57:14.662566+0000","last_peered":"2024-05-10T09:57:14.662566+0000","last_clean":"2024-05-10T09:57:14.662566+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:57:14.662566+0000","last_undegraded":"2024-05-10T09:57:14.662566+0000","last_fullsized":"2024-05-10T09:57:14.662566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'11","reported_seq":189,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.986587+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:57:14.986587+0000","last_peered":"2024-05-10T09:57:14.986587+0000","last_clean":"2024-05-10T09:57:14.986587+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:57:14.986587+0000","last_undegraded":"2024-05-10T09:57:14.986587+0000","last_fullsized":"2024-05-10T09:57:14.986587+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36870,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662658+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:57:14.662658+0000","last_peered":"2024-05-10T09:57:14.662658+0000","last_clean":"2024-05-10T09:57:14.662658+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:57:14.662658+0000","last_undegraded":"2024-05-10T09:57:14.662658+0000","last_fullsized":"2024-05-10T09:57:14.662658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.069886+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:57:15.069886+0000","last_peered":"2024-05-10T09:57:15.069886+0000","last_clean":"2024-05-10T09:57:15.069886+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:57:15.069886+0000","last_undegraded":"2024-05-10T09:57:15.069886+0000","last_fullsized":"2024-05-10T09:57:15.069886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":36870,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.613082+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:57:11.613082+0000","last_peered":"2024-05-10T09:57:11.613082+0000","last_clean":"2024-05-10T09:57:11.613082+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:57:11.613082+0000","last_undegraded":"2024-05-10T09:57:11.613082+0000","last_fullsized":"2024-05-10T09:57:11.613082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'16","reported_seq":202,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.146474+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:57:15.146474+0000","last_peered":"2024-05-10T09:57:15.146474+0000","last_clean":"2024-05-10T09:57:15.146474+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:57:15.146474+0000","last_undegraded":"2024-05-10T09:57:15.146474+0000","last_fullsized":"2024-05-10T09:57:15.146474+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643012+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:57:14.643012+0000","last_peered":"2024-05-10T09:57:14.643012+0000","last_clean":"2024-05-10T09:57:14.643012+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:57:14.643012+0000","last_undegraded":"2024-05-10T09:57:14.643012+0000","last_fullsized":"2024-05-10T09:57:14.643012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.859631+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:57:14.859631+0000","last_peered":"2024-05-10T09:57:14.859631+0000","last_clean":"2024-05-10T09:57:14.859631+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:57:14.859631+0000","last_undegraded":"2024-05-10T09:57:14.859631+0000","last_fullsized":"2024-05-10T09:57:14.859631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-10T09:57:11.614365+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:57:11.614365+0000","last_peered":"2024-05-10T09:57:11.614365+0000","last_clean":"2024-05-10T09:57:11.614365+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:57:11.614365+0000","last_undegraded":"2024-05-10T09:57:11.614365+0000","last_fullsized":"2024-05-10T09:57:11.614365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"79'8","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.661113+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:57:14.661113+0000","last_peered":"2024-05-10T09:57:14.661113+0000","last_clean":"2024-05-10T09:57:14.661113+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:57:14.661113+0000","last_undegraded":"2024-05-10T09:57:14.661113+0000","last_fullsized":"2024-05-10T09:57:14.661113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":10,"num_read_kb":30722,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.658372+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:57:14.658372+0000","last_peered":"2024-05-10T09:57:14.658372+0000","last_clean":"2024-05-10T09:57:14.658372+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:57:14.658372+0000","last_undegraded":"2024-05-10T09:57:14.658372+0000","last_fullsized":"2024-05-10T09:57:14.658372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'14","reported_seq":195,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.130769+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:57:15.130769+0000","last_peered":"2024-05-10T09:57:15.130769+0000","last_clean":"2024-05-10T09:57:15.130769+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:57:15.130769+0000","last_undegraded":"2024-05-10T09:57:15.130769+0000","last_fullsized":"2024-05-10T09:57:15.130769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":23,"num_read_kb":36880,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.660691+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:57:14.660691+0000","last_peered":"2024-05-10T09:57:14.660691+0000","last_clean":"2024-05-10T09:57:14.660691+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:57:14.660691+0000","last_undegraded":"2024-05-10T09:57:14.660691+0000","last_fullsized":"2024-05-10T09:57:14.660691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'13","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:15.223039+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:57:15.223039+0000","last_peered":"2024-05-10T09:57:15.223039+0000","last_clean":"2024-05-10T09:57:15.223039+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:57:15.223039+0000","last_undegraded":"2024-05-10T09:57:15.223039+0000","last_fullsized":"2024-05-10T09:57:15.223039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":34834,"num_write":43,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.644156+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:57:14.644156+0000","last_peered":"2024-05-10T09:57:14.644156+0000","last_clean":"2024-05-10T09:57:14.644156+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:57:14.644156+0000","last_undegraded":"2024-05-10T09:57:14.644156+0000","last_fullsized":"2024-05-10T09:57:14.644156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'9","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.643442+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:57:14.643442+0000","last_peered":"2024-05-10T09:57:14.643442+0000","last_clean":"2024-05-10T09:57:14.643442+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:57:14.643442+0000","last_undegraded":"2024-05-10T09:57:14.643442+0000","last_fullsized":"2024-05-10T09:57:14.643442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.657483+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:57:14.657483+0000","last_peered":"2024-05-10T09:57:14.657483+0000","last_clean":"2024-05-10T09:57:14.657483+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:57:14.657483+0000","last_undegraded":"2024-05-10T09:57:14.657483+0000","last_fullsized":"2024-05-10T09:57:14.657483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'14","reported_seq":168,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.974034+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:57:14.974034+0000","last_peered":"2024-05-10T09:57:14.974034+0000","last_clean":"2024-05-10T09:57:14.974034+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:57:14.974034+0000","last_undegraded":"2024-05-10T09:57:14.974034+0000","last_fullsized":"2024-05-10T09:57:14.974034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":36882,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'8","reported_seq":156,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.669064+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:57:14.669064+0000","last_peered":"2024-05-10T09:57:14.669064+0000","last_clean":"2024-05-10T09:57:14.669064+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:57:14.669064+0000","last_undegraded":"2024-05-10T09:57:14.669064+0000","last_fullsized":"2024-05-10T09:57:14.669064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.662569+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:57:14.662569+0000","last_peered":"2024-05-10T09:57:14.662569+0000","last_clean":"2024-05-10T09:57:14.662569+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:57:14.662569+0000","last_undegraded":"2024-05-10T09:57:14.662569+0000","last_fullsized":"2024-05-10T09:57:14.662569+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'8","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-10T09:57:13.980302+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:57:13.980302+0000","last_peered":"2024-05-10T09:57:13.980302+0000","last_clean":"2024-05-10T09:57:13.980302+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:57:13.980302+0000","last_undegraded":"2024-05-10T09:57:13.980302+0000","last_fullsized":"2024-05-10T09:57:13.980302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9,"num_read_kb":24578,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-10T09:57:14.670617+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:57:14.670617+0000","last_peered":"2024-05-10T09:57:14.670617+0000","last_clean":"2024-05-10T09:57:14.670617+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:57:14.670617+0000","last_undegraded":"2024-05-10T09:57:14.670617+0000","last_fullsized":"2024-05-10T09:57:14.670617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1081,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":26,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":198509,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":829,"num_read_kb":705,"num_write":559,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":185665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":520,"ondisk_log_size":520,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1345,"num_read_kb":996,"num_write":579,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":397,"ondisk_log_size":397,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1757413376,"num_objects":469,"num_object_clones":0,"num_object_copies":938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":469,"num_whiteouts":0,"num_read":995,"num_read_kb":2003484,"num_write":1731,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3598712832,"data_stored":3598712832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":631,"ondisk_log_size":631,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514160,"kb_used_data":482984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93857680,"statfs":{"total":96636764160,"available":96110264320,"internally_reserved":0,"allocated":494575616,"data_stored":494042106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":380392,"kb_used_data":349208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93991448,"statfs":{"total":96636764160,"available":96247242752,"internally_reserved":0,"allocated":357588992,"data_stored":357108641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509479,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":620072,"kb_used_data":588888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93751768,"statfs":{"total":96636764160,"available":96001810432,"internally_reserved":0,"allocated":603021312,"data_stored":602491107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285570,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":581648,"kb_used_data":549888,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":93790192,"statfs":{"total":96636764160,"available":96041156608,"internally_reserved":0,"allocated":563085312,"data_stored":562620723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":669276,"kb_used_data":633928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93702564,"statfs":{"total":96636764160,"available":95951425536,"internally_reserved":0,"allocated":649142272,"data_stored":648637245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":337456,"kb_used_data":302108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94034384,"statfs":{"total":96636764160,"available":96291209216,"internally_reserved":0,"allocated":309358592,"data_stored":308888004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":632988,"kb_used_data":597652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93738852,"statfs":{"total":96636764160,"available":95988584448,"internally_reserved":0,"allocated":611995648,"data_stored":611482112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386592,"kb_used_data":351248,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93985248,"statfs":{"total":96636764160,"available":96240893952,"internally_reserved":0,"allocated":359677952,"data_stored":359191327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":585105408,"data_stored":585105408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":358612992,"data_stored":358612992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":241172480,"data_stored":241172480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":551550976,"data_stored":551550976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":591396864,"data_stored":591396864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":522190848,"data_stored":522190848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":301989888,"data_stored":301989888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":446693376,"data_stored":446693376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":27145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":6620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":15428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":41465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":11424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":34363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":17029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":32191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:57:17.353 INFO:tasks.thrashosds.thrasher:Setting 7.1 to [3, 7] 2024-05-10T09:57:17.353 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '7.1', '3', '7'] 2024-05-10T09:57:17.353 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 7.1 3 7 2024-05-10T09:57:17.399 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:17.399 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:17.413 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-10T09:57:17.530 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:17.530 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:17.545 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-10T09:57:17.672 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:17.672 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:17.687 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-10T09:57:17.808 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:17.808 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:17.822 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-10T09:57:17.939 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:17.939 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:17.953 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-10T09:57:18.074 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:18.075 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:18.090 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-10T09:57:18.208 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:18.208 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:18.222 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-10T09:57:18.344 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:18.344 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:18.358 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-10T09:57:18.479 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:18.479 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:18.493 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-10T09:57:18.613 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:18.613 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:18.627 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-10T09:57:18.675 INFO:teuthology.orchestra.run.smithi042.stderr:set 7.1 pg_upmap mapping to [3,7] 2024-05-10T09:57:18.685 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-10T09:57:18.754 INFO:teuthology.orchestra.run.smithi181.stdout:ERROR: (22) Invalid argument 2024-05-10T09:57:18.754 INFO:teuthology.orchestra.run.smithi181.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-10T09:57:19.678 INFO:teuthology.orchestra.run.smithi042.stderr:noscrub is unset 2024-05-10T09:57:19.706 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-10T09:57:20.690 INFO:teuthology.orchestra.run.smithi042.stderr:nodeep-scrub is unset 2024-05-10T09:57:48.698 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-05-10T09:57:48.850 INFO:teuthology.orchestra.run.smithi042.stdout:mon.a: {} 2024-05-10T09:57:48.851 INFO:teuthology.orchestra.run.smithi042.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T09:57:48.865 INFO:teuthology.orchestra.run.smithi042.stdout:mon.b: {} 2024-05-10T09:57:48.865 INFO:teuthology.orchestra.run.smithi042.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T09:57:48.876 INFO:teuthology.orchestra.run.smithi042.stdout:mon.c: {} 2024-05-10T09:57:48.876 INFO:teuthology.orchestra.run.smithi042.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-10T09:57:48.894 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-10T09:57:49.348 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.0 to 1 (10000) 2024-05-10T09:57:49.373 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-05-10T09:57:50.360 INFO:teuthology.orchestra.run.smithi042.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-05-10T09:57:50.387 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-10T09:57:51.388 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.1 to 1 (10000) 2024-05-10T09:57:51.411 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-05-10T09:57:52.381 INFO:teuthology.orchestra.run.smithi042.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-05-10T09:57:52.410 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-10T09:57:53.393 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.2 to 1 (10000) 2024-05-10T09:57:53.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-05-10T09:57:54.418 INFO:teuthology.orchestra.run.smithi042.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-05-10T09:57:54.446 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-10T09:57:55.415 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.3 to 1 (10000) 2024-05-10T09:57:55.448 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-05-10T09:57:56.446 INFO:teuthology.orchestra.run.smithi042.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-05-10T09:57:56.469 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-10T09:57:57.449 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.5 to 1 (10000) 2024-05-10T09:57:57.472 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-05-10T09:57:58.466 INFO:teuthology.orchestra.run.smithi042.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-05-10T09:57:58.490 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-10T09:57:59.468 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.6 to 1 (10000) 2024-05-10T09:57:59.500 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-05-10T09:58:00.487 INFO:teuthology.orchestra.run.smithi042.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-05-10T09:58:00.513 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-10T09:58:01.495 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.7 to 1 (10000) 2024-05-10T09:58:01.522 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-05-10T09:58:02.514 INFO:teuthology.orchestra.run.smithi042.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-05-10T09:58:02.538 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-10T09:58:03.516 INFO:teuthology.orchestra.run.smithi042.stderr:reweighted osd.4 to 1 (10000) 2024-05-10T09:58:03.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-05-10T09:58:04.531 INFO:teuthology.orchestra.run.smithi042.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-05-10T09:58:04.556 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-05-10T09:58:04.556 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-05-10T09:58:04.557 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-05-10T09:58:04.557 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-05-10T09:58:04.557 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T09:58:04.557 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T09:58:04.869 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:04.869 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":110,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:58:04.517834+0000","last_up_change":"2024-05-10T09:57:08.584897+0000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T09:54:26.214148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T09:54:31.575111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-10T09:54:38.369592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-10T09:54:39.953615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-10T09:54:41.893433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-10T09:54:43.804869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-10T09:54:45.696998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-10T09:54:47.845498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6801","nonce":3913515164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6803","nonce":3913515164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6807","nonce":3913515164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6805","nonce":3913515164}]},"public_addr":"172.21.15.42:6801/3913515164","cluster_addr":"172.21.15.42:6803/3913515164","heartbeat_back_addr":"172.21.15.42:6807/3913515164","heartbeat_front_addr":"172.21.15.42:6805/3913515164","state":["exists","up"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6811","nonce":2743871003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6815","nonce":2743871003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6823","nonce":2743871003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6819","nonce":2743871003}]},"public_addr":"172.21.15.42:6811/2743871003","cluster_addr":"172.21.15.42:6815/2743871003","heartbeat_back_addr":"172.21.15.42:6823/2743871003","heartbeat_front_addr":"172.21.15.42:6819/2743871003","state":["exists","up"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6810","nonce":3683869396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6814","nonce":3683869396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6822","nonce":3683869396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6818","nonce":3683869396}]},"public_addr":"172.21.15.42:6810/3683869396","cluster_addr":"172.21.15.42:6814/3683869396","heartbeat_back_addr":"172.21.15.42:6822/3683869396","heartbeat_front_addr":"172.21.15.42:6818/3683869396","state":["exists","up"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6825","nonce":125865404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6827","nonce":125865404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6831","nonce":125865404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6829","nonce":125865404}]},"public_addr":"172.21.15.42:6825/125865404","cluster_addr":"172.21.15.42:6827/125865404","heartbeat_back_addr":"172.21.15.42:6831/125865404","heartbeat_front_addr":"172.21.15.42:6829/125865404","state":["exists","up"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":69,"up_from":83,"up_thru":83,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6825","nonce":3297710412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6827","nonce":3297710412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6831","nonce":3297710412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6829","nonce":3297710412}]},"public_addr":"172.21.15.181:6825/3297710412","cluster_addr":"172.21.15.181:6827/3297710412","heartbeat_back_addr":"172.21.15.181:6831/3297710412","heartbeat_front_addr":"172.21.15.181:6829/3297710412","state":["exists","up"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6809","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6812","nonce":893112190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6816","nonce":893112190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6824","nonce":893112190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6819","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6821","nonce":893112190}]},"public_addr":"172.21.15.181:6812/893112190","cluster_addr":"172.21.15.181:6816/893112190","heartbeat_back_addr":"172.21.15.181:6824/893112190","heartbeat_front_addr":"172.21.15.181:6821/893112190","state":["exists","up"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6802","nonce":1622048387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6807","nonce":1622048387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6820","nonce":1622048387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6813","nonce":1622048387}]},"public_addr":"172.21.15.181:6802/1622048387","cluster_addr":"172.21.15.181:6807/1622048387","heartbeat_back_addr":"172.21.15.181:6820/1622048387","heartbeat_front_addr":"172.21.15.181:6813/1622048387","state":["exists","up"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6801","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6803","nonce":3508953868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6805","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6806","nonce":3508953868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6815","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6818","nonce":3508953868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6811","nonce":3508953868}]},"public_addr":"172.21.15.181:6803/3508953868","cluster_addr":"172.21.15.181:6806/3508953868","heartbeat_back_addr":"172.21.15.181:6818/3508953868","heartbeat_front_addr":"172.21.15.181:6811/3508953868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.309797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:20.776872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.163014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.344100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.292805+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.412990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.456741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.437150+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1b","osds":[1,5]},{"pgid":"7.1","osds":[3,7]}],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:58:04.889 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T09:58:04.890 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T09:58:05.190 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:05.190 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":110,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:58:04.517834+0000","last_up_change":"2024-05-10T09:57:08.584897+0000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T09:54:26.214148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T09:54:31.575111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-10T09:54:38.369592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-10T09:54:39.953615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-10T09:54:41.893433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-10T09:54:43.804869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-10T09:54:45.696998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-10T09:54:47.845498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6801","nonce":3913515164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6803","nonce":3913515164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6807","nonce":3913515164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6805","nonce":3913515164}]},"public_addr":"172.21.15.42:6801/3913515164","cluster_addr":"172.21.15.42:6803/3913515164","heartbeat_back_addr":"172.21.15.42:6807/3913515164","heartbeat_front_addr":"172.21.15.42:6805/3913515164","state":["exists","up"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6811","nonce":2743871003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6815","nonce":2743871003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6823","nonce":2743871003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6819","nonce":2743871003}]},"public_addr":"172.21.15.42:6811/2743871003","cluster_addr":"172.21.15.42:6815/2743871003","heartbeat_back_addr":"172.21.15.42:6823/2743871003","heartbeat_front_addr":"172.21.15.42:6819/2743871003","state":["exists","up"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6810","nonce":3683869396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6814","nonce":3683869396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6822","nonce":3683869396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6818","nonce":3683869396}]},"public_addr":"172.21.15.42:6810/3683869396","cluster_addr":"172.21.15.42:6814/3683869396","heartbeat_back_addr":"172.21.15.42:6822/3683869396","heartbeat_front_addr":"172.21.15.42:6818/3683869396","state":["exists","up"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6825","nonce":125865404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6827","nonce":125865404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6831","nonce":125865404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6829","nonce":125865404}]},"public_addr":"172.21.15.42:6825/125865404","cluster_addr":"172.21.15.42:6827/125865404","heartbeat_back_addr":"172.21.15.42:6831/125865404","heartbeat_front_addr":"172.21.15.42:6829/125865404","state":["exists","up"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":69,"up_from":83,"up_thru":83,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6825","nonce":3297710412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6827","nonce":3297710412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6831","nonce":3297710412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6829","nonce":3297710412}]},"public_addr":"172.21.15.181:6825/3297710412","cluster_addr":"172.21.15.181:6827/3297710412","heartbeat_back_addr":"172.21.15.181:6831/3297710412","heartbeat_front_addr":"172.21.15.181:6829/3297710412","state":["exists","up"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6809","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6812","nonce":893112190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6816","nonce":893112190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6824","nonce":893112190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6819","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6821","nonce":893112190}]},"public_addr":"172.21.15.181:6812/893112190","cluster_addr":"172.21.15.181:6816/893112190","heartbeat_back_addr":"172.21.15.181:6824/893112190","heartbeat_front_addr":"172.21.15.181:6821/893112190","state":["exists","up"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6802","nonce":1622048387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6807","nonce":1622048387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6820","nonce":1622048387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6813","nonce":1622048387}]},"public_addr":"172.21.15.181:6802/1622048387","cluster_addr":"172.21.15.181:6807/1622048387","heartbeat_back_addr":"172.21.15.181:6820/1622048387","heartbeat_front_addr":"172.21.15.181:6813/1622048387","state":["exists","up"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6801","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6803","nonce":3508953868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6805","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6806","nonce":3508953868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6815","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6818","nonce":3508953868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6811","nonce":3508953868}]},"public_addr":"172.21.15.181:6803/3508953868","cluster_addr":"172.21.15.181:6806/3508953868","heartbeat_back_addr":"172.21.15.181:6818/3508953868","heartbeat_front_addr":"172.21.15.181:6811/3508953868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.309797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:20.776872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.163014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.344100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.292805+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.412990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.456741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.437150+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1b","osds":[1,5]},{"pgid":"7.1","osds":[3,7]}],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:58:05.211 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T09:58:05.211 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T09:58:05.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T09:58:05.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T09:58:05.213 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T09:58:05.213 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T09:58:05.214 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T09:58:05.214 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T09:58:05.476 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:05.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T09:58:05.486 INFO:teuthology.orchestra.run.smithi042.stdout:64424509490 2024-05-10T09:58:05.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T09:58:05.498 INFO:teuthology.orchestra.run.smithi042.stdout:356482285581 2024-05-10T09:58:05.498 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T09:58:05.499 INFO:teuthology.orchestra.run.smithi042.stdout:64424509489 2024-05-10T09:58:05.500 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T09:58:05.501 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:05.501 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T09:58:05.502 INFO:teuthology.orchestra.run.smithi042.stdout:60129542193 2024-05-10T09:58:05.502 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T09:58:05.506 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:05.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T09:58:05.511 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:05.512 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T09:58:06.015 INFO:teuthology.orchestra.run.smithi042.stdout:64424509486 2024-05-10T09:58:06.025 INFO:teuthology.orchestra.run.smithi042.stdout:64424509486 2024-05-10T09:58:06.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509486 for osd.6 2024-05-10T09:58:06.044 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:06.050 INFO:teuthology.orchestra.run.smithi042.stdout:356482285580 2024-05-10T09:58:06.050 INFO:teuthology.orchestra.run.smithi042.stdout:60129542192 2024-05-10T09:58:06.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509486 for osd.3 2024-05-10T09:58:06.058 INFO:teuthology.orchestra.run.smithi042.stdout:64424509486 2024-05-10T09:58:06.060 INFO:teuthology.orchestra.run.smithi042.stdout:64424509487 2024-05-10T09:58:06.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509490 got 64424509488 for osd.5 2024-05-10T09:58:06.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 356482285581 got 356482285580 for osd.4 2024-05-10T09:58:06.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542192 for osd.1 2024-05-10T09:58:06.090 INFO:teuthology.orchestra.run.smithi042.stdout:64424509486 2024-05-10T09:58:06.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509489 got 64424509487 for osd.0 2024-05-10T09:58:06.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509486 for osd.2 2024-05-10T09:58:06.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509486 for osd.7 2024-05-10T09:58:07.045 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T09:58:07.059 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T09:58:07.073 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T09:58:07.080 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T09:58:07.088 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T09:58:07.092 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T09:58:07.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T09:58:07.108 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T09:58:07.553 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:07.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509488 for osd.6 2024-05-10T09:58:07.578 DEBUG:teuthology.parallel:result is None 2024-05-10T09:58:07.638 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:07.639 INFO:teuthology.orchestra.run.smithi042.stdout:60129542193 2024-05-10T09:58:07.642 INFO:teuthology.orchestra.run.smithi042.stdout:356482285581 2024-05-10T09:58:07.650 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:07.660 INFO:teuthology.orchestra.run.smithi042.stdout:64424509490 2024-05-10T09:58:07.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542193 got 60129542193 for osd.1 2024-05-10T09:58:07.674 DEBUG:teuthology.parallel:result is None 2024-05-10T09:58:07.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509488 for osd.7 2024-05-10T09:58:07.675 DEBUG:teuthology.parallel:result is None 2024-05-10T09:58:07.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509488 for osd.3 2024-05-10T09:58:07.678 DEBUG:teuthology.parallel:result is None 2024-05-10T09:58:07.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 356482285581 got 356482285581 for osd.4 2024-05-10T09:58:07.680 INFO:teuthology.orchestra.run.smithi042.stdout:64424509488 2024-05-10T09:58:07.680 DEBUG:teuthology.parallel:result is None 2024-05-10T09:58:07.682 INFO:teuthology.orchestra.run.smithi042.stdout:64424509489 2024-05-10T09:58:07.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509490 got 64424509490 for osd.5 2024-05-10T09:58:07.688 DEBUG:teuthology.parallel:result is None 2024-05-10T09:58:07.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509488 got 64424509488 for osd.2 2024-05-10T09:58:07.700 DEBUG:teuthology.parallel:result is None 2024-05-10T09:58:07.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509489 got 64424509489 for osd.0 2024-05-10T09:58:07.702 DEBUG:teuthology.parallel:result is None 2024-05-10T09:58:07.702 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-10T09:58:07.702 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:58:08.070 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:08.077 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:58:08.085 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-05-10T09:58:06.263781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613457,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3802,"num_read_kb":2005881,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1935,"ondisk_log_size":1935,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3477700,"kb_used_data":3206872,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":751497020,"statfs":{"total":773094113280,"available":769532948480,"internally_reserved":0,"allocated":3283836928,"data_stored":3279063562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.778115"},"pg_stats":[{"pgid":"3.3f","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657807+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:58:04.657807+0000","last_peered":"2024-05-10T09:58:04.657807+0000","last_clean":"2024-05-10T09:58:04.657807+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:04.657807+0000","last_undegraded":"2024-05-10T09:58:04.657807+0000","last_fullsized":"2024-05-10T09:58:04.657807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650396+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:58:04.650396+0000","last_peered":"2024-05-10T09:58:04.650396+0000","last_clean":"2024-05-10T09:58:04.650396+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:04.650396+0000","last_undegraded":"2024-05-10T09:58:04.650396+0000","last_fullsized":"2024-05-10T09:58:04.650396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'9","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647529+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:58:04.647529+0000","last_peered":"2024-05-10T09:58:04.647529+0000","last_clean":"2024-05-10T09:58:04.647529+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:04.647529+0000","last_undegraded":"2024-05-10T09:58:04.647529+0000","last_fullsized":"2024-05-10T09:58:04.647529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651881+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:58:04.651881+0000","last_peered":"2024-05-10T09:58:04.651881+0000","last_clean":"2024-05-10T09:58:04.651881+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:04.651881+0000","last_undegraded":"2024-05-10T09:58:04.651881+0000","last_fullsized":"2024-05-10T09:58:04.651881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652086+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:58:04.652086+0000","last_peered":"2024-05-10T09:58:04.652086+0000","last_clean":"2024-05-10T09:58:04.652086+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:04.652086+0000","last_undegraded":"2024-05-10T09:58:04.652086+0000","last_fullsized":"2024-05-10T09:58:04.652086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'12","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654181+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:58:04.654181+0000","last_peered":"2024-05-10T09:58:04.654181+0000","last_clean":"2024-05-10T09:58:04.654181+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:04.654181+0000","last_undegraded":"2024-05-10T09:58:04.654181+0000","last_fullsized":"2024-05-10T09:58:04.654181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649254+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:58:04.649254+0000","last_peered":"2024-05-10T09:58:04.649254+0000","last_clean":"2024-05-10T09:58:04.649254+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:04.649254+0000","last_undegraded":"2024-05-10T09:58:04.649254+0000","last_fullsized":"2024-05-10T09:58:04.649254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'16","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654430+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:58:04.654430+0000","last_peered":"2024-05-10T09:58:04.654430+0000","last_clean":"2024-05-10T09:58:04.654430+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:04.654430+0000","last_undegraded":"2024-05-10T09:58:04.654430+0000","last_fullsized":"2024-05-10T09:58:04.654430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":43032,"num_write":56,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655633+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:58:04.655633+0000","last_peered":"2024-05-10T09:58:04.655633+0000","last_clean":"2024-05-10T09:58:04.655633+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:04.655633+0000","last_undegraded":"2024-05-10T09:58:04.655633+0000","last_fullsized":"2024-05-10T09:58:04.655633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'11","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651688+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:58:04.651688+0000","last_peered":"2024-05-10T09:58:04.651688+0000","last_clean":"2024-05-10T09:58:04.651688+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:04.651688+0000","last_undegraded":"2024-05-10T09:58:04.651688+0000","last_fullsized":"2024-05-10T09:58:04.651688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":36876,"num_write":31,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529657+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:58:04.529657+0000","last_peered":"2024-05-10T09:58:04.529657+0000","last_clean":"2024-05-10T09:58:04.529657+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:04.529657+0000","last_undegraded":"2024-05-10T09:58:04.529657+0000","last_fullsized":"2024-05-10T09:58:04.529657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'6","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528952+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:58:04.528952+0000","last_peered":"2024-05-10T09:58:04.528952+0000","last_clean":"2024-05-10T09:58:04.528952+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:04.528952+0000","last_undegraded":"2024-05-10T09:58:04.528952+0000","last_fullsized":"2024-05-10T09:58:04.528952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656752+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:58:04.656752+0000","last_peered":"2024-05-10T09:58:04.656752+0000","last_clean":"2024-05-10T09:58:04.656752+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:04.656752+0000","last_undegraded":"2024-05-10T09:58:04.656752+0000","last_fullsized":"2024-05-10T09:58:04.656752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"78'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528643+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:58:04.528643+0000","last_peered":"2024-05-10T09:58:04.528643+0000","last_clean":"2024-05-10T09:58:04.528643+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:04.528643+0000","last_undegraded":"2024-05-10T09:58:04.528643+0000","last_fullsized":"2024-05-10T09:58:04.528643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528564+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:58:04.528564+0000","last_peered":"2024-05-10T09:58:04.528564+0000","last_clean":"2024-05-10T09:58:04.528564+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:04.528564+0000","last_undegraded":"2024-05-10T09:58:04.528564+0000","last_fullsized":"2024-05-10T09:58:04.528564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527703+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:58:04.527703+0000","last_peered":"2024-05-10T09:58:04.527703+0000","last_clean":"2024-05-10T09:58:04.527703+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:04.527703+0000","last_undegraded":"2024-05-10T09:58:04.527703+0000","last_fullsized":"2024-05-10T09:58:04.527703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657912+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:58:04.657912+0000","last_peered":"2024-05-10T09:58:04.657912+0000","last_clean":"2024-05-10T09:58:04.657912+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:04.657912+0000","last_undegraded":"2024-05-10T09:58:04.657912+0000","last_fullsized":"2024-05-10T09:58:04.657912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652120+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:58:04.652120+0000","last_peered":"2024-05-10T09:58:04.652120+0000","last_clean":"2024-05-10T09:58:04.652120+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:04.652120+0000","last_undegraded":"2024-05-10T09:58:04.652120+0000","last_fullsized":"2024-05-10T09:58:04.652120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'7","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652595+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:58:04.652595+0000","last_peered":"2024-05-10T09:58:04.652595+0000","last_clean":"2024-05-10T09:58:04.652595+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:04.652595+0000","last_undegraded":"2024-05-10T09:58:04.652595+0000","last_fullsized":"2024-05-10T09:58:04.652595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651965+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:58:04.651965+0000","last_peered":"2024-05-10T09:58:04.651965+0000","last_clean":"2024-05-10T09:58:04.651965+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:04.651965+0000","last_undegraded":"2024-05-10T09:58:04.651965+0000","last_fullsized":"2024-05-10T09:58:04.651965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"79'5","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657131+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:58:04.657131+0000","last_peered":"2024-05-10T09:58:04.657131+0000","last_clean":"2024-05-10T09:58:04.657131+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:04.657131+0000","last_undegraded":"2024-05-10T09:58:04.657131+0000","last_fullsized":"2024-05-10T09:58:04.657131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527325+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:58:04.527325+0000","last_peered":"2024-05-10T09:58:04.527325+0000","last_clean":"2024-05-10T09:58:04.527325+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:04.527325+0000","last_undegraded":"2024-05-10T09:58:04.527325+0000","last_fullsized":"2024-05-10T09:58:04.527325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'19","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529749+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:58:04.529749+0000","last_peered":"2024-05-10T09:58:04.529749+0000","last_clean":"2024-05-10T09:58:04.529749+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:04.529749+0000","last_undegraded":"2024-05-10T09:58:04.529749+0000","last_fullsized":"2024-05-10T09:58:04.529749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":25,"num_read_kb":61452,"num_write":39,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":231,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526267+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:58:04.526267+0000","last_peered":"2024-05-10T09:58:04.526267+0000","last_clean":"2024-05-10T09:58:04.526267+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:04.526267+0000","last_undegraded":"2024-05-10T09:58:04.526267+0000","last_fullsized":"2024-05-10T09:58:04.526267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:28.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529605+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:58:04.529605+0000","last_peered":"2024-05-10T09:58:04.529605+0000","last_clean":"2024-05-10T09:58:04.529605+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:04.529605+0000","last_undegraded":"2024-05-10T09:58:04.529605+0000","last_fullsized":"2024-05-10T09:58:04.529605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529511+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:58:04.529511+0000","last_peered":"2024-05-10T09:58:04.529511+0000","last_clean":"2024-05-10T09:58:04.529511+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:04.529511+0000","last_undegraded":"2024-05-10T09:58:04.529511+0000","last_fullsized":"2024-05-10T09:58:04.529511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"79'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650655+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:58:04.650655+0000","last_peered":"2024-05-10T09:58:04.650655+0000","last_clean":"2024-05-10T09:58:04.650655+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:04.650655+0000","last_undegraded":"2024-05-10T09:58:04.650655+0000","last_fullsized":"2024-05-10T09:58:04.650655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528133+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:58:04.528133+0000","last_peered":"2024-05-10T09:58:04.528133+0000","last_clean":"2024-05-10T09:58:04.528133+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:04.528133+0000","last_undegraded":"2024-05-10T09:58:04.528133+0000","last_fullsized":"2024-05-10T09:58:04.528133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530920+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:58:04.530920+0000","last_peered":"2024-05-10T09:58:04.530920+0000","last_clean":"2024-05-10T09:58:04.530920+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:04.530920+0000","last_undegraded":"2024-05-10T09:58:04.530920+0000","last_fullsized":"2024-05-10T09:58:04.530920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'10","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654850+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:58:04.654850+0000","last_peered":"2024-05-10T09:58:04.654850+0000","last_clean":"2024-05-10T09:58:04.654850+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:04.654850+0000","last_undegraded":"2024-05-10T09:58:04.654850+0000","last_fullsized":"2024-05-10T09:58:04.654850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":18442,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655953+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:58:04.655953+0000","last_peered":"2024-05-10T09:58:04.655953+0000","last_clean":"2024-05-10T09:58:04.655953+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:04.655953+0000","last_undegraded":"2024-05-10T09:58:04.655953+0000","last_fullsized":"2024-05-10T09:58:04.655953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652475+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:58:04.652475+0000","last_peered":"2024-05-10T09:58:04.652475+0000","last_clean":"2024-05-10T09:58:04.652475+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:04.652475+0000","last_undegraded":"2024-05-10T09:58:04.652475+0000","last_fullsized":"2024-05-10T09:58:04.652475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655116+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:58:04.655116+0000","last_peered":"2024-05-10T09:58:04.655116+0000","last_clean":"2024-05-10T09:58:04.655116+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:04.655116+0000","last_undegraded":"2024-05-10T09:58:04.655116+0000","last_fullsized":"2024-05-10T09:58:04.655116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650200+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:58:04.650200+0000","last_peered":"2024-05-10T09:58:04.650200+0000","last_clean":"2024-05-10T09:58:04.650200+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:04.650200+0000","last_undegraded":"2024-05-10T09:58:04.650200+0000","last_fullsized":"2024-05-10T09:58:04.650200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657074+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:58:04.657074+0000","last_peered":"2024-05-10T09:58:04.657074+0000","last_clean":"2024-05-10T09:58:04.657074+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:04.657074+0000","last_undegraded":"2024-05-10T09:58:04.657074+0000","last_fullsized":"2024-05-10T09:58:04.657074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650910+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:58:04.650910+0000","last_peered":"2024-05-10T09:58:04.650910+0000","last_clean":"2024-05-10T09:58:04.650910+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:04.650910+0000","last_undegraded":"2024-05-10T09:58:04.650910+0000","last_fullsized":"2024-05-10T09:58:04.650910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530366+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:58:04.530366+0000","last_peered":"2024-05-10T09:58:04.530366+0000","last_clean":"2024-05-10T09:58:04.530366+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:04.530366+0000","last_undegraded":"2024-05-10T09:58:04.530366+0000","last_fullsized":"2024-05-10T09:58:04.530366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":93,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530616+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:58:04.530616+0000","last_peered":"2024-05-10T09:58:04.530616+0000","last_clean":"2024-05-10T09:58:04.530616+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:04.530616+0000","last_undegraded":"2024-05-10T09:58:04.530616+0000","last_fullsized":"2024-05-10T09:58:04.530616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530644+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:58:04.530644+0000","last_peered":"2024-05-10T09:58:04.530644+0000","last_clean":"2024-05-10T09:58:04.530644+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:04.530644+0000","last_undegraded":"2024-05-10T09:58:04.530644+0000","last_fullsized":"2024-05-10T09:58:04.530644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649999+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:58:04.649999+0000","last_peered":"2024-05-10T09:58:04.649999+0000","last_clean":"2024-05-10T09:58:04.649999+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:04.649999+0000","last_undegraded":"2024-05-10T09:58:04.649999+0000","last_fullsized":"2024-05-10T09:58:04.649999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652885+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:58:04.652885+0000","last_peered":"2024-05-10T09:58:04.652885+0000","last_clean":"2024-05-10T09:58:04.652885+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:04.652885+0000","last_undegraded":"2024-05-10T09:58:04.652885+0000","last_fullsized":"2024-05-10T09:58:04.652885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'13","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652338+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:58:04.652338+0000","last_peered":"2024-05-10T09:58:04.652338+0000","last_clean":"2024-05-10T09:58:04.652338+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:04.652338+0000","last_undegraded":"2024-05-10T09:58:04.652338+0000","last_fullsized":"2024-05-10T09:58:04.652338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.532396+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:58:04.532396+0000","last_peered":"2024-05-10T09:58:04.532396+0000","last_clean":"2024-05-10T09:58:04.532396+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:04.532396+0000","last_undegraded":"2024-05-10T09:58:04.532396+0000","last_fullsized":"2024-05-10T09:58:04.532396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525699+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:58:04.525699+0000","last_peered":"2024-05-10T09:58:04.525699+0000","last_clean":"2024-05-10T09:58:04.525699+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:04.525699+0000","last_undegraded":"2024-05-10T09:58:04.525699+0000","last_fullsized":"2024-05-10T09:58:04.525699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:28.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"89'14","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654514+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:58:04.654514+0000","last_peered":"2024-05-10T09:58:04.654514+0000","last_clean":"2024-05-10T09:58:04.654514+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:04.654514+0000","last_undegraded":"2024-05-10T09:58:04.654514+0000","last_fullsized":"2024-05-10T09:58:04.654514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529188+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:58:04.529188+0000","last_peered":"2024-05-10T09:58:04.529188+0000","last_clean":"2024-05-10T09:58:04.529188+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:04.529188+0000","last_undegraded":"2024-05-10T09:58:04.529188+0000","last_fullsized":"2024-05-10T09:58:04.529188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531253+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:58:04.531253+0000","last_peered":"2024-05-10T09:58:04.531253+0000","last_clean":"2024-05-10T09:58:04.531253+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:04.531253+0000","last_undegraded":"2024-05-10T09:58:04.531253+0000","last_fullsized":"2024-05-10T09:58:04.531253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654828+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:58:04.654828+0000","last_peered":"2024-05-10T09:58:04.654828+0000","last_clean":"2024-05-10T09:58:04.654828+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:04.654828+0000","last_undegraded":"2024-05-10T09:58:04.654828+0000","last_fullsized":"2024-05-10T09:58:04.654828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656656+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:58:04.656656+0000","last_peered":"2024-05-10T09:58:04.656656+0000","last_clean":"2024-05-10T09:58:04.656656+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:04.656656+0000","last_undegraded":"2024-05-10T09:58:04.656656+0000","last_fullsized":"2024-05-10T09:58:04.656656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"89'13","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655008+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:58:04.655008+0000","last_peered":"2024-05-10T09:58:04.655008+0000","last_clean":"2024-05-10T09:58:04.655008+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:04.655008+0000","last_undegraded":"2024-05-10T09:58:04.655008+0000","last_fullsized":"2024-05-10T09:58:04.655008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"89'14","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528311+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:58:04.528311+0000","last_peered":"2024-05-10T09:58:04.528311+0000","last_clean":"2024-05-10T09:58:04.528311+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:04.528311+0000","last_undegraded":"2024-05-10T09:58:04.528311+0000","last_fullsized":"2024-05-10T09:58:04.528311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651101+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:58:04.651101+0000","last_peered":"2024-05-10T09:58:04.651101+0000","last_clean":"2024-05-10T09:58:04.651101+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:04.651101+0000","last_undegraded":"2024-05-10T09:58:04.651101+0000","last_fullsized":"2024-05-10T09:58:04.651101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'8","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658091+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:58:04.658091+0000","last_peered":"2024-05-10T09:58:04.658091+0000","last_clean":"2024-05-10T09:58:04.658091+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:04.658091+0000","last_undegraded":"2024-05-10T09:58:04.658091+0000","last_fullsized":"2024-05-10T09:58:04.658091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651083+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:58:04.651083+0000","last_peered":"2024-05-10T09:58:04.651083+0000","last_clean":"2024-05-10T09:58:04.651083+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:04.651083+0000","last_undegraded":"2024-05-10T09:58:04.651083+0000","last_fullsized":"2024-05-10T09:58:04.651083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"89'23","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650787+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:58:04.650787+0000","last_peered":"2024-05-10T09:58:04.650787+0000","last_clean":"2024-05-10T09:58:04.650787+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:04.650787+0000","last_undegraded":"2024-05-10T09:58:04.650787+0000","last_fullsized":"2024-05-10T09:58:04.650787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647210+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:58:04.647210+0000","last_peered":"2024-05-10T09:58:04.647210+0000","last_clean":"2024-05-10T09:58:04.647210+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:04.647210+0000","last_undegraded":"2024-05-10T09:58:04.647210+0000","last_fullsized":"2024-05-10T09:58:04.647210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653582+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:58:04.653582+0000","last_peered":"2024-05-10T09:58:04.653582+0000","last_clean":"2024-05-10T09:58:04.653582+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:04.653582+0000","last_undegraded":"2024-05-10T09:58:04.653582+0000","last_fullsized":"2024-05-10T09:58:04.653582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527921+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:58:04.527921+0000","last_peered":"2024-05-10T09:58:04.527921+0000","last_clean":"2024-05-10T09:58:04.527921+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:04.527921+0000","last_undegraded":"2024-05-10T09:58:04.527921+0000","last_fullsized":"2024-05-10T09:58:04.527921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'13","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656481+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:58:04.656481+0000","last_peered":"2024-05-10T09:58:04.656481+0000","last_clean":"2024-05-10T09:58:04.656481+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:04.656481+0000","last_undegraded":"2024-05-10T09:58:04.656481+0000","last_fullsized":"2024-05-10T09:58:04.656481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525029+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:58:04.525029+0000","last_peered":"2024-05-10T09:58:04.525029+0000","last_clean":"2024-05-10T09:58:04.525029+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:04.525029+0000","last_undegraded":"2024-05-10T09:58:04.525029+0000","last_fullsized":"2024-05-10T09:58:04.525029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"89'15","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531332+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:58:04.531332+0000","last_peered":"2024-05-10T09:58:04.531332+0000","last_clean":"2024-05-10T09:58:04.531332+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:04.531332+0000","last_undegraded":"2024-05-10T09:58:04.531332+0000","last_fullsized":"2024-05-10T09:58:04.531332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527842+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:58:04.527842+0000","last_peered":"2024-05-10T09:58:04.527842+0000","last_clean":"2024-05-10T09:58:04.527842+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:04.527842+0000","last_undegraded":"2024-05-10T09:58:04.527842+0000","last_fullsized":"2024-05-10T09:58:04.527842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660834+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:58:04.660834+0000","last_peered":"2024-05-10T09:58:04.660834+0000","last_clean":"2024-05-10T09:58:04.660834+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:04.660834+0000","last_undegraded":"2024-05-10T09:58:04.660834+0000","last_fullsized":"2024-05-10T09:58:04.660834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655192+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:58:04.655192+0000","last_peered":"2024-05-10T09:58:04.655192+0000","last_clean":"2024-05-10T09:58:04.655192+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:04.655192+0000","last_undegraded":"2024-05-10T09:58:04.655192+0000","last_fullsized":"2024-05-10T09:58:04.655192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656460+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:58:04.656460+0000","last_peered":"2024-05-10T09:58:04.656460+0000","last_clean":"2024-05-10T09:58:04.656460+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:04.656460+0000","last_undegraded":"2024-05-10T09:58:04.656460+0000","last_fullsized":"2024-05-10T09:58:04.656460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527977+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:58:04.527977+0000","last_peered":"2024-05-10T09:58:04.527977+0000","last_clean":"2024-05-10T09:58:04.527977+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:04.527977+0000","last_undegraded":"2024-05-10T09:58:04.527977+0000","last_fullsized":"2024-05-10T09:58:04.527977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"89'19","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650811+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:58:04.650811+0000","last_peered":"2024-05-10T09:58:04.650811+0000","last_clean":"2024-05-10T09:58:04.650811+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:04.650811+0000","last_undegraded":"2024-05-10T09:58:04.650811+0000","last_fullsized":"2024-05-10T09:58:04.650811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"89'14","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648057+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:58:04.648057+0000","last_peered":"2024-05-10T09:58:04.648057+0000","last_clean":"2024-05-10T09:58:04.648057+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:04.648057+0000","last_undegraded":"2024-05-10T09:58:04.648057+0000","last_fullsized":"2024-05-10T09:58:04.648057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652535+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:58:04.652535+0000","last_peered":"2024-05-10T09:58:04.652535+0000","last_clean":"2024-05-10T09:58:04.652535+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:04.652535+0000","last_undegraded":"2024-05-10T09:58:04.652535+0000","last_fullsized":"2024-05-10T09:58:04.652535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651204+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:58:04.651204+0000","last_peered":"2024-05-10T09:58:04.651204+0000","last_clean":"2024-05-10T09:58:04.651204+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:04.651204+0000","last_undegraded":"2024-05-10T09:58:04.651204+0000","last_fullsized":"2024-05-10T09:58:04.651204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'15","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654833+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:58:04.654833+0000","last_peered":"2024-05-10T09:58:04.654833+0000","last_clean":"2024-05-10T09:58:04.654833+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:04.654833+0000","last_undegraded":"2024-05-10T09:58:04.654833+0000","last_fullsized":"2024-05-10T09:58:04.654833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":49170,"num_write":45,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526171+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:58:04.526171+0000","last_peered":"2024-05-10T09:58:04.526171+0000","last_clean":"2024-05-10T09:58:04.526171+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:04.526171+0000","last_undegraded":"2024-05-10T09:58:04.526171+0000","last_fullsized":"2024-05-10T09:58:04.526171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:37.269066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"89'24","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648751+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:58:04.648751+0000","last_peered":"2024-05-10T09:58:04.648751+0000","last_clean":"2024-05-10T09:58:04.648751+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:04.648751+0000","last_undegraded":"2024-05-10T09:58:04.648751+0000","last_fullsized":"2024-05-10T09:58:04.648751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.524822+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:58:04.524822+0000","last_peered":"2024-05-10T09:58:04.524822+0000","last_clean":"2024-05-10T09:58:04.524822+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:04.524822+0000","last_undegraded":"2024-05-10T09:58:04.524822+0000","last_fullsized":"2024-05-10T09:58:04.524822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646874+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:58:04.646874+0000","last_peered":"2024-05-10T09:58:04.646874+0000","last_clean":"2024-05-10T09:58:04.646874+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:04.646874+0000","last_undegraded":"2024-05-10T09:58:04.646874+0000","last_fullsized":"2024-05-10T09:58:04.646874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529824+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:58:04.529824+0000","last_peered":"2024-05-10T09:58:04.529824+0000","last_clean":"2024-05-10T09:58:04.529824+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:04.529824+0000","last_undegraded":"2024-05-10T09:58:04.529824+0000","last_fullsized":"2024-05-10T09:58:04.529824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528967+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:58:04.528967+0000","last_peered":"2024-05-10T09:58:04.528967+0000","last_clean":"2024-05-10T09:58:04.528967+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:04.528967+0000","last_undegraded":"2024-05-10T09:58:04.528967+0000","last_fullsized":"2024-05-10T09:58:04.528967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526622+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:58:04.526622+0000","last_peered":"2024-05-10T09:58:04.526622+0000","last_clean":"2024-05-10T09:58:04.526622+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:04.526622+0000","last_undegraded":"2024-05-10T09:58:04.526622+0000","last_fullsized":"2024-05-10T09:58:04.526622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"94'19","reported_seq":114,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530696+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:58:04.530696+0000","last_peered":"2024-05-10T09:58:04.530696+0000","last_clean":"2024-05-10T09:58:04.530696+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:04.530696+0000","last_undegraded":"2024-05-10T09:58:04.530696+0000","last_fullsized":"2024-05-10T09:58:04.530696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":33,"num_write":28,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653112+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:58:04.653112+0000","last_peered":"2024-05-10T09:58:04.653112+0000","last_clean":"2024-05-10T09:58:04.653112+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:04.653112+0000","last_undegraded":"2024-05-10T09:58:04.653112+0000","last_fullsized":"2024-05-10T09:58:04.653112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525936+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:58:04.525936+0000","last_peered":"2024-05-10T09:58:04.525936+0000","last_clean":"2024-05-10T09:58:04.525936+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:04.525936+0000","last_undegraded":"2024-05-10T09:58:04.525936+0000","last_fullsized":"2024-05-10T09:58:04.525936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529936+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:58:04.529936+0000","last_peered":"2024-05-10T09:58:04.529936+0000","last_clean":"2024-05-10T09:58:04.529936+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:04.529936+0000","last_undegraded":"2024-05-10T09:58:04.529936+0000","last_fullsized":"2024-05-10T09:58:04.529936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'7","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655796+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:58:04.655796+0000","last_peered":"2024-05-10T09:58:04.655796+0000","last_clean":"2024-05-10T09:58:04.655796+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:04.655796+0000","last_undegraded":"2024-05-10T09:58:04.655796+0000","last_fullsized":"2024-05-10T09:58:04.655796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646639+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:58:04.646639+0000","last_peered":"2024-05-10T09:58:04.646639+0000","last_clean":"2024-05-10T09:58:04.646639+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:04.646639+0000","last_undegraded":"2024-05-10T09:58:04.646639+0000","last_fullsized":"2024-05-10T09:58:04.646639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"89'22","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528148+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:58:04.528148+0000","last_peered":"2024-05-10T09:58:04.528148+0000","last_clean":"2024-05-10T09:58:04.528148+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:04.528148+0000","last_undegraded":"2024-05-10T09:58:04.528148+0000","last_fullsized":"2024-05-10T09:58:04.528148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11923,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"89'14","reported_seq":249,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529183+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:58:04.529183+0000","last_peered":"2024-05-10T09:58:04.529183+0000","last_clean":"2024-05-10T09:58:04.529183+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:04.529183+0000","last_undegraded":"2024-05-10T09:58:04.529183+0000","last_fullsized":"2024-05-10T09:58:04.529183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648186+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:58:04.648186+0000","last_peered":"2024-05-10T09:58:04.648186+0000","last_clean":"2024-05-10T09:58:04.648186+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:04.648186+0000","last_undegraded":"2024-05-10T09:58:04.648186+0000","last_fullsized":"2024-05-10T09:58:04.648186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530492+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:58:04.530492+0000","last_peered":"2024-05-10T09:58:04.530492+0000","last_clean":"2024-05-10T09:58:04.530492+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:04.530492+0000","last_undegraded":"2024-05-10T09:58:04.530492+0000","last_fullsized":"2024-05-10T09:58:04.530492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"78'3","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528266+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:58:04.528266+0000","last_peered":"2024-05-10T09:58:04.528266+0000","last_clean":"2024-05-10T09:58:04.528266+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:04.528266+0000","last_undegraded":"2024-05-10T09:58:04.528266+0000","last_fullsized":"2024-05-10T09:58:04.528266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657217+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:58:04.657217+0000","last_peered":"2024-05-10T09:58:04.657217+0000","last_clean":"2024-05-10T09:58:04.657217+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:04.657217+0000","last_undegraded":"2024-05-10T09:58:04.657217+0000","last_fullsized":"2024-05-10T09:58:04.657217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528642+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:58:04.528642+0000","last_peered":"2024-05-10T09:58:04.528642+0000","last_clean":"2024-05-10T09:58:04.528642+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:04.528642+0000","last_undegraded":"2024-05-10T09:58:04.528642+0000","last_fullsized":"2024-05-10T09:58:04.528642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"89'14","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655833+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:58:04.655833+0000","last_peered":"2024-05-10T09:58:04.655833+0000","last_clean":"2024-05-10T09:58:04.655833+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:04.655833+0000","last_undegraded":"2024-05-10T09:58:04.655833+0000","last_fullsized":"2024-05-10T09:58:04.655833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528502+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:58:04.528502+0000","last_peered":"2024-05-10T09:58:04.528502+0000","last_clean":"2024-05-10T09:58:04.528502+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:04.528502+0000","last_undegraded":"2024-05-10T09:58:04.528502+0000","last_fullsized":"2024-05-10T09:58:04.528502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647951+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:58:04.647951+0000","last_peered":"2024-05-10T09:58:04.647951+0000","last_clean":"2024-05-10T09:58:04.647951+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:04.647951+0000","last_undegraded":"2024-05-10T09:58:04.647951+0000","last_fullsized":"2024-05-10T09:58:04.647951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"89'13","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529478+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:58:04.529478+0000","last_peered":"2024-05-10T09:58:04.529478+0000","last_clean":"2024-05-10T09:58:04.529478+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:04.529478+0000","last_undegraded":"2024-05-10T09:58:04.529478+0000","last_fullsized":"2024-05-10T09:58:04.529478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530226+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:58:04.530226+0000","last_peered":"2024-05-10T09:58:04.530226+0000","last_clean":"2024-05-10T09:58:04.530226+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:04.530226+0000","last_undegraded":"2024-05-10T09:58:04.530226+0000","last_fullsized":"2024-05-10T09:58:04.530226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"89'24","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655681+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:58:04.655681+0000","last_peered":"2024-05-10T09:58:04.655681+0000","last_clean":"2024-05-10T09:58:04.655681+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:04.655681+0000","last_undegraded":"2024-05-10T09:58:04.655681+0000","last_fullsized":"2024-05-10T09:58:04.655681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652778+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:58:04.652778+0000","last_peered":"2024-05-10T09:58:04.652778+0000","last_clean":"2024-05-10T09:58:04.652778+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:04.652778+0000","last_undegraded":"2024-05-10T09:58:04.652778+0000","last_fullsized":"2024-05-10T09:58:04.652778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646928+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:58:04.646928+0000","last_peered":"2024-05-10T09:58:04.646928+0000","last_clean":"2024-05-10T09:58:04.646928+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:04.646928+0000","last_undegraded":"2024-05-10T09:58:04.646928+0000","last_fullsized":"2024-05-10T09:58:04.646928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":238,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656709+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:58:04.656709+0000","last_peered":"2024-05-10T09:58:04.656709+0000","last_clean":"2024-05-10T09:58:04.656709+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:04.656709+0000","last_undegraded":"2024-05-10T09:58:04.656709+0000","last_fullsized":"2024-05-10T09:58:04.656709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":285,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651075+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:58:04.651075+0000","last_peered":"2024-05-10T09:58:04.651075+0000","last_clean":"2024-05-10T09:58:04.651075+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:04.651075+0000","last_undegraded":"2024-05-10T09:58:04.651075+0000","last_fullsized":"2024-05-10T09:58:04.651075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651354+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:58:04.651354+0000","last_peered":"2024-05-10T09:58:04.651354+0000","last_clean":"2024-05-10T09:58:04.651354+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:04.651354+0000","last_undegraded":"2024-05-10T09:58:04.651354+0000","last_fullsized":"2024-05-10T09:58:04.651354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528876+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:58:04.528876+0000","last_peered":"2024-05-10T09:58:04.528876+0000","last_clean":"2024-05-10T09:58:04.528876+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:04.528876+0000","last_undegraded":"2024-05-10T09:58:04.528876+0000","last_fullsized":"2024-05-10T09:58:04.528876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657379+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:58:04.657379+0000","last_peered":"2024-05-10T09:58:04.657379+0000","last_clean":"2024-05-10T09:58:04.657379+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:04.657379+0000","last_undegraded":"2024-05-10T09:58:04.657379+0000","last_fullsized":"2024-05-10T09:58:04.657379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"89'31","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657459+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:58:04.657459+0000","last_peered":"2024-05-10T09:58:04.657459+0000","last_clean":"2024-05-10T09:58:04.657459+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:04.657459+0000","last_undegraded":"2024-05-10T09:58:04.657459+0000","last_fullsized":"2024-05-10T09:58:04.657459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":70,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652543+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:58:04.652543+0000","last_peered":"2024-05-10T09:58:04.652543+0000","last_clean":"2024-05-10T09:58:04.652543+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:04.652543+0000","last_undegraded":"2024-05-10T09:58:04.652543+0000","last_fullsized":"2024-05-10T09:58:04.652543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651894+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:58:04.651894+0000","last_peered":"2024-05-10T09:58:04.651894+0000","last_clean":"2024-05-10T09:58:04.651894+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:04.651894+0000","last_undegraded":"2024-05-10T09:58:04.651894+0000","last_fullsized":"2024-05-10T09:58:04.651894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652782+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:58:04.652782+0000","last_peered":"2024-05-10T09:58:04.652782+0000","last_clean":"2024-05-10T09:58:04.652782+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:04.652782+0000","last_undegraded":"2024-05-10T09:58:04.652782+0000","last_fullsized":"2024-05-10T09:58:04.652782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650560+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:58:04.650560+0000","last_peered":"2024-05-10T09:58:04.650560+0000","last_clean":"2024-05-10T09:58:04.650560+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:04.650560+0000","last_undegraded":"2024-05-10T09:58:04.650560+0000","last_fullsized":"2024-05-10T09:58:04.650560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'12","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649016+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:58:04.649016+0000","last_peered":"2024-05-10T09:58:04.649016+0000","last_clean":"2024-05-10T09:58:04.649016+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:04.649016+0000","last_undegraded":"2024-05-10T09:58:04.649016+0000","last_fullsized":"2024-05-10T09:58:04.649016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.015437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658097+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:58:04.658097+0000","last_peered":"2024-05-10T09:58:04.658097+0000","last_clean":"2024-05-10T09:58:04.658097+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:04.658097+0000","last_undegraded":"2024-05-10T09:58:04.658097+0000","last_fullsized":"2024-05-10T09:58:04.658097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"89'51","reported_seq":282,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646574+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:58:04.646574+0000","last_peered":"2024-05-10T09:58:04.646574+0000","last_clean":"2024-05-10T09:58:04.646574+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:04.646574+0000","last_undegraded":"2024-05-10T09:58:04.646574+0000","last_fullsized":"2024-05-10T09:58:04.646574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20102,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":82,"num_read_kb":100,"num_write":54,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654776+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:58:04.654776+0000","last_peered":"2024-05-10T09:58:04.654776+0000","last_clean":"2024-05-10T09:58:04.654776+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:04.654776+0000","last_undegraded":"2024-05-10T09:58:04.654776+0000","last_fullsized":"2024-05-10T09:58:04.654776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647636+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:58:04.647636+0000","last_peered":"2024-05-10T09:58:04.647636+0000","last_clean":"2024-05-10T09:58:04.647636+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:04.647636+0000","last_undegraded":"2024-05-10T09:58:04.647636+0000","last_fullsized":"2024-05-10T09:58:04.647636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648061+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:58:04.648061+0000","last_peered":"2024-05-10T09:58:04.648061+0000","last_clean":"2024-05-10T09:58:04.648061+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:04.648061+0000","last_undegraded":"2024-05-10T09:58:04.648061+0000","last_fullsized":"2024-05-10T09:58:04.648061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529781+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:58:04.529781+0000","last_peered":"2024-05-10T09:58:04.529781+0000","last_clean":"2024-05-10T09:58:04.529781+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:04.529781+0000","last_undegraded":"2024-05-10T09:58:04.529781+0000","last_fullsized":"2024-05-10T09:58:04.529781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'10","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645674+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:58:04.645674+0000","last_peered":"2024-05-10T09:58:04.645674+0000","last_clean":"2024-05-10T09:58:04.645674+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:04.645674+0000","last_undegraded":"2024-05-10T09:58:04.645674+0000","last_fullsized":"2024-05-10T09:58:04.645674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529576+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:58:04.529576+0000","last_peered":"2024-05-10T09:58:04.529576+0000","last_clean":"2024-05-10T09:58:04.529576+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:04.529576+0000","last_undegraded":"2024-05-10T09:58:04.529576+0000","last_fullsized":"2024-05-10T09:58:04.529576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655521+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:58:04.655521+0000","last_peered":"2024-05-10T09:58:04.655521+0000","last_clean":"2024-05-10T09:58:04.655521+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:04.655521+0000","last_undegraded":"2024-05-10T09:58:04.655521+0000","last_fullsized":"2024-05-10T09:58:04.655521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651737+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:58:04.651737+0000","last_peered":"2024-05-10T09:58:04.651737+0000","last_clean":"2024-05-10T09:58:04.651737+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:04.651737+0000","last_undegraded":"2024-05-10T09:58:04.651737+0000","last_fullsized":"2024-05-10T09:58:04.651737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:06.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530498+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:58:04.530498+0000","last_peered":"2024-05-10T09:58:04.530498+0000","last_clean":"2024-05-10T09:58:04.530498+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:04.530498+0000","last_undegraded":"2024-05-10T09:58:04.530498+0000","last_fullsized":"2024-05-10T09:58:04.530498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647231+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:58:04.647231+0000","last_peered":"2024-05-10T09:58:04.647231+0000","last_clean":"2024-05-10T09:58:04.647231+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:04.647231+0000","last_undegraded":"2024-05-10T09:58:04.647231+0000","last_fullsized":"2024-05-10T09:58:04.647231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653676+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:58:04.653676+0000","last_peered":"2024-05-10T09:58:04.653676+0000","last_clean":"2024-05-10T09:58:04.653676+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:04.653676+0000","last_undegraded":"2024-05-10T09:58:04.653676+0000","last_fullsized":"2024-05-10T09:58:04.653676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'10","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651974+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:58:04.651974+0000","last_peered":"2024-05-10T09:58:04.651974+0000","last_clean":"2024-05-10T09:58:04.651974+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:04.651974+0000","last_undegraded":"2024-05-10T09:58:04.651974+0000","last_fullsized":"2024-05-10T09:58:04.651974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528089+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:58:04.528089+0000","last_peered":"2024-05-10T09:58:04.528089+0000","last_clean":"2024-05-10T09:58:04.528089+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:04.528089+0000","last_undegraded":"2024-05-10T09:58:04.528089+0000","last_fullsized":"2024-05-10T09:58:04.528089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655245+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:58:04.655245+0000","last_peered":"2024-05-10T09:58:04.655245+0000","last_clean":"2024-05-10T09:58:04.655245+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:04.655245+0000","last_undegraded":"2024-05-10T09:58:04.655245+0000","last_fullsized":"2024-05-10T09:58:04.655245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649808+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:58:04.649808+0000","last_peered":"2024-05-10T09:58:04.649808+0000","last_clean":"2024-05-10T09:58:04.649808+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:04.649808+0000","last_undegraded":"2024-05-10T09:58:04.649808+0000","last_fullsized":"2024-05-10T09:58:04.649808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646914+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:58:04.646914+0000","last_peered":"2024-05-10T09:58:04.646914+0000","last_clean":"2024-05-10T09:58:04.646914+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:04.646914+0000","last_undegraded":"2024-05-10T09:58:04.646914+0000","last_fullsized":"2024-05-10T09:58:04.646914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657604+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:58:04.657604+0000","last_peered":"2024-05-10T09:58:04.657604+0000","last_clean":"2024-05-10T09:58:04.657604+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:04.657604+0000","last_undegraded":"2024-05-10T09:58:04.657604+0000","last_fullsized":"2024-05-10T09:58:04.657604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648281+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:58:04.648281+0000","last_peered":"2024-05-10T09:58:04.648281+0000","last_clean":"2024-05-10T09:58:04.648281+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:04.648281+0000","last_undegraded":"2024-05-10T09:58:04.648281+0000","last_fullsized":"2024-05-10T09:58:04.648281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649720+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:58:04.649720+0000","last_peered":"2024-05-10T09:58:04.649720+0000","last_clean":"2024-05-10T09:58:04.649720+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:04.649720+0000","last_undegraded":"2024-05-10T09:58:04.649720+0000","last_fullsized":"2024-05-10T09:58:04.649720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"89'28","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646802+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:58:04.646802+0000","last_peered":"2024-05-10T09:58:04.646802+0000","last_clean":"2024-05-10T09:58:04.646802+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:04.646802+0000","last_undegraded":"2024-05-10T09:58:04.646802+0000","last_fullsized":"2024-05-10T09:58:04.646802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11529,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529488+0000","last_change":"2024-05-10T09:57:19.676469+0000","last_active":"2024-05-10T09:58:04.529488+0000","last_peered":"2024-05-10T09:58:04.529488+0000","last_clean":"2024-05-10T09:58:04.529488+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:58:04.529488+0000","last_undegraded":"2024-05-10T09:58:04.529488+0000","last_fullsized":"2024-05-10T09:58:04.529488+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:07.877322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651956+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:58:04.651956+0000","last_peered":"2024-05-10T09:58:04.651956+0000","last_clean":"2024-05-10T09:58:04.651956+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:04.651956+0000","last_undegraded":"2024-05-10T09:58:04.651956+0000","last_fullsized":"2024-05-10T09:58:04.651956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651063+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:58:04.651063+0000","last_peered":"2024-05-10T09:58:04.651063+0000","last_clean":"2024-05-10T09:58:04.651063+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:04.651063+0000","last_undegraded":"2024-05-10T09:58:04.651063+0000","last_fullsized":"2024-05-10T09:58:04.651063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"77'3","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647490+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:58:04.647490+0000","last_peered":"2024-05-10T09:58:04.647490+0000","last_clean":"2024-05-10T09:58:04.647490+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:04.647490+0000","last_undegraded":"2024-05-10T09:58:04.647490+0000","last_fullsized":"2024-05-10T09:58:04.647490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657133+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:58:04.657133+0000","last_peered":"2024-05-10T09:58:04.657133+0000","last_clean":"2024-05-10T09:58:04.657133+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:04.657133+0000","last_undegraded":"2024-05-10T09:58:04.657133+0000","last_fullsized":"2024-05-10T09:58:04.657133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656463+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:58:04.656463+0000","last_peered":"2024-05-10T09:58:04.656463+0000","last_clean":"2024-05-10T09:58:04.656463+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:04.656463+0000","last_undegraded":"2024-05-10T09:58:04.656463+0000","last_fullsized":"2024-05-10T09:58:04.656463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645778+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:58:04.645778+0000","last_peered":"2024-05-10T09:58:04.645778+0000","last_clean":"2024-05-10T09:58:04.645778+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:04.645778+0000","last_undegraded":"2024-05-10T09:58:04.645778+0000","last_fullsized":"2024-05-10T09:58:04.645778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"89'14","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650634+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:58:04.650634+0000","last_peered":"2024-05-10T09:58:04.650634+0000","last_clean":"2024-05-10T09:58:04.650634+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:04.650634+0000","last_undegraded":"2024-05-10T09:58:04.650634+0000","last_fullsized":"2024-05-10T09:58:04.650634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531521+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:58:04.531521+0000","last_peered":"2024-05-10T09:58:04.531521+0000","last_clean":"2024-05-10T09:58:04.531521+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:04.531521+0000","last_undegraded":"2024-05-10T09:58:04.531521+0000","last_fullsized":"2024-05-10T09:58:04.531521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527816+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:58:04.527816+0000","last_peered":"2024-05-10T09:58:04.527816+0000","last_clean":"2024-05-10T09:58:04.527816+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:04.527816+0000","last_undegraded":"2024-05-10T09:58:04.527816+0000","last_fullsized":"2024-05-10T09:58:04.527816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527678+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:58:04.527678+0000","last_peered":"2024-05-10T09:58:04.527678+0000","last_clean":"2024-05-10T09:58:04.527678+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:04.527678+0000","last_undegraded":"2024-05-10T09:58:04.527678+0000","last_fullsized":"2024-05-10T09:58:04.527678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647640+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:58:04.647640+0000","last_peered":"2024-05-10T09:58:04.647640+0000","last_clean":"2024-05-10T09:58:04.647640+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:04.647640+0000","last_undegraded":"2024-05-10T09:58:04.647640+0000","last_fullsized":"2024-05-10T09:58:04.647640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528907+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:58:04.528907+0000","last_peered":"2024-05-10T09:58:04.528907+0000","last_clean":"2024-05-10T09:58:04.528907+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:04.528907+0000","last_undegraded":"2024-05-10T09:58:04.528907+0000","last_fullsized":"2024-05-10T09:58:04.528907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":99,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529276+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:58:04.529276+0000","last_peered":"2024-05-10T09:58:04.529276+0000","last_clean":"2024-05-10T09:58:04.529276+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:04.529276+0000","last_undegraded":"2024-05-10T09:58:04.529276+0000","last_fullsized":"2024-05-10T09:58:04.529276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"89'14","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531743+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:58:04.531743+0000","last_peered":"2024-05-10T09:58:04.531743+0000","last_clean":"2024-05-10T09:58:04.531743+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:04.531743+0000","last_undegraded":"2024-05-10T09:58:04.531743+0000","last_fullsized":"2024-05-10T09:58:04.531743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651782+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:58:04.651782+0000","last_peered":"2024-05-10T09:58:04.651782+0000","last_clean":"2024-05-10T09:58:04.651782+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:04.651782+0000","last_undegraded":"2024-05-10T09:58:04.651782+0000","last_fullsized":"2024-05-10T09:58:04.651782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529167+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:58:04.529167+0000","last_peered":"2024-05-10T09:58:04.529167+0000","last_clean":"2024-05-10T09:58:04.529167+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:04.529167+0000","last_undegraded":"2024-05-10T09:58:04.529167+0000","last_fullsized":"2024-05-10T09:58:04.529167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652922+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:58:04.652922+0000","last_peered":"2024-05-10T09:58:04.652922+0000","last_clean":"2024-05-10T09:58:04.652922+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:04.652922+0000","last_undegraded":"2024-05-10T09:58:04.652922+0000","last_fullsized":"2024-05-10T09:58:04.652922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":41,"num_read_kb":59422,"num_write":71,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656494+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:58:04.656494+0000","last_peered":"2024-05-10T09:58:04.656494+0000","last_clean":"2024-05-10T09:58:04.656494+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:04.656494+0000","last_undegraded":"2024-05-10T09:58:04.656494+0000","last_fullsized":"2024-05-10T09:58:04.656494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527204+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:58:04.527204+0000","last_peered":"2024-05-10T09:58:04.527204+0000","last_clean":"2024-05-10T09:58:04.527204+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:04.527204+0000","last_undegraded":"2024-05-10T09:58:04.527204+0000","last_fullsized":"2024-05-10T09:58:04.527204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"89'35","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653416+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:58:04.653416+0000","last_peered":"2024-05-10T09:58:04.653416+0000","last_clean":"2024-05-10T09:58:04.653416+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:04.653416+0000","last_undegraded":"2024-05-10T09:58:04.653416+0000","last_fullsized":"2024-05-10T09:58:04.653416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17853,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":59,"num_read_kb":66,"num_write":42,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528099+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:58:04.528099+0000","last_peered":"2024-05-10T09:58:04.528099+0000","last_clean":"2024-05-10T09:58:04.528099+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:04.528099+0000","last_undegraded":"2024-05-10T09:58:04.528099+0000","last_fullsized":"2024-05-10T09:58:04.528099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650656+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:58:04.650656+0000","last_peered":"2024-05-10T09:58:04.650656+0000","last_clean":"2024-05-10T09:58:04.650656+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:04.650656+0000","last_undegraded":"2024-05-10T09:58:04.650656+0000","last_fullsized":"2024-05-10T09:58:04.650656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652973+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:58:04.652973+0000","last_peered":"2024-05-10T09:58:04.652973+0000","last_clean":"2024-05-10T09:58:04.652973+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:04.652973+0000","last_undegraded":"2024-05-10T09:58:04.652973+0000","last_fullsized":"2024-05-10T09:58:04.652973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529250+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:58:04.529250+0000","last_peered":"2024-05-10T09:58:04.529250+0000","last_clean":"2024-05-10T09:58:04.529250+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:04.529250+0000","last_undegraded":"2024-05-10T09:58:04.529250+0000","last_fullsized":"2024-05-10T09:58:04.529250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"79'7","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528880+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:58:04.528880+0000","last_peered":"2024-05-10T09:58:04.528880+0000","last_clean":"2024-05-10T09:58:04.528880+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:04.528880+0000","last_undegraded":"2024-05-10T09:58:04.528880+0000","last_fullsized":"2024-05-10T09:58:04.528880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647012+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:58:04.647012+0000","last_peered":"2024-05-10T09:58:04.647012+0000","last_clean":"2024-05-10T09:58:04.647012+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:04.647012+0000","last_undegraded":"2024-05-10T09:58:04.647012+0000","last_fullsized":"2024-05-10T09:58:04.647012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"89'17","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527493+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:58:04.527493+0000","last_peered":"2024-05-10T09:58:04.527493+0000","last_clean":"2024-05-10T09:58:04.527493+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:04.527493+0000","last_undegraded":"2024-05-10T09:58:04.527493+0000","last_fullsized":"2024-05-10T09:58:04.527493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526191+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:58:04.526191+0000","last_peered":"2024-05-10T09:58:04.526191+0000","last_clean":"2024-05-10T09:58:04.526191+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:04.526191+0000","last_undegraded":"2024-05-10T09:58:04.526191+0000","last_fullsized":"2024-05-10T09:58:04.526191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527534+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:58:04.527534+0000","last_peered":"2024-05-10T09:58:04.527534+0000","last_clean":"2024-05-10T09:58:04.527534+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:04.527534+0000","last_undegraded":"2024-05-10T09:58:04.527534+0000","last_fullsized":"2024-05-10T09:58:04.527534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646813+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:58:04.646813+0000","last_peered":"2024-05-10T09:58:04.646813+0000","last_clean":"2024-05-10T09:58:04.646813+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:04.646813+0000","last_undegraded":"2024-05-10T09:58:04.646813+0000","last_fullsized":"2024-05-10T09:58:04.646813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656190+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:58:04.656190+0000","last_peered":"2024-05-10T09:58:04.656190+0000","last_clean":"2024-05-10T09:58:04.656190+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:04.656190+0000","last_undegraded":"2024-05-10T09:58:04.656190+0000","last_fullsized":"2024-05-10T09:58:04.656190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":30738,"num_write":42,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530067+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:58:04.530067+0000","last_peered":"2024-05-10T09:58:04.530067+0000","last_clean":"2024-05-10T09:58:04.530067+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:04.530067+0000","last_undegraded":"2024-05-10T09:58:04.530067+0000","last_fullsized":"2024-05-10T09:58:04.530067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646603+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:58:04.646603+0000","last_peered":"2024-05-10T09:58:04.646603+0000","last_clean":"2024-05-10T09:58:04.646603+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:04.646603+0000","last_undegraded":"2024-05-10T09:58:04.646603+0000","last_fullsized":"2024-05-10T09:58:04.646603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651652+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:58:04.651652+0000","last_peered":"2024-05-10T09:58:04.651652+0000","last_clean":"2024-05-10T09:58:04.651652+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:04.651652+0000","last_undegraded":"2024-05-10T09:58:04.651652+0000","last_fullsized":"2024-05-10T09:58:04.651652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651848+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:58:04.651848+0000","last_peered":"2024-05-10T09:58:04.651848+0000","last_clean":"2024-05-10T09:58:04.651848+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:04.651848+0000","last_undegraded":"2024-05-10T09:58:04.651848+0000","last_fullsized":"2024-05-10T09:58:04.651848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530746+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:58:04.530746+0000","last_peered":"2024-05-10T09:58:04.530746+0000","last_clean":"2024-05-10T09:58:04.530746+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:04.530746+0000","last_undegraded":"2024-05-10T09:58:04.530746+0000","last_fullsized":"2024-05-10T09:58:04.530746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'9","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657229+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:58:04.657229+0000","last_peered":"2024-05-10T09:58:04.657229+0000","last_clean":"2024-05-10T09:58:04.657229+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:04.657229+0000","last_undegraded":"2024-05-10T09:58:04.657229+0000","last_fullsized":"2024-05-10T09:58:04.657229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649736+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:58:04.649736+0000","last_peered":"2024-05-10T09:58:04.649736+0000","last_clean":"2024-05-10T09:58:04.649736+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:04.649736+0000","last_undegraded":"2024-05-10T09:58:04.649736+0000","last_fullsized":"2024-05-10T09:58:04.649736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"89'18","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529286+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:58:04.529286+0000","last_peered":"2024-05-10T09:58:04.529286+0000","last_clean":"2024-05-10T09:58:04.529286+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:04.529286+0000","last_undegraded":"2024-05-10T09:58:04.529286+0000","last_fullsized":"2024-05-10T09:58:04.529286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654262+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:58:04.654262+0000","last_peered":"2024-05-10T09:58:04.654262+0000","last_clean":"2024-05-10T09:58:04.654262+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:04.654262+0000","last_undegraded":"2024-05-10T09:58:04.654262+0000","last_fullsized":"2024-05-10T09:58:04.654262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653292+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:58:04.653292+0000","last_peered":"2024-05-10T09:58:04.653292+0000","last_clean":"2024-05-10T09:58:04.653292+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:04.653292+0000","last_undegraded":"2024-05-10T09:58:04.653292+0000","last_fullsized":"2024-05-10T09:58:04.653292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528375+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:58:04.528375+0000","last_peered":"2024-05-10T09:58:04.528375+0000","last_clean":"2024-05-10T09:58:04.528375+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:04.528375+0000","last_undegraded":"2024-05-10T09:58:04.528375+0000","last_fullsized":"2024-05-10T09:58:04.528375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653595+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:58:04.653595+0000","last_peered":"2024-05-10T09:58:04.653595+0000","last_clean":"2024-05-10T09:58:04.653595+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:04.653595+0000","last_undegraded":"2024-05-10T09:58:04.653595+0000","last_fullsized":"2024-05-10T09:58:04.653595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40978,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654529+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:58:04.654529+0000","last_peered":"2024-05-10T09:58:04.654529+0000","last_clean":"2024-05-10T09:58:04.654529+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:04.654529+0000","last_undegraded":"2024-05-10T09:58:04.654529+0000","last_fullsized":"2024-05-10T09:58:04.654529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"89'15","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653237+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:58:04.653237+0000","last_peered":"2024-05-10T09:58:04.653237+0000","last_clean":"2024-05-10T09:58:04.653237+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:04.653237+0000","last_undegraded":"2024-05-10T09:58:04.653237+0000","last_fullsized":"2024-05-10T09:58:04.653237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648770+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:58:04.648770+0000","last_peered":"2024-05-10T09:58:04.648770+0000","last_clean":"2024-05-10T09:58:04.648770+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:04.648770+0000","last_undegraded":"2024-05-10T09:58:04.648770+0000","last_fullsized":"2024-05-10T09:58:04.648770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656182+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:58:04.656182+0000","last_peered":"2024-05-10T09:58:04.656182+0000","last_clean":"2024-05-10T09:58:04.656182+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:04.656182+0000","last_undegraded":"2024-05-10T09:58:04.656182+0000","last_fullsized":"2024-05-10T09:58:04.656182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529228+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:58:04.529228+0000","last_peered":"2024-05-10T09:58:04.529228+0000","last_clean":"2024-05-10T09:58:04.529228+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:04.529228+0000","last_undegraded":"2024-05-10T09:58:04.529228+0000","last_fullsized":"2024-05-10T09:58:04.529228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":27,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652635+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:58:04.652635+0000","last_peered":"2024-05-10T09:58:04.652635+0000","last_clean":"2024-05-10T09:58:04.652635+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:04.652635+0000","last_undegraded":"2024-05-10T09:58:04.652635+0000","last_fullsized":"2024-05-10T09:58:04.652635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"89'21","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647027+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:58:04.647027+0000","last_peered":"2024-05-10T09:58:04.647027+0000","last_clean":"2024-05-10T09:58:04.647027+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:04.647027+0000","last_undegraded":"2024-05-10T09:58:04.647027+0000","last_fullsized":"2024-05-10T09:58:04.647027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10974,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":24,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653816+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:58:04.653816+0000","last_peered":"2024-05-10T09:58:04.653816+0000","last_clean":"2024-05-10T09:58:04.653816+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:04.653816+0000","last_undegraded":"2024-05-10T09:58:04.653816+0000","last_fullsized":"2024-05-10T09:58:04.653816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528651+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:58:04.528651+0000","last_peered":"2024-05-10T09:58:04.528651+0000","last_clean":"2024-05-10T09:58:04.528651+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:04.528651+0000","last_undegraded":"2024-05-10T09:58:04.528651+0000","last_fullsized":"2024-05-10T09:58:04.528651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652727+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:58:04.652727+0000","last_peered":"2024-05-10T09:58:04.652727+0000","last_clean":"2024-05-10T09:58:04.652727+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:04.652727+0000","last_undegraded":"2024-05-10T09:58:04.652727+0000","last_fullsized":"2024-05-10T09:58:04.652727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646498+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:58:04.646498+0000","last_peered":"2024-05-10T09:58:04.646498+0000","last_clean":"2024-05-10T09:58:04.646498+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:04.646498+0000","last_undegraded":"2024-05-10T09:58:04.646498+0000","last_fullsized":"2024-05-10T09:58:04.646498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":30726,"num_write":21,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655646+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:58:04.655646+0000","last_peered":"2024-05-10T09:58:04.655646+0000","last_clean":"2024-05-10T09:58:04.655646+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:04.655646+0000","last_undegraded":"2024-05-10T09:58:04.655646+0000","last_fullsized":"2024-05-10T09:58:04.655646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"89'21","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653505+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:58:04.653505+0000","last_peered":"2024-05-10T09:58:04.653505+0000","last_clean":"2024-05-10T09:58:04.653505+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:04.653505+0000","last_undegraded":"2024-05-10T09:58:04.653505+0000","last_fullsized":"2024-05-10T09:58:04.653505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647328+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:58:04.647328+0000","last_peered":"2024-05-10T09:58:04.647328+0000","last_clean":"2024-05-10T09:58:04.647328+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:04.647328+0000","last_undegraded":"2024-05-10T09:58:04.647328+0000","last_fullsized":"2024-05-10T09:58:04.647328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652826+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:58:04.652826+0000","last_peered":"2024-05-10T09:58:04.652826+0000","last_clean":"2024-05-10T09:58:04.652826+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:04.652826+0000","last_undegraded":"2024-05-10T09:58:04.652826+0000","last_fullsized":"2024-05-10T09:58:04.652826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528292+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:58:04.528292+0000","last_peered":"2024-05-10T09:58:04.528292+0000","last_clean":"2024-05-10T09:58:04.528292+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:04.528292+0000","last_undegraded":"2024-05-10T09:58:04.528292+0000","last_fullsized":"2024-05-10T09:58:04.528292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528195+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:58:04.528195+0000","last_peered":"2024-05-10T09:58:04.528195+0000","last_clean":"2024-05-10T09:58:04.528195+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:04.528195+0000","last_undegraded":"2024-05-10T09:58:04.528195+0000","last_fullsized":"2024-05-10T09:58:04.528195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529014+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:58:04.529014+0000","last_peered":"2024-05-10T09:58:04.529014+0000","last_clean":"2024-05-10T09:58:04.529014+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:04.529014+0000","last_undegraded":"2024-05-10T09:58:04.529014+0000","last_fullsized":"2024-05-10T09:58:04.529014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"89'16","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531919+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:58:04.531919+0000","last_peered":"2024-05-10T09:58:04.531919+0000","last_clean":"2024-05-10T09:58:04.531919+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:04.531919+0000","last_undegraded":"2024-05-10T09:58:04.531919+0000","last_fullsized":"2024-05-10T09:58:04.531919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647189+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:58:04.647189+0000","last_peered":"2024-05-10T09:58:04.647189+0000","last_clean":"2024-05-10T09:58:04.647189+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:04.647189+0000","last_undegraded":"2024-05-10T09:58:04.647189+0000","last_fullsized":"2024-05-10T09:58:04.647189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650463+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:58:04.650463+0000","last_peered":"2024-05-10T09:58:04.650463+0000","last_clean":"2024-05-10T09:58:04.650463+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:04.650463+0000","last_undegraded":"2024-05-10T09:58:04.650463+0000","last_fullsized":"2024-05-10T09:58:04.650463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526549+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:58:04.526549+0000","last_peered":"2024-05-10T09:58:04.526549+0000","last_clean":"2024-05-10T09:58:04.526549+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:04.526549+0000","last_undegraded":"2024-05-10T09:58:04.526549+0000","last_fullsized":"2024-05-10T09:58:04.526549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"79'11","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649007+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:58:04.649007+0000","last_peered":"2024-05-10T09:58:04.649007+0000","last_clean":"2024-05-10T09:58:04.649007+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:04.649007+0000","last_undegraded":"2024-05-10T09:58:04.649007+0000","last_fullsized":"2024-05-10T09:58:04.649007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:36.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647618+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:58:04.647618+0000","last_peered":"2024-05-10T09:58:04.647618+0000","last_clean":"2024-05-10T09:58:04.647618+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:04.647618+0000","last_undegraded":"2024-05-10T09:58:04.647618+0000","last_fullsized":"2024-05-10T09:58:04.647618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":103,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530384+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:58:04.530384+0000","last_peered":"2024-05-10T09:58:04.530384+0000","last_clean":"2024-05-10T09:58:04.530384+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:04.530384+0000","last_undegraded":"2024-05-10T09:58:04.530384+0000","last_fullsized":"2024-05-10T09:58:04.530384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"89'16","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651661+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:58:04.651661+0000","last_peered":"2024-05-10T09:58:04.651661+0000","last_clean":"2024-05-10T09:58:04.651661+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:04.651661+0000","last_undegraded":"2024-05-10T09:58:04.651661+0000","last_fullsized":"2024-05-10T09:58:04.651661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649718+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:58:04.649718+0000","last_peered":"2024-05-10T09:58:04.649718+0000","last_clean":"2024-05-10T09:58:04.649718+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:04.649718+0000","last_undegraded":"2024-05-10T09:58:04.649718+0000","last_fullsized":"2024-05-10T09:58:04.649718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":131,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646678+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:58:04.646678+0000","last_peered":"2024-05-10T09:58:04.646678+0000","last_clean":"2024-05-10T09:58:04.646678+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:04.646678+0000","last_undegraded":"2024-05-10T09:58:04.646678+0000","last_fullsized":"2024-05-10T09:58:04.646678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654431+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:58:04.654431+0000","last_peered":"2024-05-10T09:58:04.654431+0000","last_clean":"2024-05-10T09:58:04.654431+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:04.654431+0000","last_undegraded":"2024-05-10T09:58:04.654431+0000","last_fullsized":"2024-05-10T09:58:04.654431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18450,"num_write":39,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653243+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:58:04.653243+0000","last_peered":"2024-05-10T09:58:04.653243+0000","last_clean":"2024-05-10T09:58:04.653243+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:04.653243+0000","last_undegraded":"2024-05-10T09:58:04.653243+0000","last_fullsized":"2024-05-10T09:58:04.653243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"89'19","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653251+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:58:04.653251+0000","last_peered":"2024-05-10T09:58:04.653251+0000","last_clean":"2024-05-10T09:58:04.653251+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:04.653251+0000","last_undegraded":"2024-05-10T09:58:04.653251+0000","last_fullsized":"2024-05-10T09:58:04.653251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646293+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:58:04.646293+0000","last_peered":"2024-05-10T09:58:04.646293+0000","last_clean":"2024-05-10T09:58:04.646293+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:04.646293+0000","last_undegraded":"2024-05-10T09:58:04.646293+0000","last_fullsized":"2024-05-10T09:58:04.646293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658184+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:58:04.658184+0000","last_peered":"2024-05-10T09:58:04.658184+0000","last_clean":"2024-05-10T09:58:04.658184+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:04.658184+0000","last_undegraded":"2024-05-10T09:58:04.658184+0000","last_fullsized":"2024-05-10T09:58:04.658184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529018+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:58:04.529018+0000","last_peered":"2024-05-10T09:58:04.529018+0000","last_clean":"2024-05-10T09:58:04.529018+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:04.529018+0000","last_undegraded":"2024-05-10T09:58:04.529018+0000","last_fullsized":"2024-05-10T09:58:04.529018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657322+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:58:04.657322+0000","last_peered":"2024-05-10T09:58:04.657322+0000","last_clean":"2024-05-10T09:58:04.657322+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:04.657322+0000","last_undegraded":"2024-05-10T09:58:04.657322+0000","last_fullsized":"2024-05-10T09:58:04.657322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650809+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:58:04.650809+0000","last_peered":"2024-05-10T09:58:04.650809+0000","last_clean":"2024-05-10T09:58:04.650809+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:04.650809+0000","last_undegraded":"2024-05-10T09:58:04.650809+0000","last_fullsized":"2024-05-10T09:58:04.650809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646411+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:58:04.646411+0000","last_peered":"2024-05-10T09:58:04.646411+0000","last_clean":"2024-05-10T09:58:04.646411+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:04.646411+0000","last_undegraded":"2024-05-10T09:58:04.646411+0000","last_fullsized":"2024-05-10T09:58:04.646411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652426+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:58:04.652426+0000","last_peered":"2024-05-10T09:58:04.652426+0000","last_clean":"2024-05-10T09:58:04.652426+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:04.652426+0000","last_undegraded":"2024-05-10T09:58:04.652426+0000","last_fullsized":"2024-05-10T09:58:04.652426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527768+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:58:04.527768+0000","last_peered":"2024-05-10T09:58:04.527768+0000","last_clean":"2024-05-10T09:58:04.527768+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:04.527768+0000","last_undegraded":"2024-05-10T09:58:04.527768+0000","last_fullsized":"2024-05-10T09:58:04.527768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531028+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:58:04.531028+0000","last_peered":"2024-05-10T09:58:04.531028+0000","last_clean":"2024-05-10T09:58:04.531028+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:04.531028+0000","last_undegraded":"2024-05-10T09:58:04.531028+0000","last_fullsized":"2024-05-10T09:58:04.531028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528950+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:58:04.528950+0000","last_peered":"2024-05-10T09:58:04.528950+0000","last_clean":"2024-05-10T09:58:04.528950+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:04.528950+0000","last_undegraded":"2024-05-10T09:58:04.528950+0000","last_fullsized":"2024-05-10T09:58:04.528950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527959+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:58:04.527959+0000","last_peered":"2024-05-10T09:58:04.527959+0000","last_clean":"2024-05-10T09:58:04.527959+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:04.527959+0000","last_undegraded":"2024-05-10T09:58:04.527959+0000","last_fullsized":"2024-05-10T09:58:04.527959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"89'8","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531553+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:58:04.531553+0000","last_peered":"2024-05-10T09:58:04.531553+0000","last_clean":"2024-05-10T09:58:04.531553+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:04.531553+0000","last_undegraded":"2024-05-10T09:58:04.531553+0000","last_fullsized":"2024-05-10T09:58:04.531553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529836+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:58:04.529836+0000","last_peered":"2024-05-10T09:58:04.529836+0000","last_clean":"2024-05-10T09:58:04.529836+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:04.529836+0000","last_undegraded":"2024-05-10T09:58:04.529836+0000","last_fullsized":"2024-05-10T09:58:04.529836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655255+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:58:04.655255+0000","last_peered":"2024-05-10T09:58:04.655255+0000","last_clean":"2024-05-10T09:58:04.655255+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:04.655255+0000","last_undegraded":"2024-05-10T09:58:04.655255+0000","last_fullsized":"2024-05-10T09:58:04.655255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527607+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:58:04.527607+0000","last_peered":"2024-05-10T09:58:04.527607+0000","last_clean":"2024-05-10T09:58:04.527607+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:04.527607+0000","last_undegraded":"2024-05-10T09:58:04.527607+0000","last_fullsized":"2024-05-10T09:58:04.527607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653419+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:58:04.653419+0000","last_peered":"2024-05-10T09:58:04.653419+0000","last_clean":"2024-05-10T09:58:04.653419+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:04.653419+0000","last_undegraded":"2024-05-10T09:58:04.653419+0000","last_fullsized":"2024-05-10T09:58:04.653419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645798+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:58:04.645798+0000","last_peered":"2024-05-10T09:58:04.645798+0000","last_clean":"2024-05-10T09:58:04.645798+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:04.645798+0000","last_undegraded":"2024-05-10T09:58:04.645798+0000","last_fullsized":"2024-05-10T09:58:04.645798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"89'14","reported_seq":107,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528957+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:58:04.528957+0000","last_peered":"2024-05-10T09:58:04.528957+0000","last_clean":"2024-05-10T09:58:04.528957+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:04.528957+0000","last_undegraded":"2024-05-10T09:58:04.528957+0000","last_fullsized":"2024-05-10T09:58:04.528957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648510+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:58:04.648510+0000","last_peered":"2024-05-10T09:58:04.648510+0000","last_clean":"2024-05-10T09:58:04.648510+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:04.648510+0000","last_undegraded":"2024-05-10T09:58:04.648510+0000","last_fullsized":"2024-05-10T09:58:04.648510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529237+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:58:04.529237+0000","last_peered":"2024-05-10T09:58:04.529237+0000","last_clean":"2024-05-10T09:58:04.529237+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:04.529237+0000","last_undegraded":"2024-05-10T09:58:04.529237+0000","last_fullsized":"2024-05-10T09:58:04.529237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647961+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:58:04.647961+0000","last_peered":"2024-05-10T09:58:04.647961+0000","last_clean":"2024-05-10T09:58:04.647961+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:04.647961+0000","last_undegraded":"2024-05-10T09:58:04.647961+0000","last_fullsized":"2024-05-10T09:58:04.647961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654410+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:58:04.654410+0000","last_peered":"2024-05-10T09:58:04.654410+0000","last_clean":"2024-05-10T09:58:04.654410+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:04.654410+0000","last_undegraded":"2024-05-10T09:58:04.654410+0000","last_fullsized":"2024-05-10T09:58:04.654410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647419+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:58:04.647419+0000","last_peered":"2024-05-10T09:58:04.647419+0000","last_clean":"2024-05-10T09:58:04.647419+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:04.647419+0000","last_undegraded":"2024-05-10T09:58:04.647419+0000","last_fullsized":"2024-05-10T09:58:04.647419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'14","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529372+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:58:04.529372+0000","last_peered":"2024-05-10T09:58:04.529372+0000","last_clean":"2024-05-10T09:58:04.529372+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:04.529372+0000","last_undegraded":"2024-05-10T09:58:04.529372+0000","last_fullsized":"2024-05-10T09:58:04.529372+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656340+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:58:04.656340+0000","last_peered":"2024-05-10T09:58:04.656340+0000","last_clean":"2024-05-10T09:58:04.656340+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:04.656340+0000","last_undegraded":"2024-05-10T09:58:04.656340+0000","last_fullsized":"2024-05-10T09:58:04.656340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"79'6","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652452+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:58:04.652452+0000","last_peered":"2024-05-10T09:58:04.652452+0000","last_clean":"2024-05-10T09:58:04.652452+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:04.652452+0000","last_undegraded":"2024-05-10T09:58:04.652452+0000","last_fullsized":"2024-05-10T09:58:04.652452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648308+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:58:04.648308+0000","last_peered":"2024-05-10T09:58:04.648308+0000","last_clean":"2024-05-10T09:58:04.648308+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:04.648308+0000","last_undegraded":"2024-05-10T09:58:04.648308+0000","last_fullsized":"2024-05-10T09:58:04.648308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649477+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:58:04.649477+0000","last_peered":"2024-05-10T09:58:04.649477+0000","last_clean":"2024-05-10T09:58:04.649477+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:04.649477+0000","last_undegraded":"2024-05-10T09:58:04.649477+0000","last_fullsized":"2024-05-10T09:58:04.649477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":29,"num_read_kb":71692,"num_write":41,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530949+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:58:04.530949+0000","last_peered":"2024-05-10T09:58:04.530949+0000","last_clean":"2024-05-10T09:58:04.530949+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:04.530949+0000","last_undegraded":"2024-05-10T09:58:04.530949+0000","last_fullsized":"2024-05-10T09:58:04.530949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'5","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531779+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:58:04.531779+0000","last_peered":"2024-05-10T09:58:04.531779+0000","last_clean":"2024-05-10T09:58:04.531779+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:58:04.531779+0000","last_undegraded":"2024-05-10T09:58:04.531779+0000","last_fullsized":"2024-05-10T09:58:04.531779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528181+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:58:04.528181+0000","last_peered":"2024-05-10T09:58:04.528181+0000","last_clean":"2024-05-10T09:58:04.528181+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:04.528181+0000","last_undegraded":"2024-05-10T09:58:04.528181+0000","last_fullsized":"2024-05-10T09:58:04.528181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"79'8","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648027+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:58:04.648027+0000","last_peered":"2024-05-10T09:58:04.648027+0000","last_clean":"2024-05-10T09:58:04.648027+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:04.648027+0000","last_undegraded":"2024-05-10T09:58:04.648027+0000","last_fullsized":"2024-05-10T09:58:04.648027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":145,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528710+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:58:04.528710+0000","last_peered":"2024-05-10T09:58:04.528710+0000","last_clean":"2024-05-10T09:58:04.528710+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:04.528710+0000","last_undegraded":"2024-05-10T09:58:04.528710+0000","last_fullsized":"2024-05-10T09:58:04.528710+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660880+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:58:04.660880+0000","last_peered":"2024-05-10T09:58:04.660880+0000","last_clean":"2024-05-10T09:58:04.660880+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:04.660880+0000","last_undegraded":"2024-05-10T09:58:04.660880+0000","last_fullsized":"2024-05-10T09:58:04.660880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651663+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:58:04.651663+0000","last_peered":"2024-05-10T09:58:04.651663+0000","last_clean":"2024-05-10T09:58:04.651663+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:04.651663+0000","last_undegraded":"2024-05-10T09:58:04.651663+0000","last_fullsized":"2024-05-10T09:58:04.651663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'11","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531405+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:58:04.531405+0000","last_peered":"2024-05-10T09:58:04.531405+0000","last_clean":"2024-05-10T09:58:04.531405+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:04.531405+0000","last_undegraded":"2024-05-10T09:58:04.531405+0000","last_fullsized":"2024-05-10T09:58:04.531405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36870,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653362+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:58:04.653362+0000","last_peered":"2024-05-10T09:58:04.653362+0000","last_clean":"2024-05-10T09:58:04.653362+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:04.653362+0000","last_undegraded":"2024-05-10T09:58:04.653362+0000","last_fullsized":"2024-05-10T09:58:04.653362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651637+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:58:04.651637+0000","last_peered":"2024-05-10T09:58:04.651637+0000","last_clean":"2024-05-10T09:58:04.651637+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:04.651637+0000","last_undegraded":"2024-05-10T09:58:04.651637+0000","last_fullsized":"2024-05-10T09:58:04.651637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":36870,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529866+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:58:04.529866+0000","last_peered":"2024-05-10T09:58:04.529866+0000","last_clean":"2024-05-10T09:58:04.529866+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:04.529866+0000","last_undegraded":"2024-05-10T09:58:04.529866+0000","last_fullsized":"2024-05-10T09:58:04.529866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'16","reported_seq":243,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531176+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:58:04.531176+0000","last_peered":"2024-05-10T09:58:04.531176+0000","last_clean":"2024-05-10T09:58:04.531176+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:58:04.531176+0000","last_undegraded":"2024-05-10T09:58:04.531176+0000","last_fullsized":"2024-05-10T09:58:04.531176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527324+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:58:04.527324+0000","last_peered":"2024-05-10T09:58:04.527324+0000","last_clean":"2024-05-10T09:58:04.527324+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:04.527324+0000","last_undegraded":"2024-05-10T09:58:04.527324+0000","last_fullsized":"2024-05-10T09:58:04.527324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652210+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:58:04.652210+0000","last_peered":"2024-05-10T09:58:04.652210+0000","last_clean":"2024-05-10T09:58:04.652210+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:04.652210+0000","last_undegraded":"2024-05-10T09:58:04.652210+0000","last_fullsized":"2024-05-10T09:58:04.652210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530261+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:58:04.530261+0000","last_peered":"2024-05-10T09:58:04.530261+0000","last_clean":"2024-05-10T09:58:04.530261+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:04.530261+0000","last_undegraded":"2024-05-10T09:58:04.530261+0000","last_fullsized":"2024-05-10T09:58:04.530261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650076+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:58:04.650076+0000","last_peered":"2024-05-10T09:58:04.650076+0000","last_clean":"2024-05-10T09:58:04.650076+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:04.650076+0000","last_undegraded":"2024-05-10T09:58:04.650076+0000","last_fullsized":"2024-05-10T09:58:04.650076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654023+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:58:04.654023+0000","last_peered":"2024-05-10T09:58:04.654023+0000","last_clean":"2024-05-10T09:58:04.654023+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:04.654023+0000","last_undegraded":"2024-05-10T09:58:04.654023+0000","last_fullsized":"2024-05-10T09:58:04.654023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'14","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655299+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:58:04.655299+0000","last_peered":"2024-05-10T09:58:04.655299+0000","last_clean":"2024-05-10T09:58:04.655299+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:04.655299+0000","last_undegraded":"2024-05-10T09:58:04.655299+0000","last_fullsized":"2024-05-10T09:58:04.655299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":23,"num_read_kb":36880,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649741+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:58:04.649741+0000","last_peered":"2024-05-10T09:58:04.649741+0000","last_clean":"2024-05-10T09:58:04.649741+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:04.649741+0000","last_undegraded":"2024-05-10T09:58:04.649741+0000","last_fullsized":"2024-05-10T09:58:04.649741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'13","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656883+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:58:04.656883+0000","last_peered":"2024-05-10T09:58:04.656883+0000","last_clean":"2024-05-10T09:58:04.656883+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:04.656883+0000","last_undegraded":"2024-05-10T09:58:04.656883+0000","last_fullsized":"2024-05-10T09:58:04.656883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":34834,"num_write":43,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530476+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:58:04.530476+0000","last_peered":"2024-05-10T09:58:04.530476+0000","last_clean":"2024-05-10T09:58:04.530476+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:04.530476+0000","last_undegraded":"2024-05-10T09:58:04.530476+0000","last_fullsized":"2024-05-10T09:58:04.530476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'9","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530270+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:58:04.530270+0000","last_peered":"2024-05-10T09:58:04.530270+0000","last_clean":"2024-05-10T09:58:04.530270+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:04.530270+0000","last_undegraded":"2024-05-10T09:58:04.530270+0000","last_fullsized":"2024-05-10T09:58:04.530270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650180+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:58:04.650180+0000","last_peered":"2024-05-10T09:58:04.650180+0000","last_clean":"2024-05-10T09:58:04.650180+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:04.650180+0000","last_undegraded":"2024-05-10T09:58:04.650180+0000","last_fullsized":"2024-05-10T09:58:04.650180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658360+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:58:04.658360+0000","last_peered":"2024-05-10T09:58:04.658360+0000","last_clean":"2024-05-10T09:58:04.658360+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:04.658360+0000","last_undegraded":"2024-05-10T09:58:04.658360+0000","last_fullsized":"2024-05-10T09:58:04.658360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":36882,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'8","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651346+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:58:04.651346+0000","last_peered":"2024-05-10T09:58:04.651346+0000","last_clean":"2024-05-10T09:58:04.651346+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:04.651346+0000","last_undegraded":"2024-05-10T09:58:04.651346+0000","last_fullsized":"2024-05-10T09:58:04.651346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653196+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:58:04.653196+0000","last_peered":"2024-05-10T09:58:04.653196+0000","last_clean":"2024-05-10T09:58:04.653196+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:04.653196+0000","last_undegraded":"2024-05-10T09:58:04.653196+0000","last_fullsized":"2024-05-10T09:58:04.653196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'9","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646387+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:58:04.646387+0000","last_peered":"2024-05-10T09:58:04.646387+0000","last_clean":"2024-05-10T09:58:04.646387+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:04.646387+0000","last_undegraded":"2024-05-10T09:58:04.646387+0000","last_fullsized":"2024-05-10T09:58:04.646387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657058+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:58:04.657058+0000","last_peered":"2024-05-10T09:58:04.657058+0000","last_clean":"2024-05-10T09:58:04.657058+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:04.657058+0000","last_undegraded":"2024-05-10T09:58:04.657058+0000","last_fullsized":"2024-05-10T09:58:04.657058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242916,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":922,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":230728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1082,"num_read_kb":2003600,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":452984,"kb_used_data":421804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93918856,"statfs":{"total":96636764160,"available":96172908544,"internally_reserved":0,"allocated":431927296,"data_stored":431305753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323336,"kb_used_data":292156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048504,"statfs":{"total":96636764160,"available":96305668096,"internally_reserved":0,"allocated":299167744,"data_stored":298578850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505676,"kb_used_data":474492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866164,"statfs":{"total":96636764160,"available":96118951936,"internally_reserved":0,"allocated":485879808,"data_stored":485241465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285581,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508200,"kb_used_data":476444,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":93863640,"statfs":{"total":96636764160,"available":96116367360,"internally_reserved":0,"allocated":487878656,"data_stored":487316023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538480,"kb_used_data":503140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93833360,"statfs":{"total":96636764160,"available":96085360640,"internally_reserved":0,"allocated":515215360,"data_stored":514612407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263980,"kb_used_data":228636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94107860,"statfs":{"total":96636764160,"available":96366448640,"internally_reserved":0,"allocated":234123264,"data_stored":233561927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555420,"kb_used_data":520076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93816420,"statfs":{"total":96636764160,"available":96068014080,"internally_reserved":0,"allocated":532557824,"data_stored":531963325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329624,"kb_used_data":290124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94042216,"statfs":{"total":96636764160,"available":96299229184,"internally_reserved":0,"allocated":297086976,"data_stored":296483812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":530579456,"data_stored":530579456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":295698432,"data_stored":295698432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":232783872,"data_stored":232783872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":513802240,"data_stored":513802240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":429916160,"data_stored":429916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":31596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":23865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":16540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":48698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":14205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":37700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":37756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:58:08.096 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:58:08.471 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:08.477 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:58:08.485 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-05-10T09:58:08.265452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613457,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3802,"num_read_kb":2005881,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1935,"ondisk_log_size":1935,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3477700,"kb_used_data":3206872,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":751497020,"statfs":{"total":773094113280,"available":769532948480,"internally_reserved":0,"allocated":3283836928,"data_stored":3279063562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.003173"},"pg_stats":[{"pgid":"3.3f","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657807+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:58:04.657807+0000","last_peered":"2024-05-10T09:58:04.657807+0000","last_clean":"2024-05-10T09:58:04.657807+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:04.657807+0000","last_undegraded":"2024-05-10T09:58:04.657807+0000","last_fullsized":"2024-05-10T09:58:04.657807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650396+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:58:04.650396+0000","last_peered":"2024-05-10T09:58:04.650396+0000","last_clean":"2024-05-10T09:58:04.650396+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:04.650396+0000","last_undegraded":"2024-05-10T09:58:04.650396+0000","last_fullsized":"2024-05-10T09:58:04.650396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'9","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647529+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:58:04.647529+0000","last_peered":"2024-05-10T09:58:04.647529+0000","last_clean":"2024-05-10T09:58:04.647529+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:04.647529+0000","last_undegraded":"2024-05-10T09:58:04.647529+0000","last_fullsized":"2024-05-10T09:58:04.647529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651881+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:58:04.651881+0000","last_peered":"2024-05-10T09:58:04.651881+0000","last_clean":"2024-05-10T09:58:04.651881+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:04.651881+0000","last_undegraded":"2024-05-10T09:58:04.651881+0000","last_fullsized":"2024-05-10T09:58:04.651881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652086+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:58:04.652086+0000","last_peered":"2024-05-10T09:58:04.652086+0000","last_clean":"2024-05-10T09:58:04.652086+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:04.652086+0000","last_undegraded":"2024-05-10T09:58:04.652086+0000","last_fullsized":"2024-05-10T09:58:04.652086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'12","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654181+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:58:04.654181+0000","last_peered":"2024-05-10T09:58:04.654181+0000","last_clean":"2024-05-10T09:58:04.654181+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:04.654181+0000","last_undegraded":"2024-05-10T09:58:04.654181+0000","last_fullsized":"2024-05-10T09:58:04.654181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649254+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:58:04.649254+0000","last_peered":"2024-05-10T09:58:04.649254+0000","last_clean":"2024-05-10T09:58:04.649254+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:04.649254+0000","last_undegraded":"2024-05-10T09:58:04.649254+0000","last_fullsized":"2024-05-10T09:58:04.649254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'16","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654430+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:58:04.654430+0000","last_peered":"2024-05-10T09:58:04.654430+0000","last_clean":"2024-05-10T09:58:04.654430+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:04.654430+0000","last_undegraded":"2024-05-10T09:58:04.654430+0000","last_fullsized":"2024-05-10T09:58:04.654430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":43032,"num_write":56,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655633+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:58:04.655633+0000","last_peered":"2024-05-10T09:58:04.655633+0000","last_clean":"2024-05-10T09:58:04.655633+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:04.655633+0000","last_undegraded":"2024-05-10T09:58:04.655633+0000","last_fullsized":"2024-05-10T09:58:04.655633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'11","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651688+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:58:04.651688+0000","last_peered":"2024-05-10T09:58:04.651688+0000","last_clean":"2024-05-10T09:58:04.651688+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:04.651688+0000","last_undegraded":"2024-05-10T09:58:04.651688+0000","last_fullsized":"2024-05-10T09:58:04.651688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":36876,"num_write":31,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529657+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:58:04.529657+0000","last_peered":"2024-05-10T09:58:04.529657+0000","last_clean":"2024-05-10T09:58:04.529657+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:04.529657+0000","last_undegraded":"2024-05-10T09:58:04.529657+0000","last_fullsized":"2024-05-10T09:58:04.529657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'6","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528952+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:58:04.528952+0000","last_peered":"2024-05-10T09:58:04.528952+0000","last_clean":"2024-05-10T09:58:04.528952+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:04.528952+0000","last_undegraded":"2024-05-10T09:58:04.528952+0000","last_fullsized":"2024-05-10T09:58:04.528952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656752+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:58:04.656752+0000","last_peered":"2024-05-10T09:58:04.656752+0000","last_clean":"2024-05-10T09:58:04.656752+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:04.656752+0000","last_undegraded":"2024-05-10T09:58:04.656752+0000","last_fullsized":"2024-05-10T09:58:04.656752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"78'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528643+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:58:04.528643+0000","last_peered":"2024-05-10T09:58:04.528643+0000","last_clean":"2024-05-10T09:58:04.528643+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:04.528643+0000","last_undegraded":"2024-05-10T09:58:04.528643+0000","last_fullsized":"2024-05-10T09:58:04.528643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528564+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:58:04.528564+0000","last_peered":"2024-05-10T09:58:04.528564+0000","last_clean":"2024-05-10T09:58:04.528564+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:04.528564+0000","last_undegraded":"2024-05-10T09:58:04.528564+0000","last_fullsized":"2024-05-10T09:58:04.528564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527703+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:58:04.527703+0000","last_peered":"2024-05-10T09:58:04.527703+0000","last_clean":"2024-05-10T09:58:04.527703+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:04.527703+0000","last_undegraded":"2024-05-10T09:58:04.527703+0000","last_fullsized":"2024-05-10T09:58:04.527703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657912+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:58:04.657912+0000","last_peered":"2024-05-10T09:58:04.657912+0000","last_clean":"2024-05-10T09:58:04.657912+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:04.657912+0000","last_undegraded":"2024-05-10T09:58:04.657912+0000","last_fullsized":"2024-05-10T09:58:04.657912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652120+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:58:04.652120+0000","last_peered":"2024-05-10T09:58:04.652120+0000","last_clean":"2024-05-10T09:58:04.652120+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:04.652120+0000","last_undegraded":"2024-05-10T09:58:04.652120+0000","last_fullsized":"2024-05-10T09:58:04.652120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'7","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652595+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:58:04.652595+0000","last_peered":"2024-05-10T09:58:04.652595+0000","last_clean":"2024-05-10T09:58:04.652595+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:04.652595+0000","last_undegraded":"2024-05-10T09:58:04.652595+0000","last_fullsized":"2024-05-10T09:58:04.652595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651965+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:58:04.651965+0000","last_peered":"2024-05-10T09:58:04.651965+0000","last_clean":"2024-05-10T09:58:04.651965+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:04.651965+0000","last_undegraded":"2024-05-10T09:58:04.651965+0000","last_fullsized":"2024-05-10T09:58:04.651965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"79'5","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657131+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:58:04.657131+0000","last_peered":"2024-05-10T09:58:04.657131+0000","last_clean":"2024-05-10T09:58:04.657131+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:04.657131+0000","last_undegraded":"2024-05-10T09:58:04.657131+0000","last_fullsized":"2024-05-10T09:58:04.657131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527325+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:58:04.527325+0000","last_peered":"2024-05-10T09:58:04.527325+0000","last_clean":"2024-05-10T09:58:04.527325+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:04.527325+0000","last_undegraded":"2024-05-10T09:58:04.527325+0000","last_fullsized":"2024-05-10T09:58:04.527325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'19","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529749+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:58:04.529749+0000","last_peered":"2024-05-10T09:58:04.529749+0000","last_clean":"2024-05-10T09:58:04.529749+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:04.529749+0000","last_undegraded":"2024-05-10T09:58:04.529749+0000","last_fullsized":"2024-05-10T09:58:04.529749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":25,"num_read_kb":61452,"num_write":39,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":231,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526267+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:58:04.526267+0000","last_peered":"2024-05-10T09:58:04.526267+0000","last_clean":"2024-05-10T09:58:04.526267+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:04.526267+0000","last_undegraded":"2024-05-10T09:58:04.526267+0000","last_fullsized":"2024-05-10T09:58:04.526267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:28.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529605+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:58:04.529605+0000","last_peered":"2024-05-10T09:58:04.529605+0000","last_clean":"2024-05-10T09:58:04.529605+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:04.529605+0000","last_undegraded":"2024-05-10T09:58:04.529605+0000","last_fullsized":"2024-05-10T09:58:04.529605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529511+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:58:04.529511+0000","last_peered":"2024-05-10T09:58:04.529511+0000","last_clean":"2024-05-10T09:58:04.529511+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:04.529511+0000","last_undegraded":"2024-05-10T09:58:04.529511+0000","last_fullsized":"2024-05-10T09:58:04.529511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"79'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650655+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:58:04.650655+0000","last_peered":"2024-05-10T09:58:04.650655+0000","last_clean":"2024-05-10T09:58:04.650655+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:04.650655+0000","last_undegraded":"2024-05-10T09:58:04.650655+0000","last_fullsized":"2024-05-10T09:58:04.650655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528133+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:58:04.528133+0000","last_peered":"2024-05-10T09:58:04.528133+0000","last_clean":"2024-05-10T09:58:04.528133+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:04.528133+0000","last_undegraded":"2024-05-10T09:58:04.528133+0000","last_fullsized":"2024-05-10T09:58:04.528133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530920+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:58:04.530920+0000","last_peered":"2024-05-10T09:58:04.530920+0000","last_clean":"2024-05-10T09:58:04.530920+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:04.530920+0000","last_undegraded":"2024-05-10T09:58:04.530920+0000","last_fullsized":"2024-05-10T09:58:04.530920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'10","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654850+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:58:04.654850+0000","last_peered":"2024-05-10T09:58:04.654850+0000","last_clean":"2024-05-10T09:58:04.654850+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:04.654850+0000","last_undegraded":"2024-05-10T09:58:04.654850+0000","last_fullsized":"2024-05-10T09:58:04.654850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":18442,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655953+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:58:04.655953+0000","last_peered":"2024-05-10T09:58:04.655953+0000","last_clean":"2024-05-10T09:58:04.655953+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:04.655953+0000","last_undegraded":"2024-05-10T09:58:04.655953+0000","last_fullsized":"2024-05-10T09:58:04.655953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652475+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:58:04.652475+0000","last_peered":"2024-05-10T09:58:04.652475+0000","last_clean":"2024-05-10T09:58:04.652475+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:04.652475+0000","last_undegraded":"2024-05-10T09:58:04.652475+0000","last_fullsized":"2024-05-10T09:58:04.652475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655116+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:58:04.655116+0000","last_peered":"2024-05-10T09:58:04.655116+0000","last_clean":"2024-05-10T09:58:04.655116+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:04.655116+0000","last_undegraded":"2024-05-10T09:58:04.655116+0000","last_fullsized":"2024-05-10T09:58:04.655116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650200+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:58:04.650200+0000","last_peered":"2024-05-10T09:58:04.650200+0000","last_clean":"2024-05-10T09:58:04.650200+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:04.650200+0000","last_undegraded":"2024-05-10T09:58:04.650200+0000","last_fullsized":"2024-05-10T09:58:04.650200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657074+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:58:04.657074+0000","last_peered":"2024-05-10T09:58:04.657074+0000","last_clean":"2024-05-10T09:58:04.657074+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:04.657074+0000","last_undegraded":"2024-05-10T09:58:04.657074+0000","last_fullsized":"2024-05-10T09:58:04.657074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650910+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:58:04.650910+0000","last_peered":"2024-05-10T09:58:04.650910+0000","last_clean":"2024-05-10T09:58:04.650910+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:04.650910+0000","last_undegraded":"2024-05-10T09:58:04.650910+0000","last_fullsized":"2024-05-10T09:58:04.650910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530366+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:58:04.530366+0000","last_peered":"2024-05-10T09:58:04.530366+0000","last_clean":"2024-05-10T09:58:04.530366+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:04.530366+0000","last_undegraded":"2024-05-10T09:58:04.530366+0000","last_fullsized":"2024-05-10T09:58:04.530366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":93,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530616+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:58:04.530616+0000","last_peered":"2024-05-10T09:58:04.530616+0000","last_clean":"2024-05-10T09:58:04.530616+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:04.530616+0000","last_undegraded":"2024-05-10T09:58:04.530616+0000","last_fullsized":"2024-05-10T09:58:04.530616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530644+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:58:04.530644+0000","last_peered":"2024-05-10T09:58:04.530644+0000","last_clean":"2024-05-10T09:58:04.530644+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:04.530644+0000","last_undegraded":"2024-05-10T09:58:04.530644+0000","last_fullsized":"2024-05-10T09:58:04.530644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649999+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:58:04.649999+0000","last_peered":"2024-05-10T09:58:04.649999+0000","last_clean":"2024-05-10T09:58:04.649999+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:04.649999+0000","last_undegraded":"2024-05-10T09:58:04.649999+0000","last_fullsized":"2024-05-10T09:58:04.649999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652885+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:58:04.652885+0000","last_peered":"2024-05-10T09:58:04.652885+0000","last_clean":"2024-05-10T09:58:04.652885+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:04.652885+0000","last_undegraded":"2024-05-10T09:58:04.652885+0000","last_fullsized":"2024-05-10T09:58:04.652885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'13","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652338+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:58:04.652338+0000","last_peered":"2024-05-10T09:58:04.652338+0000","last_clean":"2024-05-10T09:58:04.652338+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:04.652338+0000","last_undegraded":"2024-05-10T09:58:04.652338+0000","last_fullsized":"2024-05-10T09:58:04.652338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.532396+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:58:04.532396+0000","last_peered":"2024-05-10T09:58:04.532396+0000","last_clean":"2024-05-10T09:58:04.532396+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:04.532396+0000","last_undegraded":"2024-05-10T09:58:04.532396+0000","last_fullsized":"2024-05-10T09:58:04.532396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525699+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:58:04.525699+0000","last_peered":"2024-05-10T09:58:04.525699+0000","last_clean":"2024-05-10T09:58:04.525699+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:04.525699+0000","last_undegraded":"2024-05-10T09:58:04.525699+0000","last_fullsized":"2024-05-10T09:58:04.525699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:28.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"89'14","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654514+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:58:04.654514+0000","last_peered":"2024-05-10T09:58:04.654514+0000","last_clean":"2024-05-10T09:58:04.654514+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:04.654514+0000","last_undegraded":"2024-05-10T09:58:04.654514+0000","last_fullsized":"2024-05-10T09:58:04.654514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529188+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:58:04.529188+0000","last_peered":"2024-05-10T09:58:04.529188+0000","last_clean":"2024-05-10T09:58:04.529188+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:04.529188+0000","last_undegraded":"2024-05-10T09:58:04.529188+0000","last_fullsized":"2024-05-10T09:58:04.529188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531253+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:58:04.531253+0000","last_peered":"2024-05-10T09:58:04.531253+0000","last_clean":"2024-05-10T09:58:04.531253+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:04.531253+0000","last_undegraded":"2024-05-10T09:58:04.531253+0000","last_fullsized":"2024-05-10T09:58:04.531253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654828+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:58:04.654828+0000","last_peered":"2024-05-10T09:58:04.654828+0000","last_clean":"2024-05-10T09:58:04.654828+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:04.654828+0000","last_undegraded":"2024-05-10T09:58:04.654828+0000","last_fullsized":"2024-05-10T09:58:04.654828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656656+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:58:04.656656+0000","last_peered":"2024-05-10T09:58:04.656656+0000","last_clean":"2024-05-10T09:58:04.656656+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:04.656656+0000","last_undegraded":"2024-05-10T09:58:04.656656+0000","last_fullsized":"2024-05-10T09:58:04.656656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"89'13","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655008+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:58:04.655008+0000","last_peered":"2024-05-10T09:58:04.655008+0000","last_clean":"2024-05-10T09:58:04.655008+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:04.655008+0000","last_undegraded":"2024-05-10T09:58:04.655008+0000","last_fullsized":"2024-05-10T09:58:04.655008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"89'14","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528311+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:58:04.528311+0000","last_peered":"2024-05-10T09:58:04.528311+0000","last_clean":"2024-05-10T09:58:04.528311+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:04.528311+0000","last_undegraded":"2024-05-10T09:58:04.528311+0000","last_fullsized":"2024-05-10T09:58:04.528311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651101+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:58:04.651101+0000","last_peered":"2024-05-10T09:58:04.651101+0000","last_clean":"2024-05-10T09:58:04.651101+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:04.651101+0000","last_undegraded":"2024-05-10T09:58:04.651101+0000","last_fullsized":"2024-05-10T09:58:04.651101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'8","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658091+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:58:04.658091+0000","last_peered":"2024-05-10T09:58:04.658091+0000","last_clean":"2024-05-10T09:58:04.658091+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:04.658091+0000","last_undegraded":"2024-05-10T09:58:04.658091+0000","last_fullsized":"2024-05-10T09:58:04.658091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651083+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:58:04.651083+0000","last_peered":"2024-05-10T09:58:04.651083+0000","last_clean":"2024-05-10T09:58:04.651083+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:04.651083+0000","last_undegraded":"2024-05-10T09:58:04.651083+0000","last_fullsized":"2024-05-10T09:58:04.651083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"89'23","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650787+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:58:04.650787+0000","last_peered":"2024-05-10T09:58:04.650787+0000","last_clean":"2024-05-10T09:58:04.650787+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:04.650787+0000","last_undegraded":"2024-05-10T09:58:04.650787+0000","last_fullsized":"2024-05-10T09:58:04.650787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647210+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:58:04.647210+0000","last_peered":"2024-05-10T09:58:04.647210+0000","last_clean":"2024-05-10T09:58:04.647210+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:04.647210+0000","last_undegraded":"2024-05-10T09:58:04.647210+0000","last_fullsized":"2024-05-10T09:58:04.647210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653582+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:58:04.653582+0000","last_peered":"2024-05-10T09:58:04.653582+0000","last_clean":"2024-05-10T09:58:04.653582+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:04.653582+0000","last_undegraded":"2024-05-10T09:58:04.653582+0000","last_fullsized":"2024-05-10T09:58:04.653582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527921+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:58:04.527921+0000","last_peered":"2024-05-10T09:58:04.527921+0000","last_clean":"2024-05-10T09:58:04.527921+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:04.527921+0000","last_undegraded":"2024-05-10T09:58:04.527921+0000","last_fullsized":"2024-05-10T09:58:04.527921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'13","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656481+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:58:04.656481+0000","last_peered":"2024-05-10T09:58:04.656481+0000","last_clean":"2024-05-10T09:58:04.656481+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:04.656481+0000","last_undegraded":"2024-05-10T09:58:04.656481+0000","last_fullsized":"2024-05-10T09:58:04.656481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525029+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:58:04.525029+0000","last_peered":"2024-05-10T09:58:04.525029+0000","last_clean":"2024-05-10T09:58:04.525029+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:04.525029+0000","last_undegraded":"2024-05-10T09:58:04.525029+0000","last_fullsized":"2024-05-10T09:58:04.525029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"89'15","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531332+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:58:04.531332+0000","last_peered":"2024-05-10T09:58:04.531332+0000","last_clean":"2024-05-10T09:58:04.531332+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:04.531332+0000","last_undegraded":"2024-05-10T09:58:04.531332+0000","last_fullsized":"2024-05-10T09:58:04.531332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527842+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:58:04.527842+0000","last_peered":"2024-05-10T09:58:04.527842+0000","last_clean":"2024-05-10T09:58:04.527842+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:04.527842+0000","last_undegraded":"2024-05-10T09:58:04.527842+0000","last_fullsized":"2024-05-10T09:58:04.527842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660834+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:58:04.660834+0000","last_peered":"2024-05-10T09:58:04.660834+0000","last_clean":"2024-05-10T09:58:04.660834+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:04.660834+0000","last_undegraded":"2024-05-10T09:58:04.660834+0000","last_fullsized":"2024-05-10T09:58:04.660834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655192+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:58:04.655192+0000","last_peered":"2024-05-10T09:58:04.655192+0000","last_clean":"2024-05-10T09:58:04.655192+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:04.655192+0000","last_undegraded":"2024-05-10T09:58:04.655192+0000","last_fullsized":"2024-05-10T09:58:04.655192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656460+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:58:04.656460+0000","last_peered":"2024-05-10T09:58:04.656460+0000","last_clean":"2024-05-10T09:58:04.656460+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:04.656460+0000","last_undegraded":"2024-05-10T09:58:04.656460+0000","last_fullsized":"2024-05-10T09:58:04.656460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527977+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:58:04.527977+0000","last_peered":"2024-05-10T09:58:04.527977+0000","last_clean":"2024-05-10T09:58:04.527977+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:04.527977+0000","last_undegraded":"2024-05-10T09:58:04.527977+0000","last_fullsized":"2024-05-10T09:58:04.527977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"89'19","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650811+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:58:04.650811+0000","last_peered":"2024-05-10T09:58:04.650811+0000","last_clean":"2024-05-10T09:58:04.650811+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:04.650811+0000","last_undegraded":"2024-05-10T09:58:04.650811+0000","last_fullsized":"2024-05-10T09:58:04.650811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"89'14","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648057+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:58:04.648057+0000","last_peered":"2024-05-10T09:58:04.648057+0000","last_clean":"2024-05-10T09:58:04.648057+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:04.648057+0000","last_undegraded":"2024-05-10T09:58:04.648057+0000","last_fullsized":"2024-05-10T09:58:04.648057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652535+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:58:04.652535+0000","last_peered":"2024-05-10T09:58:04.652535+0000","last_clean":"2024-05-10T09:58:04.652535+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:04.652535+0000","last_undegraded":"2024-05-10T09:58:04.652535+0000","last_fullsized":"2024-05-10T09:58:04.652535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651204+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:58:04.651204+0000","last_peered":"2024-05-10T09:58:04.651204+0000","last_clean":"2024-05-10T09:58:04.651204+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:04.651204+0000","last_undegraded":"2024-05-10T09:58:04.651204+0000","last_fullsized":"2024-05-10T09:58:04.651204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'15","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654833+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:58:04.654833+0000","last_peered":"2024-05-10T09:58:04.654833+0000","last_clean":"2024-05-10T09:58:04.654833+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:04.654833+0000","last_undegraded":"2024-05-10T09:58:04.654833+0000","last_fullsized":"2024-05-10T09:58:04.654833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":49170,"num_write":45,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526171+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:58:04.526171+0000","last_peered":"2024-05-10T09:58:04.526171+0000","last_clean":"2024-05-10T09:58:04.526171+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:04.526171+0000","last_undegraded":"2024-05-10T09:58:04.526171+0000","last_fullsized":"2024-05-10T09:58:04.526171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:37.269066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"89'24","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648751+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:58:04.648751+0000","last_peered":"2024-05-10T09:58:04.648751+0000","last_clean":"2024-05-10T09:58:04.648751+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:04.648751+0000","last_undegraded":"2024-05-10T09:58:04.648751+0000","last_fullsized":"2024-05-10T09:58:04.648751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.524822+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:58:04.524822+0000","last_peered":"2024-05-10T09:58:04.524822+0000","last_clean":"2024-05-10T09:58:04.524822+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:04.524822+0000","last_undegraded":"2024-05-10T09:58:04.524822+0000","last_fullsized":"2024-05-10T09:58:04.524822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646874+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:58:04.646874+0000","last_peered":"2024-05-10T09:58:04.646874+0000","last_clean":"2024-05-10T09:58:04.646874+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:04.646874+0000","last_undegraded":"2024-05-10T09:58:04.646874+0000","last_fullsized":"2024-05-10T09:58:04.646874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529824+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:58:04.529824+0000","last_peered":"2024-05-10T09:58:04.529824+0000","last_clean":"2024-05-10T09:58:04.529824+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:04.529824+0000","last_undegraded":"2024-05-10T09:58:04.529824+0000","last_fullsized":"2024-05-10T09:58:04.529824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528967+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:58:04.528967+0000","last_peered":"2024-05-10T09:58:04.528967+0000","last_clean":"2024-05-10T09:58:04.528967+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:04.528967+0000","last_undegraded":"2024-05-10T09:58:04.528967+0000","last_fullsized":"2024-05-10T09:58:04.528967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526622+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:58:04.526622+0000","last_peered":"2024-05-10T09:58:04.526622+0000","last_clean":"2024-05-10T09:58:04.526622+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:04.526622+0000","last_undegraded":"2024-05-10T09:58:04.526622+0000","last_fullsized":"2024-05-10T09:58:04.526622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"94'19","reported_seq":114,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530696+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:58:04.530696+0000","last_peered":"2024-05-10T09:58:04.530696+0000","last_clean":"2024-05-10T09:58:04.530696+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:04.530696+0000","last_undegraded":"2024-05-10T09:58:04.530696+0000","last_fullsized":"2024-05-10T09:58:04.530696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":33,"num_write":28,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653112+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:58:04.653112+0000","last_peered":"2024-05-10T09:58:04.653112+0000","last_clean":"2024-05-10T09:58:04.653112+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:04.653112+0000","last_undegraded":"2024-05-10T09:58:04.653112+0000","last_fullsized":"2024-05-10T09:58:04.653112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525936+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:58:04.525936+0000","last_peered":"2024-05-10T09:58:04.525936+0000","last_clean":"2024-05-10T09:58:04.525936+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:04.525936+0000","last_undegraded":"2024-05-10T09:58:04.525936+0000","last_fullsized":"2024-05-10T09:58:04.525936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529936+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:58:04.529936+0000","last_peered":"2024-05-10T09:58:04.529936+0000","last_clean":"2024-05-10T09:58:04.529936+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:04.529936+0000","last_undegraded":"2024-05-10T09:58:04.529936+0000","last_fullsized":"2024-05-10T09:58:04.529936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'7","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655796+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:58:04.655796+0000","last_peered":"2024-05-10T09:58:04.655796+0000","last_clean":"2024-05-10T09:58:04.655796+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:04.655796+0000","last_undegraded":"2024-05-10T09:58:04.655796+0000","last_fullsized":"2024-05-10T09:58:04.655796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646639+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:58:04.646639+0000","last_peered":"2024-05-10T09:58:04.646639+0000","last_clean":"2024-05-10T09:58:04.646639+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:04.646639+0000","last_undegraded":"2024-05-10T09:58:04.646639+0000","last_fullsized":"2024-05-10T09:58:04.646639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"89'22","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528148+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:58:04.528148+0000","last_peered":"2024-05-10T09:58:04.528148+0000","last_clean":"2024-05-10T09:58:04.528148+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:04.528148+0000","last_undegraded":"2024-05-10T09:58:04.528148+0000","last_fullsized":"2024-05-10T09:58:04.528148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11923,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"89'14","reported_seq":249,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529183+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:58:04.529183+0000","last_peered":"2024-05-10T09:58:04.529183+0000","last_clean":"2024-05-10T09:58:04.529183+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:04.529183+0000","last_undegraded":"2024-05-10T09:58:04.529183+0000","last_fullsized":"2024-05-10T09:58:04.529183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648186+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:58:04.648186+0000","last_peered":"2024-05-10T09:58:04.648186+0000","last_clean":"2024-05-10T09:58:04.648186+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:04.648186+0000","last_undegraded":"2024-05-10T09:58:04.648186+0000","last_fullsized":"2024-05-10T09:58:04.648186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530492+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:58:04.530492+0000","last_peered":"2024-05-10T09:58:04.530492+0000","last_clean":"2024-05-10T09:58:04.530492+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:04.530492+0000","last_undegraded":"2024-05-10T09:58:04.530492+0000","last_fullsized":"2024-05-10T09:58:04.530492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"78'3","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528266+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:58:04.528266+0000","last_peered":"2024-05-10T09:58:04.528266+0000","last_clean":"2024-05-10T09:58:04.528266+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:04.528266+0000","last_undegraded":"2024-05-10T09:58:04.528266+0000","last_fullsized":"2024-05-10T09:58:04.528266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657217+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:58:04.657217+0000","last_peered":"2024-05-10T09:58:04.657217+0000","last_clean":"2024-05-10T09:58:04.657217+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:04.657217+0000","last_undegraded":"2024-05-10T09:58:04.657217+0000","last_fullsized":"2024-05-10T09:58:04.657217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528642+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:58:04.528642+0000","last_peered":"2024-05-10T09:58:04.528642+0000","last_clean":"2024-05-10T09:58:04.528642+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:04.528642+0000","last_undegraded":"2024-05-10T09:58:04.528642+0000","last_fullsized":"2024-05-10T09:58:04.528642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"89'14","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655833+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:58:04.655833+0000","last_peered":"2024-05-10T09:58:04.655833+0000","last_clean":"2024-05-10T09:58:04.655833+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:04.655833+0000","last_undegraded":"2024-05-10T09:58:04.655833+0000","last_fullsized":"2024-05-10T09:58:04.655833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528502+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:58:04.528502+0000","last_peered":"2024-05-10T09:58:04.528502+0000","last_clean":"2024-05-10T09:58:04.528502+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:04.528502+0000","last_undegraded":"2024-05-10T09:58:04.528502+0000","last_fullsized":"2024-05-10T09:58:04.528502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647951+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:58:04.647951+0000","last_peered":"2024-05-10T09:58:04.647951+0000","last_clean":"2024-05-10T09:58:04.647951+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:04.647951+0000","last_undegraded":"2024-05-10T09:58:04.647951+0000","last_fullsized":"2024-05-10T09:58:04.647951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"89'13","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529478+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:58:04.529478+0000","last_peered":"2024-05-10T09:58:04.529478+0000","last_clean":"2024-05-10T09:58:04.529478+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:04.529478+0000","last_undegraded":"2024-05-10T09:58:04.529478+0000","last_fullsized":"2024-05-10T09:58:04.529478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530226+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:58:04.530226+0000","last_peered":"2024-05-10T09:58:04.530226+0000","last_clean":"2024-05-10T09:58:04.530226+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:04.530226+0000","last_undegraded":"2024-05-10T09:58:04.530226+0000","last_fullsized":"2024-05-10T09:58:04.530226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"89'24","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655681+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:58:04.655681+0000","last_peered":"2024-05-10T09:58:04.655681+0000","last_clean":"2024-05-10T09:58:04.655681+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:04.655681+0000","last_undegraded":"2024-05-10T09:58:04.655681+0000","last_fullsized":"2024-05-10T09:58:04.655681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652778+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:58:04.652778+0000","last_peered":"2024-05-10T09:58:04.652778+0000","last_clean":"2024-05-10T09:58:04.652778+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:04.652778+0000","last_undegraded":"2024-05-10T09:58:04.652778+0000","last_fullsized":"2024-05-10T09:58:04.652778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646928+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:58:04.646928+0000","last_peered":"2024-05-10T09:58:04.646928+0000","last_clean":"2024-05-10T09:58:04.646928+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:04.646928+0000","last_undegraded":"2024-05-10T09:58:04.646928+0000","last_fullsized":"2024-05-10T09:58:04.646928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":238,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656709+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:58:04.656709+0000","last_peered":"2024-05-10T09:58:04.656709+0000","last_clean":"2024-05-10T09:58:04.656709+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:04.656709+0000","last_undegraded":"2024-05-10T09:58:04.656709+0000","last_fullsized":"2024-05-10T09:58:04.656709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":285,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651075+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:58:04.651075+0000","last_peered":"2024-05-10T09:58:04.651075+0000","last_clean":"2024-05-10T09:58:04.651075+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:04.651075+0000","last_undegraded":"2024-05-10T09:58:04.651075+0000","last_fullsized":"2024-05-10T09:58:04.651075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651354+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:58:04.651354+0000","last_peered":"2024-05-10T09:58:04.651354+0000","last_clean":"2024-05-10T09:58:04.651354+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:04.651354+0000","last_undegraded":"2024-05-10T09:58:04.651354+0000","last_fullsized":"2024-05-10T09:58:04.651354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528876+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:58:04.528876+0000","last_peered":"2024-05-10T09:58:04.528876+0000","last_clean":"2024-05-10T09:58:04.528876+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:04.528876+0000","last_undegraded":"2024-05-10T09:58:04.528876+0000","last_fullsized":"2024-05-10T09:58:04.528876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657379+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:58:04.657379+0000","last_peered":"2024-05-10T09:58:04.657379+0000","last_clean":"2024-05-10T09:58:04.657379+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:04.657379+0000","last_undegraded":"2024-05-10T09:58:04.657379+0000","last_fullsized":"2024-05-10T09:58:04.657379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"89'31","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657459+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:58:04.657459+0000","last_peered":"2024-05-10T09:58:04.657459+0000","last_clean":"2024-05-10T09:58:04.657459+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:04.657459+0000","last_undegraded":"2024-05-10T09:58:04.657459+0000","last_fullsized":"2024-05-10T09:58:04.657459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":70,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652543+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:58:04.652543+0000","last_peered":"2024-05-10T09:58:04.652543+0000","last_clean":"2024-05-10T09:58:04.652543+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:04.652543+0000","last_undegraded":"2024-05-10T09:58:04.652543+0000","last_fullsized":"2024-05-10T09:58:04.652543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651894+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:58:04.651894+0000","last_peered":"2024-05-10T09:58:04.651894+0000","last_clean":"2024-05-10T09:58:04.651894+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:04.651894+0000","last_undegraded":"2024-05-10T09:58:04.651894+0000","last_fullsized":"2024-05-10T09:58:04.651894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652782+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:58:04.652782+0000","last_peered":"2024-05-10T09:58:04.652782+0000","last_clean":"2024-05-10T09:58:04.652782+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:04.652782+0000","last_undegraded":"2024-05-10T09:58:04.652782+0000","last_fullsized":"2024-05-10T09:58:04.652782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650560+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:58:04.650560+0000","last_peered":"2024-05-10T09:58:04.650560+0000","last_clean":"2024-05-10T09:58:04.650560+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:04.650560+0000","last_undegraded":"2024-05-10T09:58:04.650560+0000","last_fullsized":"2024-05-10T09:58:04.650560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'12","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649016+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:58:04.649016+0000","last_peered":"2024-05-10T09:58:04.649016+0000","last_clean":"2024-05-10T09:58:04.649016+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:04.649016+0000","last_undegraded":"2024-05-10T09:58:04.649016+0000","last_fullsized":"2024-05-10T09:58:04.649016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.015437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658097+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:58:04.658097+0000","last_peered":"2024-05-10T09:58:04.658097+0000","last_clean":"2024-05-10T09:58:04.658097+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:04.658097+0000","last_undegraded":"2024-05-10T09:58:04.658097+0000","last_fullsized":"2024-05-10T09:58:04.658097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"89'51","reported_seq":282,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646574+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:58:04.646574+0000","last_peered":"2024-05-10T09:58:04.646574+0000","last_clean":"2024-05-10T09:58:04.646574+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:04.646574+0000","last_undegraded":"2024-05-10T09:58:04.646574+0000","last_fullsized":"2024-05-10T09:58:04.646574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20102,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":82,"num_read_kb":100,"num_write":54,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654776+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:58:04.654776+0000","last_peered":"2024-05-10T09:58:04.654776+0000","last_clean":"2024-05-10T09:58:04.654776+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:04.654776+0000","last_undegraded":"2024-05-10T09:58:04.654776+0000","last_fullsized":"2024-05-10T09:58:04.654776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647636+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:58:04.647636+0000","last_peered":"2024-05-10T09:58:04.647636+0000","last_clean":"2024-05-10T09:58:04.647636+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:04.647636+0000","last_undegraded":"2024-05-10T09:58:04.647636+0000","last_fullsized":"2024-05-10T09:58:04.647636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648061+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:58:04.648061+0000","last_peered":"2024-05-10T09:58:04.648061+0000","last_clean":"2024-05-10T09:58:04.648061+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:04.648061+0000","last_undegraded":"2024-05-10T09:58:04.648061+0000","last_fullsized":"2024-05-10T09:58:04.648061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529781+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:58:04.529781+0000","last_peered":"2024-05-10T09:58:04.529781+0000","last_clean":"2024-05-10T09:58:04.529781+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:04.529781+0000","last_undegraded":"2024-05-10T09:58:04.529781+0000","last_fullsized":"2024-05-10T09:58:04.529781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'10","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645674+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:58:04.645674+0000","last_peered":"2024-05-10T09:58:04.645674+0000","last_clean":"2024-05-10T09:58:04.645674+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:04.645674+0000","last_undegraded":"2024-05-10T09:58:04.645674+0000","last_fullsized":"2024-05-10T09:58:04.645674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529576+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:58:04.529576+0000","last_peered":"2024-05-10T09:58:04.529576+0000","last_clean":"2024-05-10T09:58:04.529576+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:04.529576+0000","last_undegraded":"2024-05-10T09:58:04.529576+0000","last_fullsized":"2024-05-10T09:58:04.529576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655521+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:58:04.655521+0000","last_peered":"2024-05-10T09:58:04.655521+0000","last_clean":"2024-05-10T09:58:04.655521+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:04.655521+0000","last_undegraded":"2024-05-10T09:58:04.655521+0000","last_fullsized":"2024-05-10T09:58:04.655521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651737+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:58:04.651737+0000","last_peered":"2024-05-10T09:58:04.651737+0000","last_clean":"2024-05-10T09:58:04.651737+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:04.651737+0000","last_undegraded":"2024-05-10T09:58:04.651737+0000","last_fullsized":"2024-05-10T09:58:04.651737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:06.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530498+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:58:04.530498+0000","last_peered":"2024-05-10T09:58:04.530498+0000","last_clean":"2024-05-10T09:58:04.530498+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:04.530498+0000","last_undegraded":"2024-05-10T09:58:04.530498+0000","last_fullsized":"2024-05-10T09:58:04.530498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647231+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:58:04.647231+0000","last_peered":"2024-05-10T09:58:04.647231+0000","last_clean":"2024-05-10T09:58:04.647231+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:04.647231+0000","last_undegraded":"2024-05-10T09:58:04.647231+0000","last_fullsized":"2024-05-10T09:58:04.647231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653676+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:58:04.653676+0000","last_peered":"2024-05-10T09:58:04.653676+0000","last_clean":"2024-05-10T09:58:04.653676+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:04.653676+0000","last_undegraded":"2024-05-10T09:58:04.653676+0000","last_fullsized":"2024-05-10T09:58:04.653676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'10","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651974+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:58:04.651974+0000","last_peered":"2024-05-10T09:58:04.651974+0000","last_clean":"2024-05-10T09:58:04.651974+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:04.651974+0000","last_undegraded":"2024-05-10T09:58:04.651974+0000","last_fullsized":"2024-05-10T09:58:04.651974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528089+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:58:04.528089+0000","last_peered":"2024-05-10T09:58:04.528089+0000","last_clean":"2024-05-10T09:58:04.528089+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:04.528089+0000","last_undegraded":"2024-05-10T09:58:04.528089+0000","last_fullsized":"2024-05-10T09:58:04.528089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655245+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:58:04.655245+0000","last_peered":"2024-05-10T09:58:04.655245+0000","last_clean":"2024-05-10T09:58:04.655245+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:04.655245+0000","last_undegraded":"2024-05-10T09:58:04.655245+0000","last_fullsized":"2024-05-10T09:58:04.655245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649808+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:58:04.649808+0000","last_peered":"2024-05-10T09:58:04.649808+0000","last_clean":"2024-05-10T09:58:04.649808+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:04.649808+0000","last_undegraded":"2024-05-10T09:58:04.649808+0000","last_fullsized":"2024-05-10T09:58:04.649808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646914+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:58:04.646914+0000","last_peered":"2024-05-10T09:58:04.646914+0000","last_clean":"2024-05-10T09:58:04.646914+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:04.646914+0000","last_undegraded":"2024-05-10T09:58:04.646914+0000","last_fullsized":"2024-05-10T09:58:04.646914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657604+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:58:04.657604+0000","last_peered":"2024-05-10T09:58:04.657604+0000","last_clean":"2024-05-10T09:58:04.657604+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:04.657604+0000","last_undegraded":"2024-05-10T09:58:04.657604+0000","last_fullsized":"2024-05-10T09:58:04.657604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648281+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:58:04.648281+0000","last_peered":"2024-05-10T09:58:04.648281+0000","last_clean":"2024-05-10T09:58:04.648281+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:04.648281+0000","last_undegraded":"2024-05-10T09:58:04.648281+0000","last_fullsized":"2024-05-10T09:58:04.648281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649720+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:58:04.649720+0000","last_peered":"2024-05-10T09:58:04.649720+0000","last_clean":"2024-05-10T09:58:04.649720+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:04.649720+0000","last_undegraded":"2024-05-10T09:58:04.649720+0000","last_fullsized":"2024-05-10T09:58:04.649720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"89'28","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646802+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:58:04.646802+0000","last_peered":"2024-05-10T09:58:04.646802+0000","last_clean":"2024-05-10T09:58:04.646802+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:04.646802+0000","last_undegraded":"2024-05-10T09:58:04.646802+0000","last_fullsized":"2024-05-10T09:58:04.646802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11529,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529488+0000","last_change":"2024-05-10T09:57:19.676469+0000","last_active":"2024-05-10T09:58:04.529488+0000","last_peered":"2024-05-10T09:58:04.529488+0000","last_clean":"2024-05-10T09:58:04.529488+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:58:04.529488+0000","last_undegraded":"2024-05-10T09:58:04.529488+0000","last_fullsized":"2024-05-10T09:58:04.529488+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:07.877322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651956+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:58:04.651956+0000","last_peered":"2024-05-10T09:58:04.651956+0000","last_clean":"2024-05-10T09:58:04.651956+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:04.651956+0000","last_undegraded":"2024-05-10T09:58:04.651956+0000","last_fullsized":"2024-05-10T09:58:04.651956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651063+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:58:04.651063+0000","last_peered":"2024-05-10T09:58:04.651063+0000","last_clean":"2024-05-10T09:58:04.651063+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:04.651063+0000","last_undegraded":"2024-05-10T09:58:04.651063+0000","last_fullsized":"2024-05-10T09:58:04.651063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"77'3","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647490+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:58:04.647490+0000","last_peered":"2024-05-10T09:58:04.647490+0000","last_clean":"2024-05-10T09:58:04.647490+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:04.647490+0000","last_undegraded":"2024-05-10T09:58:04.647490+0000","last_fullsized":"2024-05-10T09:58:04.647490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657133+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:58:04.657133+0000","last_peered":"2024-05-10T09:58:04.657133+0000","last_clean":"2024-05-10T09:58:04.657133+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:04.657133+0000","last_undegraded":"2024-05-10T09:58:04.657133+0000","last_fullsized":"2024-05-10T09:58:04.657133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656463+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:58:04.656463+0000","last_peered":"2024-05-10T09:58:04.656463+0000","last_clean":"2024-05-10T09:58:04.656463+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:04.656463+0000","last_undegraded":"2024-05-10T09:58:04.656463+0000","last_fullsized":"2024-05-10T09:58:04.656463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645778+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:58:04.645778+0000","last_peered":"2024-05-10T09:58:04.645778+0000","last_clean":"2024-05-10T09:58:04.645778+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:04.645778+0000","last_undegraded":"2024-05-10T09:58:04.645778+0000","last_fullsized":"2024-05-10T09:58:04.645778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"89'14","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650634+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:58:04.650634+0000","last_peered":"2024-05-10T09:58:04.650634+0000","last_clean":"2024-05-10T09:58:04.650634+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:04.650634+0000","last_undegraded":"2024-05-10T09:58:04.650634+0000","last_fullsized":"2024-05-10T09:58:04.650634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531521+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:58:04.531521+0000","last_peered":"2024-05-10T09:58:04.531521+0000","last_clean":"2024-05-10T09:58:04.531521+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:04.531521+0000","last_undegraded":"2024-05-10T09:58:04.531521+0000","last_fullsized":"2024-05-10T09:58:04.531521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527816+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:58:04.527816+0000","last_peered":"2024-05-10T09:58:04.527816+0000","last_clean":"2024-05-10T09:58:04.527816+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:04.527816+0000","last_undegraded":"2024-05-10T09:58:04.527816+0000","last_fullsized":"2024-05-10T09:58:04.527816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527678+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:58:04.527678+0000","last_peered":"2024-05-10T09:58:04.527678+0000","last_clean":"2024-05-10T09:58:04.527678+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:04.527678+0000","last_undegraded":"2024-05-10T09:58:04.527678+0000","last_fullsized":"2024-05-10T09:58:04.527678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647640+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:58:04.647640+0000","last_peered":"2024-05-10T09:58:04.647640+0000","last_clean":"2024-05-10T09:58:04.647640+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:04.647640+0000","last_undegraded":"2024-05-10T09:58:04.647640+0000","last_fullsized":"2024-05-10T09:58:04.647640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528907+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:58:04.528907+0000","last_peered":"2024-05-10T09:58:04.528907+0000","last_clean":"2024-05-10T09:58:04.528907+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:04.528907+0000","last_undegraded":"2024-05-10T09:58:04.528907+0000","last_fullsized":"2024-05-10T09:58:04.528907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":99,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529276+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:58:04.529276+0000","last_peered":"2024-05-10T09:58:04.529276+0000","last_clean":"2024-05-10T09:58:04.529276+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:04.529276+0000","last_undegraded":"2024-05-10T09:58:04.529276+0000","last_fullsized":"2024-05-10T09:58:04.529276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"89'14","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531743+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:58:04.531743+0000","last_peered":"2024-05-10T09:58:04.531743+0000","last_clean":"2024-05-10T09:58:04.531743+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:04.531743+0000","last_undegraded":"2024-05-10T09:58:04.531743+0000","last_fullsized":"2024-05-10T09:58:04.531743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651782+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:58:04.651782+0000","last_peered":"2024-05-10T09:58:04.651782+0000","last_clean":"2024-05-10T09:58:04.651782+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:04.651782+0000","last_undegraded":"2024-05-10T09:58:04.651782+0000","last_fullsized":"2024-05-10T09:58:04.651782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529167+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:58:04.529167+0000","last_peered":"2024-05-10T09:58:04.529167+0000","last_clean":"2024-05-10T09:58:04.529167+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:04.529167+0000","last_undegraded":"2024-05-10T09:58:04.529167+0000","last_fullsized":"2024-05-10T09:58:04.529167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652922+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:58:04.652922+0000","last_peered":"2024-05-10T09:58:04.652922+0000","last_clean":"2024-05-10T09:58:04.652922+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:04.652922+0000","last_undegraded":"2024-05-10T09:58:04.652922+0000","last_fullsized":"2024-05-10T09:58:04.652922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":41,"num_read_kb":59422,"num_write":71,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656494+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:58:04.656494+0000","last_peered":"2024-05-10T09:58:04.656494+0000","last_clean":"2024-05-10T09:58:04.656494+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:04.656494+0000","last_undegraded":"2024-05-10T09:58:04.656494+0000","last_fullsized":"2024-05-10T09:58:04.656494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527204+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:58:04.527204+0000","last_peered":"2024-05-10T09:58:04.527204+0000","last_clean":"2024-05-10T09:58:04.527204+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:04.527204+0000","last_undegraded":"2024-05-10T09:58:04.527204+0000","last_fullsized":"2024-05-10T09:58:04.527204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"89'35","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653416+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:58:04.653416+0000","last_peered":"2024-05-10T09:58:04.653416+0000","last_clean":"2024-05-10T09:58:04.653416+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:04.653416+0000","last_undegraded":"2024-05-10T09:58:04.653416+0000","last_fullsized":"2024-05-10T09:58:04.653416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17853,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":59,"num_read_kb":66,"num_write":42,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528099+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:58:04.528099+0000","last_peered":"2024-05-10T09:58:04.528099+0000","last_clean":"2024-05-10T09:58:04.528099+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:04.528099+0000","last_undegraded":"2024-05-10T09:58:04.528099+0000","last_fullsized":"2024-05-10T09:58:04.528099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650656+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:58:04.650656+0000","last_peered":"2024-05-10T09:58:04.650656+0000","last_clean":"2024-05-10T09:58:04.650656+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:04.650656+0000","last_undegraded":"2024-05-10T09:58:04.650656+0000","last_fullsized":"2024-05-10T09:58:04.650656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652973+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:58:04.652973+0000","last_peered":"2024-05-10T09:58:04.652973+0000","last_clean":"2024-05-10T09:58:04.652973+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:04.652973+0000","last_undegraded":"2024-05-10T09:58:04.652973+0000","last_fullsized":"2024-05-10T09:58:04.652973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529250+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:58:04.529250+0000","last_peered":"2024-05-10T09:58:04.529250+0000","last_clean":"2024-05-10T09:58:04.529250+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:04.529250+0000","last_undegraded":"2024-05-10T09:58:04.529250+0000","last_fullsized":"2024-05-10T09:58:04.529250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"79'7","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528880+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:58:04.528880+0000","last_peered":"2024-05-10T09:58:04.528880+0000","last_clean":"2024-05-10T09:58:04.528880+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:04.528880+0000","last_undegraded":"2024-05-10T09:58:04.528880+0000","last_fullsized":"2024-05-10T09:58:04.528880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647012+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:58:04.647012+0000","last_peered":"2024-05-10T09:58:04.647012+0000","last_clean":"2024-05-10T09:58:04.647012+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:04.647012+0000","last_undegraded":"2024-05-10T09:58:04.647012+0000","last_fullsized":"2024-05-10T09:58:04.647012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"89'17","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527493+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:58:04.527493+0000","last_peered":"2024-05-10T09:58:04.527493+0000","last_clean":"2024-05-10T09:58:04.527493+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:04.527493+0000","last_undegraded":"2024-05-10T09:58:04.527493+0000","last_fullsized":"2024-05-10T09:58:04.527493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526191+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:58:04.526191+0000","last_peered":"2024-05-10T09:58:04.526191+0000","last_clean":"2024-05-10T09:58:04.526191+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:04.526191+0000","last_undegraded":"2024-05-10T09:58:04.526191+0000","last_fullsized":"2024-05-10T09:58:04.526191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527534+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:58:04.527534+0000","last_peered":"2024-05-10T09:58:04.527534+0000","last_clean":"2024-05-10T09:58:04.527534+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:04.527534+0000","last_undegraded":"2024-05-10T09:58:04.527534+0000","last_fullsized":"2024-05-10T09:58:04.527534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646813+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:58:04.646813+0000","last_peered":"2024-05-10T09:58:04.646813+0000","last_clean":"2024-05-10T09:58:04.646813+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:04.646813+0000","last_undegraded":"2024-05-10T09:58:04.646813+0000","last_fullsized":"2024-05-10T09:58:04.646813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656190+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:58:04.656190+0000","last_peered":"2024-05-10T09:58:04.656190+0000","last_clean":"2024-05-10T09:58:04.656190+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:04.656190+0000","last_undegraded":"2024-05-10T09:58:04.656190+0000","last_fullsized":"2024-05-10T09:58:04.656190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":30738,"num_write":42,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530067+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:58:04.530067+0000","last_peered":"2024-05-10T09:58:04.530067+0000","last_clean":"2024-05-10T09:58:04.530067+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:04.530067+0000","last_undegraded":"2024-05-10T09:58:04.530067+0000","last_fullsized":"2024-05-10T09:58:04.530067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646603+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:58:04.646603+0000","last_peered":"2024-05-10T09:58:04.646603+0000","last_clean":"2024-05-10T09:58:04.646603+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:04.646603+0000","last_undegraded":"2024-05-10T09:58:04.646603+0000","last_fullsized":"2024-05-10T09:58:04.646603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651652+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:58:04.651652+0000","last_peered":"2024-05-10T09:58:04.651652+0000","last_clean":"2024-05-10T09:58:04.651652+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:04.651652+0000","last_undegraded":"2024-05-10T09:58:04.651652+0000","last_fullsized":"2024-05-10T09:58:04.651652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651848+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:58:04.651848+0000","last_peered":"2024-05-10T09:58:04.651848+0000","last_clean":"2024-05-10T09:58:04.651848+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:04.651848+0000","last_undegraded":"2024-05-10T09:58:04.651848+0000","last_fullsized":"2024-05-10T09:58:04.651848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530746+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:58:04.530746+0000","last_peered":"2024-05-10T09:58:04.530746+0000","last_clean":"2024-05-10T09:58:04.530746+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:04.530746+0000","last_undegraded":"2024-05-10T09:58:04.530746+0000","last_fullsized":"2024-05-10T09:58:04.530746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'9","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657229+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:58:04.657229+0000","last_peered":"2024-05-10T09:58:04.657229+0000","last_clean":"2024-05-10T09:58:04.657229+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:04.657229+0000","last_undegraded":"2024-05-10T09:58:04.657229+0000","last_fullsized":"2024-05-10T09:58:04.657229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649736+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:58:04.649736+0000","last_peered":"2024-05-10T09:58:04.649736+0000","last_clean":"2024-05-10T09:58:04.649736+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:04.649736+0000","last_undegraded":"2024-05-10T09:58:04.649736+0000","last_fullsized":"2024-05-10T09:58:04.649736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"89'18","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529286+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:58:04.529286+0000","last_peered":"2024-05-10T09:58:04.529286+0000","last_clean":"2024-05-10T09:58:04.529286+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:04.529286+0000","last_undegraded":"2024-05-10T09:58:04.529286+0000","last_fullsized":"2024-05-10T09:58:04.529286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654262+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:58:04.654262+0000","last_peered":"2024-05-10T09:58:04.654262+0000","last_clean":"2024-05-10T09:58:04.654262+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:04.654262+0000","last_undegraded":"2024-05-10T09:58:04.654262+0000","last_fullsized":"2024-05-10T09:58:04.654262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653292+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:58:04.653292+0000","last_peered":"2024-05-10T09:58:04.653292+0000","last_clean":"2024-05-10T09:58:04.653292+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:04.653292+0000","last_undegraded":"2024-05-10T09:58:04.653292+0000","last_fullsized":"2024-05-10T09:58:04.653292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528375+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:58:04.528375+0000","last_peered":"2024-05-10T09:58:04.528375+0000","last_clean":"2024-05-10T09:58:04.528375+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:04.528375+0000","last_undegraded":"2024-05-10T09:58:04.528375+0000","last_fullsized":"2024-05-10T09:58:04.528375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653595+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:58:04.653595+0000","last_peered":"2024-05-10T09:58:04.653595+0000","last_clean":"2024-05-10T09:58:04.653595+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:04.653595+0000","last_undegraded":"2024-05-10T09:58:04.653595+0000","last_fullsized":"2024-05-10T09:58:04.653595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40978,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654529+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:58:04.654529+0000","last_peered":"2024-05-10T09:58:04.654529+0000","last_clean":"2024-05-10T09:58:04.654529+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:04.654529+0000","last_undegraded":"2024-05-10T09:58:04.654529+0000","last_fullsized":"2024-05-10T09:58:04.654529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"89'15","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653237+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:58:04.653237+0000","last_peered":"2024-05-10T09:58:04.653237+0000","last_clean":"2024-05-10T09:58:04.653237+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:04.653237+0000","last_undegraded":"2024-05-10T09:58:04.653237+0000","last_fullsized":"2024-05-10T09:58:04.653237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648770+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:58:04.648770+0000","last_peered":"2024-05-10T09:58:04.648770+0000","last_clean":"2024-05-10T09:58:04.648770+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:04.648770+0000","last_undegraded":"2024-05-10T09:58:04.648770+0000","last_fullsized":"2024-05-10T09:58:04.648770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656182+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:58:04.656182+0000","last_peered":"2024-05-10T09:58:04.656182+0000","last_clean":"2024-05-10T09:58:04.656182+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:04.656182+0000","last_undegraded":"2024-05-10T09:58:04.656182+0000","last_fullsized":"2024-05-10T09:58:04.656182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529228+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:58:04.529228+0000","last_peered":"2024-05-10T09:58:04.529228+0000","last_clean":"2024-05-10T09:58:04.529228+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:04.529228+0000","last_undegraded":"2024-05-10T09:58:04.529228+0000","last_fullsized":"2024-05-10T09:58:04.529228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":27,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652635+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:58:04.652635+0000","last_peered":"2024-05-10T09:58:04.652635+0000","last_clean":"2024-05-10T09:58:04.652635+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:04.652635+0000","last_undegraded":"2024-05-10T09:58:04.652635+0000","last_fullsized":"2024-05-10T09:58:04.652635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"89'21","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647027+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:58:04.647027+0000","last_peered":"2024-05-10T09:58:04.647027+0000","last_clean":"2024-05-10T09:58:04.647027+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:04.647027+0000","last_undegraded":"2024-05-10T09:58:04.647027+0000","last_fullsized":"2024-05-10T09:58:04.647027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10974,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":24,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653816+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:58:04.653816+0000","last_peered":"2024-05-10T09:58:04.653816+0000","last_clean":"2024-05-10T09:58:04.653816+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:04.653816+0000","last_undegraded":"2024-05-10T09:58:04.653816+0000","last_fullsized":"2024-05-10T09:58:04.653816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528651+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:58:04.528651+0000","last_peered":"2024-05-10T09:58:04.528651+0000","last_clean":"2024-05-10T09:58:04.528651+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:04.528651+0000","last_undegraded":"2024-05-10T09:58:04.528651+0000","last_fullsized":"2024-05-10T09:58:04.528651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652727+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:58:04.652727+0000","last_peered":"2024-05-10T09:58:04.652727+0000","last_clean":"2024-05-10T09:58:04.652727+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:04.652727+0000","last_undegraded":"2024-05-10T09:58:04.652727+0000","last_fullsized":"2024-05-10T09:58:04.652727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646498+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:58:04.646498+0000","last_peered":"2024-05-10T09:58:04.646498+0000","last_clean":"2024-05-10T09:58:04.646498+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:04.646498+0000","last_undegraded":"2024-05-10T09:58:04.646498+0000","last_fullsized":"2024-05-10T09:58:04.646498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":30726,"num_write":21,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655646+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:58:04.655646+0000","last_peered":"2024-05-10T09:58:04.655646+0000","last_clean":"2024-05-10T09:58:04.655646+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:04.655646+0000","last_undegraded":"2024-05-10T09:58:04.655646+0000","last_fullsized":"2024-05-10T09:58:04.655646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"89'21","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653505+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:58:04.653505+0000","last_peered":"2024-05-10T09:58:04.653505+0000","last_clean":"2024-05-10T09:58:04.653505+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:04.653505+0000","last_undegraded":"2024-05-10T09:58:04.653505+0000","last_fullsized":"2024-05-10T09:58:04.653505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647328+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:58:04.647328+0000","last_peered":"2024-05-10T09:58:04.647328+0000","last_clean":"2024-05-10T09:58:04.647328+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:04.647328+0000","last_undegraded":"2024-05-10T09:58:04.647328+0000","last_fullsized":"2024-05-10T09:58:04.647328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652826+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:58:04.652826+0000","last_peered":"2024-05-10T09:58:04.652826+0000","last_clean":"2024-05-10T09:58:04.652826+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:04.652826+0000","last_undegraded":"2024-05-10T09:58:04.652826+0000","last_fullsized":"2024-05-10T09:58:04.652826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528292+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:58:04.528292+0000","last_peered":"2024-05-10T09:58:04.528292+0000","last_clean":"2024-05-10T09:58:04.528292+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:04.528292+0000","last_undegraded":"2024-05-10T09:58:04.528292+0000","last_fullsized":"2024-05-10T09:58:04.528292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528195+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:58:04.528195+0000","last_peered":"2024-05-10T09:58:04.528195+0000","last_clean":"2024-05-10T09:58:04.528195+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:04.528195+0000","last_undegraded":"2024-05-10T09:58:04.528195+0000","last_fullsized":"2024-05-10T09:58:04.528195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529014+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:58:04.529014+0000","last_peered":"2024-05-10T09:58:04.529014+0000","last_clean":"2024-05-10T09:58:04.529014+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:04.529014+0000","last_undegraded":"2024-05-10T09:58:04.529014+0000","last_fullsized":"2024-05-10T09:58:04.529014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"89'16","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531919+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:58:04.531919+0000","last_peered":"2024-05-10T09:58:04.531919+0000","last_clean":"2024-05-10T09:58:04.531919+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:04.531919+0000","last_undegraded":"2024-05-10T09:58:04.531919+0000","last_fullsized":"2024-05-10T09:58:04.531919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647189+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:58:04.647189+0000","last_peered":"2024-05-10T09:58:04.647189+0000","last_clean":"2024-05-10T09:58:04.647189+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:04.647189+0000","last_undegraded":"2024-05-10T09:58:04.647189+0000","last_fullsized":"2024-05-10T09:58:04.647189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650463+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:58:04.650463+0000","last_peered":"2024-05-10T09:58:04.650463+0000","last_clean":"2024-05-10T09:58:04.650463+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:04.650463+0000","last_undegraded":"2024-05-10T09:58:04.650463+0000","last_fullsized":"2024-05-10T09:58:04.650463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526549+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:58:04.526549+0000","last_peered":"2024-05-10T09:58:04.526549+0000","last_clean":"2024-05-10T09:58:04.526549+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:04.526549+0000","last_undegraded":"2024-05-10T09:58:04.526549+0000","last_fullsized":"2024-05-10T09:58:04.526549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"79'11","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649007+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:58:04.649007+0000","last_peered":"2024-05-10T09:58:04.649007+0000","last_clean":"2024-05-10T09:58:04.649007+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:04.649007+0000","last_undegraded":"2024-05-10T09:58:04.649007+0000","last_fullsized":"2024-05-10T09:58:04.649007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:36.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647618+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:58:04.647618+0000","last_peered":"2024-05-10T09:58:04.647618+0000","last_clean":"2024-05-10T09:58:04.647618+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:04.647618+0000","last_undegraded":"2024-05-10T09:58:04.647618+0000","last_fullsized":"2024-05-10T09:58:04.647618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":103,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530384+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:58:04.530384+0000","last_peered":"2024-05-10T09:58:04.530384+0000","last_clean":"2024-05-10T09:58:04.530384+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:04.530384+0000","last_undegraded":"2024-05-10T09:58:04.530384+0000","last_fullsized":"2024-05-10T09:58:04.530384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"89'16","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651661+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:58:04.651661+0000","last_peered":"2024-05-10T09:58:04.651661+0000","last_clean":"2024-05-10T09:58:04.651661+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:04.651661+0000","last_undegraded":"2024-05-10T09:58:04.651661+0000","last_fullsized":"2024-05-10T09:58:04.651661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649718+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:58:04.649718+0000","last_peered":"2024-05-10T09:58:04.649718+0000","last_clean":"2024-05-10T09:58:04.649718+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:04.649718+0000","last_undegraded":"2024-05-10T09:58:04.649718+0000","last_fullsized":"2024-05-10T09:58:04.649718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":131,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646678+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:58:04.646678+0000","last_peered":"2024-05-10T09:58:04.646678+0000","last_clean":"2024-05-10T09:58:04.646678+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:04.646678+0000","last_undegraded":"2024-05-10T09:58:04.646678+0000","last_fullsized":"2024-05-10T09:58:04.646678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654431+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:58:04.654431+0000","last_peered":"2024-05-10T09:58:04.654431+0000","last_clean":"2024-05-10T09:58:04.654431+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:04.654431+0000","last_undegraded":"2024-05-10T09:58:04.654431+0000","last_fullsized":"2024-05-10T09:58:04.654431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18450,"num_write":39,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653243+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:58:04.653243+0000","last_peered":"2024-05-10T09:58:04.653243+0000","last_clean":"2024-05-10T09:58:04.653243+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:04.653243+0000","last_undegraded":"2024-05-10T09:58:04.653243+0000","last_fullsized":"2024-05-10T09:58:04.653243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"89'19","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653251+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:58:04.653251+0000","last_peered":"2024-05-10T09:58:04.653251+0000","last_clean":"2024-05-10T09:58:04.653251+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:04.653251+0000","last_undegraded":"2024-05-10T09:58:04.653251+0000","last_fullsized":"2024-05-10T09:58:04.653251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646293+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:58:04.646293+0000","last_peered":"2024-05-10T09:58:04.646293+0000","last_clean":"2024-05-10T09:58:04.646293+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:04.646293+0000","last_undegraded":"2024-05-10T09:58:04.646293+0000","last_fullsized":"2024-05-10T09:58:04.646293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658184+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:58:04.658184+0000","last_peered":"2024-05-10T09:58:04.658184+0000","last_clean":"2024-05-10T09:58:04.658184+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:04.658184+0000","last_undegraded":"2024-05-10T09:58:04.658184+0000","last_fullsized":"2024-05-10T09:58:04.658184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529018+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:58:04.529018+0000","last_peered":"2024-05-10T09:58:04.529018+0000","last_clean":"2024-05-10T09:58:04.529018+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:04.529018+0000","last_undegraded":"2024-05-10T09:58:04.529018+0000","last_fullsized":"2024-05-10T09:58:04.529018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657322+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:58:04.657322+0000","last_peered":"2024-05-10T09:58:04.657322+0000","last_clean":"2024-05-10T09:58:04.657322+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:04.657322+0000","last_undegraded":"2024-05-10T09:58:04.657322+0000","last_fullsized":"2024-05-10T09:58:04.657322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650809+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:58:04.650809+0000","last_peered":"2024-05-10T09:58:04.650809+0000","last_clean":"2024-05-10T09:58:04.650809+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:04.650809+0000","last_undegraded":"2024-05-10T09:58:04.650809+0000","last_fullsized":"2024-05-10T09:58:04.650809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646411+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:58:04.646411+0000","last_peered":"2024-05-10T09:58:04.646411+0000","last_clean":"2024-05-10T09:58:04.646411+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:04.646411+0000","last_undegraded":"2024-05-10T09:58:04.646411+0000","last_fullsized":"2024-05-10T09:58:04.646411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652426+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:58:04.652426+0000","last_peered":"2024-05-10T09:58:04.652426+0000","last_clean":"2024-05-10T09:58:04.652426+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:04.652426+0000","last_undegraded":"2024-05-10T09:58:04.652426+0000","last_fullsized":"2024-05-10T09:58:04.652426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527768+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:58:04.527768+0000","last_peered":"2024-05-10T09:58:04.527768+0000","last_clean":"2024-05-10T09:58:04.527768+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:04.527768+0000","last_undegraded":"2024-05-10T09:58:04.527768+0000","last_fullsized":"2024-05-10T09:58:04.527768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531028+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:58:04.531028+0000","last_peered":"2024-05-10T09:58:04.531028+0000","last_clean":"2024-05-10T09:58:04.531028+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:04.531028+0000","last_undegraded":"2024-05-10T09:58:04.531028+0000","last_fullsized":"2024-05-10T09:58:04.531028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528950+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:58:04.528950+0000","last_peered":"2024-05-10T09:58:04.528950+0000","last_clean":"2024-05-10T09:58:04.528950+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:04.528950+0000","last_undegraded":"2024-05-10T09:58:04.528950+0000","last_fullsized":"2024-05-10T09:58:04.528950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527959+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:58:04.527959+0000","last_peered":"2024-05-10T09:58:04.527959+0000","last_clean":"2024-05-10T09:58:04.527959+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:04.527959+0000","last_undegraded":"2024-05-10T09:58:04.527959+0000","last_fullsized":"2024-05-10T09:58:04.527959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"89'8","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531553+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:58:04.531553+0000","last_peered":"2024-05-10T09:58:04.531553+0000","last_clean":"2024-05-10T09:58:04.531553+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:04.531553+0000","last_undegraded":"2024-05-10T09:58:04.531553+0000","last_fullsized":"2024-05-10T09:58:04.531553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529836+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:58:04.529836+0000","last_peered":"2024-05-10T09:58:04.529836+0000","last_clean":"2024-05-10T09:58:04.529836+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:04.529836+0000","last_undegraded":"2024-05-10T09:58:04.529836+0000","last_fullsized":"2024-05-10T09:58:04.529836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655255+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:58:04.655255+0000","last_peered":"2024-05-10T09:58:04.655255+0000","last_clean":"2024-05-10T09:58:04.655255+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:04.655255+0000","last_undegraded":"2024-05-10T09:58:04.655255+0000","last_fullsized":"2024-05-10T09:58:04.655255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527607+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:58:04.527607+0000","last_peered":"2024-05-10T09:58:04.527607+0000","last_clean":"2024-05-10T09:58:04.527607+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:04.527607+0000","last_undegraded":"2024-05-10T09:58:04.527607+0000","last_fullsized":"2024-05-10T09:58:04.527607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653419+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:58:04.653419+0000","last_peered":"2024-05-10T09:58:04.653419+0000","last_clean":"2024-05-10T09:58:04.653419+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:04.653419+0000","last_undegraded":"2024-05-10T09:58:04.653419+0000","last_fullsized":"2024-05-10T09:58:04.653419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645798+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:58:04.645798+0000","last_peered":"2024-05-10T09:58:04.645798+0000","last_clean":"2024-05-10T09:58:04.645798+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:04.645798+0000","last_undegraded":"2024-05-10T09:58:04.645798+0000","last_fullsized":"2024-05-10T09:58:04.645798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"89'14","reported_seq":107,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528957+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:58:04.528957+0000","last_peered":"2024-05-10T09:58:04.528957+0000","last_clean":"2024-05-10T09:58:04.528957+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:04.528957+0000","last_undegraded":"2024-05-10T09:58:04.528957+0000","last_fullsized":"2024-05-10T09:58:04.528957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648510+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:58:04.648510+0000","last_peered":"2024-05-10T09:58:04.648510+0000","last_clean":"2024-05-10T09:58:04.648510+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:04.648510+0000","last_undegraded":"2024-05-10T09:58:04.648510+0000","last_fullsized":"2024-05-10T09:58:04.648510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529237+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:58:04.529237+0000","last_peered":"2024-05-10T09:58:04.529237+0000","last_clean":"2024-05-10T09:58:04.529237+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:04.529237+0000","last_undegraded":"2024-05-10T09:58:04.529237+0000","last_fullsized":"2024-05-10T09:58:04.529237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647961+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:58:04.647961+0000","last_peered":"2024-05-10T09:58:04.647961+0000","last_clean":"2024-05-10T09:58:04.647961+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:04.647961+0000","last_undegraded":"2024-05-10T09:58:04.647961+0000","last_fullsized":"2024-05-10T09:58:04.647961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654410+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:58:04.654410+0000","last_peered":"2024-05-10T09:58:04.654410+0000","last_clean":"2024-05-10T09:58:04.654410+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:04.654410+0000","last_undegraded":"2024-05-10T09:58:04.654410+0000","last_fullsized":"2024-05-10T09:58:04.654410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647419+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:58:04.647419+0000","last_peered":"2024-05-10T09:58:04.647419+0000","last_clean":"2024-05-10T09:58:04.647419+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:04.647419+0000","last_undegraded":"2024-05-10T09:58:04.647419+0000","last_fullsized":"2024-05-10T09:58:04.647419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'14","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529372+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:58:04.529372+0000","last_peered":"2024-05-10T09:58:04.529372+0000","last_clean":"2024-05-10T09:58:04.529372+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:04.529372+0000","last_undegraded":"2024-05-10T09:58:04.529372+0000","last_fullsized":"2024-05-10T09:58:04.529372+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656340+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:58:04.656340+0000","last_peered":"2024-05-10T09:58:04.656340+0000","last_clean":"2024-05-10T09:58:04.656340+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:04.656340+0000","last_undegraded":"2024-05-10T09:58:04.656340+0000","last_fullsized":"2024-05-10T09:58:04.656340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"79'6","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652452+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:58:04.652452+0000","last_peered":"2024-05-10T09:58:04.652452+0000","last_clean":"2024-05-10T09:58:04.652452+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:04.652452+0000","last_undegraded":"2024-05-10T09:58:04.652452+0000","last_fullsized":"2024-05-10T09:58:04.652452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648308+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:58:04.648308+0000","last_peered":"2024-05-10T09:58:04.648308+0000","last_clean":"2024-05-10T09:58:04.648308+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:04.648308+0000","last_undegraded":"2024-05-10T09:58:04.648308+0000","last_fullsized":"2024-05-10T09:58:04.648308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649477+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:58:04.649477+0000","last_peered":"2024-05-10T09:58:04.649477+0000","last_clean":"2024-05-10T09:58:04.649477+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:04.649477+0000","last_undegraded":"2024-05-10T09:58:04.649477+0000","last_fullsized":"2024-05-10T09:58:04.649477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":29,"num_read_kb":71692,"num_write":41,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530949+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:58:04.530949+0000","last_peered":"2024-05-10T09:58:04.530949+0000","last_clean":"2024-05-10T09:58:04.530949+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:04.530949+0000","last_undegraded":"2024-05-10T09:58:04.530949+0000","last_fullsized":"2024-05-10T09:58:04.530949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'5","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531779+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:58:04.531779+0000","last_peered":"2024-05-10T09:58:04.531779+0000","last_clean":"2024-05-10T09:58:04.531779+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:58:04.531779+0000","last_undegraded":"2024-05-10T09:58:04.531779+0000","last_fullsized":"2024-05-10T09:58:04.531779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528181+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:58:04.528181+0000","last_peered":"2024-05-10T09:58:04.528181+0000","last_clean":"2024-05-10T09:58:04.528181+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:04.528181+0000","last_undegraded":"2024-05-10T09:58:04.528181+0000","last_fullsized":"2024-05-10T09:58:04.528181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"79'8","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648027+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:58:04.648027+0000","last_peered":"2024-05-10T09:58:04.648027+0000","last_clean":"2024-05-10T09:58:04.648027+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:04.648027+0000","last_undegraded":"2024-05-10T09:58:04.648027+0000","last_fullsized":"2024-05-10T09:58:04.648027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":145,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528710+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:58:04.528710+0000","last_peered":"2024-05-10T09:58:04.528710+0000","last_clean":"2024-05-10T09:58:04.528710+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:04.528710+0000","last_undegraded":"2024-05-10T09:58:04.528710+0000","last_fullsized":"2024-05-10T09:58:04.528710+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660880+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:58:04.660880+0000","last_peered":"2024-05-10T09:58:04.660880+0000","last_clean":"2024-05-10T09:58:04.660880+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:04.660880+0000","last_undegraded":"2024-05-10T09:58:04.660880+0000","last_fullsized":"2024-05-10T09:58:04.660880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651663+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:58:04.651663+0000","last_peered":"2024-05-10T09:58:04.651663+0000","last_clean":"2024-05-10T09:58:04.651663+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:04.651663+0000","last_undegraded":"2024-05-10T09:58:04.651663+0000","last_fullsized":"2024-05-10T09:58:04.651663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'11","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531405+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:58:04.531405+0000","last_peered":"2024-05-10T09:58:04.531405+0000","last_clean":"2024-05-10T09:58:04.531405+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:04.531405+0000","last_undegraded":"2024-05-10T09:58:04.531405+0000","last_fullsized":"2024-05-10T09:58:04.531405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36870,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653362+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:58:04.653362+0000","last_peered":"2024-05-10T09:58:04.653362+0000","last_clean":"2024-05-10T09:58:04.653362+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:04.653362+0000","last_undegraded":"2024-05-10T09:58:04.653362+0000","last_fullsized":"2024-05-10T09:58:04.653362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651637+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:58:04.651637+0000","last_peered":"2024-05-10T09:58:04.651637+0000","last_clean":"2024-05-10T09:58:04.651637+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:04.651637+0000","last_undegraded":"2024-05-10T09:58:04.651637+0000","last_fullsized":"2024-05-10T09:58:04.651637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":36870,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529866+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:58:04.529866+0000","last_peered":"2024-05-10T09:58:04.529866+0000","last_clean":"2024-05-10T09:58:04.529866+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:04.529866+0000","last_undegraded":"2024-05-10T09:58:04.529866+0000","last_fullsized":"2024-05-10T09:58:04.529866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'16","reported_seq":243,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531176+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:58:04.531176+0000","last_peered":"2024-05-10T09:58:04.531176+0000","last_clean":"2024-05-10T09:58:04.531176+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:58:04.531176+0000","last_undegraded":"2024-05-10T09:58:04.531176+0000","last_fullsized":"2024-05-10T09:58:04.531176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527324+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:58:04.527324+0000","last_peered":"2024-05-10T09:58:04.527324+0000","last_clean":"2024-05-10T09:58:04.527324+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:04.527324+0000","last_undegraded":"2024-05-10T09:58:04.527324+0000","last_fullsized":"2024-05-10T09:58:04.527324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652210+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:58:04.652210+0000","last_peered":"2024-05-10T09:58:04.652210+0000","last_clean":"2024-05-10T09:58:04.652210+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:04.652210+0000","last_undegraded":"2024-05-10T09:58:04.652210+0000","last_fullsized":"2024-05-10T09:58:04.652210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530261+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:58:04.530261+0000","last_peered":"2024-05-10T09:58:04.530261+0000","last_clean":"2024-05-10T09:58:04.530261+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:04.530261+0000","last_undegraded":"2024-05-10T09:58:04.530261+0000","last_fullsized":"2024-05-10T09:58:04.530261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650076+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:58:04.650076+0000","last_peered":"2024-05-10T09:58:04.650076+0000","last_clean":"2024-05-10T09:58:04.650076+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:04.650076+0000","last_undegraded":"2024-05-10T09:58:04.650076+0000","last_fullsized":"2024-05-10T09:58:04.650076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654023+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:58:04.654023+0000","last_peered":"2024-05-10T09:58:04.654023+0000","last_clean":"2024-05-10T09:58:04.654023+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:04.654023+0000","last_undegraded":"2024-05-10T09:58:04.654023+0000","last_fullsized":"2024-05-10T09:58:04.654023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'14","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655299+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:58:04.655299+0000","last_peered":"2024-05-10T09:58:04.655299+0000","last_clean":"2024-05-10T09:58:04.655299+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:04.655299+0000","last_undegraded":"2024-05-10T09:58:04.655299+0000","last_fullsized":"2024-05-10T09:58:04.655299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":23,"num_read_kb":36880,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649741+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:58:04.649741+0000","last_peered":"2024-05-10T09:58:04.649741+0000","last_clean":"2024-05-10T09:58:04.649741+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:04.649741+0000","last_undegraded":"2024-05-10T09:58:04.649741+0000","last_fullsized":"2024-05-10T09:58:04.649741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'13","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656883+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:58:04.656883+0000","last_peered":"2024-05-10T09:58:04.656883+0000","last_clean":"2024-05-10T09:58:04.656883+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:04.656883+0000","last_undegraded":"2024-05-10T09:58:04.656883+0000","last_fullsized":"2024-05-10T09:58:04.656883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":34834,"num_write":43,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530476+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:58:04.530476+0000","last_peered":"2024-05-10T09:58:04.530476+0000","last_clean":"2024-05-10T09:58:04.530476+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:04.530476+0000","last_undegraded":"2024-05-10T09:58:04.530476+0000","last_fullsized":"2024-05-10T09:58:04.530476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'9","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530270+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:58:04.530270+0000","last_peered":"2024-05-10T09:58:04.530270+0000","last_clean":"2024-05-10T09:58:04.530270+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:04.530270+0000","last_undegraded":"2024-05-10T09:58:04.530270+0000","last_fullsized":"2024-05-10T09:58:04.530270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650180+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:58:04.650180+0000","last_peered":"2024-05-10T09:58:04.650180+0000","last_clean":"2024-05-10T09:58:04.650180+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:04.650180+0000","last_undegraded":"2024-05-10T09:58:04.650180+0000","last_fullsized":"2024-05-10T09:58:04.650180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658360+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:58:04.658360+0000","last_peered":"2024-05-10T09:58:04.658360+0000","last_clean":"2024-05-10T09:58:04.658360+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:04.658360+0000","last_undegraded":"2024-05-10T09:58:04.658360+0000","last_fullsized":"2024-05-10T09:58:04.658360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":36882,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'8","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651346+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:58:04.651346+0000","last_peered":"2024-05-10T09:58:04.651346+0000","last_clean":"2024-05-10T09:58:04.651346+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:04.651346+0000","last_undegraded":"2024-05-10T09:58:04.651346+0000","last_fullsized":"2024-05-10T09:58:04.651346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653196+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:58:04.653196+0000","last_peered":"2024-05-10T09:58:04.653196+0000","last_clean":"2024-05-10T09:58:04.653196+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:04.653196+0000","last_undegraded":"2024-05-10T09:58:04.653196+0000","last_fullsized":"2024-05-10T09:58:04.653196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'9","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646387+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:58:04.646387+0000","last_peered":"2024-05-10T09:58:04.646387+0000","last_clean":"2024-05-10T09:58:04.646387+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:04.646387+0000","last_undegraded":"2024-05-10T09:58:04.646387+0000","last_fullsized":"2024-05-10T09:58:04.646387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657058+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:58:04.657058+0000","last_peered":"2024-05-10T09:58:04.657058+0000","last_clean":"2024-05-10T09:58:04.657058+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:04.657058+0000","last_undegraded":"2024-05-10T09:58:04.657058+0000","last_fullsized":"2024-05-10T09:58:04.657058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242916,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":922,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":230728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1082,"num_read_kb":2003600,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":452984,"kb_used_data":421804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93918856,"statfs":{"total":96636764160,"available":96172908544,"internally_reserved":0,"allocated":431927296,"data_stored":431305753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323336,"kb_used_data":292156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048504,"statfs":{"total":96636764160,"available":96305668096,"internally_reserved":0,"allocated":299167744,"data_stored":298578850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505676,"kb_used_data":474492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866164,"statfs":{"total":96636764160,"available":96118951936,"internally_reserved":0,"allocated":485879808,"data_stored":485241465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285582,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508200,"kb_used_data":476444,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":93863640,"statfs":{"total":96636764160,"available":96116367360,"internally_reserved":0,"allocated":487878656,"data_stored":487316023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538480,"kb_used_data":503140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93833360,"statfs":{"total":96636764160,"available":96085360640,"internally_reserved":0,"allocated":515215360,"data_stored":514612407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509488,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263980,"kb_used_data":228636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94107860,"statfs":{"total":96636764160,"available":96366448640,"internally_reserved":0,"allocated":234123264,"data_stored":233561927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509489,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555420,"kb_used_data":520076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93816420,"statfs":{"total":96636764160,"available":96068014080,"internally_reserved":0,"allocated":532557824,"data_stored":531963325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542193,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329624,"kb_used_data":290124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94042216,"statfs":{"total":96636764160,"available":96299229184,"internally_reserved":0,"allocated":297086976,"data_stored":296483812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":530579456,"data_stored":530579456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":295698432,"data_stored":295698432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":232783872,"data_stored":232783872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":513802240,"data_stored":513802240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":429916160,"data_stored":429916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":31596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":23865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":16540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":48698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":14205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":37700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":37756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:58:08.494 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-10T09:58:08.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-05-10T09:58:08.851 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-10T09:58:08.861 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-10T09:58:08.861 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:58:08.862 INFO:tasks.rgw.client.0.smithi042.stdout:2024-05-10T09:58:08.858+0000 7fd041f13640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 30554) UID: 0 2024-05-10T09:58:08.863 INFO:tasks.rgw.client.0.smithi042.stdout:2024-05-10T09:58:08.858+0000 7fd04575ba40 -1 shutting down 2024-05-10T09:58:14.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-10T09:58:14.963 INFO:tasks.rgw.client.0:Stopped 2024-05-10T09:58:14.963 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-10T09:58:14.969 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/vault-root-token 2024-05-10T09:58:15.028 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-10T09:58:15.083 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-10T09:58:15.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-10T09:58:15.084 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-10T09:58:16.002 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-10T09:58:16.011 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T09:58:16.011 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:58:16.368 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:16.374 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:58:16.389 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-05-10T09:58:16.269400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613457,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3811,"num_read_kb":2005890,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3477668,"kb_used_data":3206872,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":751497052,"statfs":{"total":773094113280,"available":769532981248,"internally_reserved":0,"allocated":3283836928,"data_stored":3279063562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.745101"},"pg_stats":[{"pgid":"3.3f","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657807+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:58:04.657807+0000","last_peered":"2024-05-10T09:58:04.657807+0000","last_clean":"2024-05-10T09:58:04.657807+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:04.657807+0000","last_undegraded":"2024-05-10T09:58:04.657807+0000","last_fullsized":"2024-05-10T09:58:04.657807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650396+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:58:04.650396+0000","last_peered":"2024-05-10T09:58:04.650396+0000","last_clean":"2024-05-10T09:58:04.650396+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:04.650396+0000","last_undegraded":"2024-05-10T09:58:04.650396+0000","last_fullsized":"2024-05-10T09:58:04.650396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'9","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647529+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:58:04.647529+0000","last_peered":"2024-05-10T09:58:04.647529+0000","last_clean":"2024-05-10T09:58:04.647529+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:04.647529+0000","last_undegraded":"2024-05-10T09:58:04.647529+0000","last_fullsized":"2024-05-10T09:58:04.647529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651881+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:58:04.651881+0000","last_peered":"2024-05-10T09:58:04.651881+0000","last_clean":"2024-05-10T09:58:04.651881+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:04.651881+0000","last_undegraded":"2024-05-10T09:58:04.651881+0000","last_fullsized":"2024-05-10T09:58:04.651881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652086+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:58:04.652086+0000","last_peered":"2024-05-10T09:58:04.652086+0000","last_clean":"2024-05-10T09:58:04.652086+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:04.652086+0000","last_undegraded":"2024-05-10T09:58:04.652086+0000","last_fullsized":"2024-05-10T09:58:04.652086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'12","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654181+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:58:04.654181+0000","last_peered":"2024-05-10T09:58:04.654181+0000","last_clean":"2024-05-10T09:58:04.654181+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:04.654181+0000","last_undegraded":"2024-05-10T09:58:04.654181+0000","last_fullsized":"2024-05-10T09:58:04.654181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649254+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:58:04.649254+0000","last_peered":"2024-05-10T09:58:04.649254+0000","last_clean":"2024-05-10T09:58:04.649254+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:04.649254+0000","last_undegraded":"2024-05-10T09:58:04.649254+0000","last_fullsized":"2024-05-10T09:58:04.649254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'16","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654430+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:58:04.654430+0000","last_peered":"2024-05-10T09:58:04.654430+0000","last_clean":"2024-05-10T09:58:04.654430+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:04.654430+0000","last_undegraded":"2024-05-10T09:58:04.654430+0000","last_fullsized":"2024-05-10T09:58:04.654430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":43032,"num_write":56,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655633+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:58:04.655633+0000","last_peered":"2024-05-10T09:58:04.655633+0000","last_clean":"2024-05-10T09:58:04.655633+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:04.655633+0000","last_undegraded":"2024-05-10T09:58:04.655633+0000","last_fullsized":"2024-05-10T09:58:04.655633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'11","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651688+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:58:04.651688+0000","last_peered":"2024-05-10T09:58:04.651688+0000","last_clean":"2024-05-10T09:58:04.651688+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:04.651688+0000","last_undegraded":"2024-05-10T09:58:04.651688+0000","last_fullsized":"2024-05-10T09:58:04.651688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":36876,"num_write":31,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529657+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:58:04.529657+0000","last_peered":"2024-05-10T09:58:04.529657+0000","last_clean":"2024-05-10T09:58:04.529657+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:04.529657+0000","last_undegraded":"2024-05-10T09:58:04.529657+0000","last_fullsized":"2024-05-10T09:58:04.529657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'6","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528952+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:58:04.528952+0000","last_peered":"2024-05-10T09:58:04.528952+0000","last_clean":"2024-05-10T09:58:04.528952+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:04.528952+0000","last_undegraded":"2024-05-10T09:58:04.528952+0000","last_fullsized":"2024-05-10T09:58:04.528952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656752+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:58:04.656752+0000","last_peered":"2024-05-10T09:58:04.656752+0000","last_clean":"2024-05-10T09:58:04.656752+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:04.656752+0000","last_undegraded":"2024-05-10T09:58:04.656752+0000","last_fullsized":"2024-05-10T09:58:04.656752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"78'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528643+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:58:04.528643+0000","last_peered":"2024-05-10T09:58:04.528643+0000","last_clean":"2024-05-10T09:58:04.528643+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:04.528643+0000","last_undegraded":"2024-05-10T09:58:04.528643+0000","last_fullsized":"2024-05-10T09:58:04.528643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528564+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:58:04.528564+0000","last_peered":"2024-05-10T09:58:04.528564+0000","last_clean":"2024-05-10T09:58:04.528564+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:04.528564+0000","last_undegraded":"2024-05-10T09:58:04.528564+0000","last_fullsized":"2024-05-10T09:58:04.528564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527703+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:58:04.527703+0000","last_peered":"2024-05-10T09:58:04.527703+0000","last_clean":"2024-05-10T09:58:04.527703+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:04.527703+0000","last_undegraded":"2024-05-10T09:58:04.527703+0000","last_fullsized":"2024-05-10T09:58:04.527703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657912+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:58:04.657912+0000","last_peered":"2024-05-10T09:58:04.657912+0000","last_clean":"2024-05-10T09:58:04.657912+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:04.657912+0000","last_undegraded":"2024-05-10T09:58:04.657912+0000","last_fullsized":"2024-05-10T09:58:04.657912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652120+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:58:04.652120+0000","last_peered":"2024-05-10T09:58:04.652120+0000","last_clean":"2024-05-10T09:58:04.652120+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:04.652120+0000","last_undegraded":"2024-05-10T09:58:04.652120+0000","last_fullsized":"2024-05-10T09:58:04.652120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'7","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652595+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:58:04.652595+0000","last_peered":"2024-05-10T09:58:04.652595+0000","last_clean":"2024-05-10T09:58:04.652595+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:04.652595+0000","last_undegraded":"2024-05-10T09:58:04.652595+0000","last_fullsized":"2024-05-10T09:58:04.652595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651965+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:58:04.651965+0000","last_peered":"2024-05-10T09:58:04.651965+0000","last_clean":"2024-05-10T09:58:04.651965+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:04.651965+0000","last_undegraded":"2024-05-10T09:58:04.651965+0000","last_fullsized":"2024-05-10T09:58:04.651965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"79'5","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657131+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:58:04.657131+0000","last_peered":"2024-05-10T09:58:04.657131+0000","last_clean":"2024-05-10T09:58:04.657131+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:04.657131+0000","last_undegraded":"2024-05-10T09:58:04.657131+0000","last_fullsized":"2024-05-10T09:58:04.657131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527325+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:58:04.527325+0000","last_peered":"2024-05-10T09:58:04.527325+0000","last_clean":"2024-05-10T09:58:04.527325+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:04.527325+0000","last_undegraded":"2024-05-10T09:58:04.527325+0000","last_fullsized":"2024-05-10T09:58:04.527325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'19","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529749+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:58:04.529749+0000","last_peered":"2024-05-10T09:58:04.529749+0000","last_clean":"2024-05-10T09:58:04.529749+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:04.529749+0000","last_undegraded":"2024-05-10T09:58:04.529749+0000","last_fullsized":"2024-05-10T09:58:04.529749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":25,"num_read_kb":61452,"num_write":39,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":231,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526267+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:58:04.526267+0000","last_peered":"2024-05-10T09:58:04.526267+0000","last_clean":"2024-05-10T09:58:04.526267+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:04.526267+0000","last_undegraded":"2024-05-10T09:58:04.526267+0000","last_fullsized":"2024-05-10T09:58:04.526267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:28.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529605+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:58:04.529605+0000","last_peered":"2024-05-10T09:58:04.529605+0000","last_clean":"2024-05-10T09:58:04.529605+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:04.529605+0000","last_undegraded":"2024-05-10T09:58:04.529605+0000","last_fullsized":"2024-05-10T09:58:04.529605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529511+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:58:04.529511+0000","last_peered":"2024-05-10T09:58:04.529511+0000","last_clean":"2024-05-10T09:58:04.529511+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:04.529511+0000","last_undegraded":"2024-05-10T09:58:04.529511+0000","last_fullsized":"2024-05-10T09:58:04.529511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"79'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650655+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:58:04.650655+0000","last_peered":"2024-05-10T09:58:04.650655+0000","last_clean":"2024-05-10T09:58:04.650655+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:04.650655+0000","last_undegraded":"2024-05-10T09:58:04.650655+0000","last_fullsized":"2024-05-10T09:58:04.650655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528133+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:58:04.528133+0000","last_peered":"2024-05-10T09:58:04.528133+0000","last_clean":"2024-05-10T09:58:04.528133+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:04.528133+0000","last_undegraded":"2024-05-10T09:58:04.528133+0000","last_fullsized":"2024-05-10T09:58:04.528133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530920+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:58:04.530920+0000","last_peered":"2024-05-10T09:58:04.530920+0000","last_clean":"2024-05-10T09:58:04.530920+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:04.530920+0000","last_undegraded":"2024-05-10T09:58:04.530920+0000","last_fullsized":"2024-05-10T09:58:04.530920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'10","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654850+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:58:04.654850+0000","last_peered":"2024-05-10T09:58:04.654850+0000","last_clean":"2024-05-10T09:58:04.654850+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:04.654850+0000","last_undegraded":"2024-05-10T09:58:04.654850+0000","last_fullsized":"2024-05-10T09:58:04.654850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":18442,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655953+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:58:04.655953+0000","last_peered":"2024-05-10T09:58:04.655953+0000","last_clean":"2024-05-10T09:58:04.655953+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:04.655953+0000","last_undegraded":"2024-05-10T09:58:04.655953+0000","last_fullsized":"2024-05-10T09:58:04.655953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652475+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:58:04.652475+0000","last_peered":"2024-05-10T09:58:04.652475+0000","last_clean":"2024-05-10T09:58:04.652475+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:04.652475+0000","last_undegraded":"2024-05-10T09:58:04.652475+0000","last_fullsized":"2024-05-10T09:58:04.652475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655116+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:58:04.655116+0000","last_peered":"2024-05-10T09:58:04.655116+0000","last_clean":"2024-05-10T09:58:04.655116+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:04.655116+0000","last_undegraded":"2024-05-10T09:58:04.655116+0000","last_fullsized":"2024-05-10T09:58:04.655116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650200+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:58:04.650200+0000","last_peered":"2024-05-10T09:58:04.650200+0000","last_clean":"2024-05-10T09:58:04.650200+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:04.650200+0000","last_undegraded":"2024-05-10T09:58:04.650200+0000","last_fullsized":"2024-05-10T09:58:04.650200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657074+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:58:04.657074+0000","last_peered":"2024-05-10T09:58:04.657074+0000","last_clean":"2024-05-10T09:58:04.657074+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:04.657074+0000","last_undegraded":"2024-05-10T09:58:04.657074+0000","last_fullsized":"2024-05-10T09:58:04.657074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650910+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:58:04.650910+0000","last_peered":"2024-05-10T09:58:04.650910+0000","last_clean":"2024-05-10T09:58:04.650910+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:04.650910+0000","last_undegraded":"2024-05-10T09:58:04.650910+0000","last_fullsized":"2024-05-10T09:58:04.650910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530366+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:58:04.530366+0000","last_peered":"2024-05-10T09:58:04.530366+0000","last_clean":"2024-05-10T09:58:04.530366+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:04.530366+0000","last_undegraded":"2024-05-10T09:58:04.530366+0000","last_fullsized":"2024-05-10T09:58:04.530366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":93,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530616+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:58:04.530616+0000","last_peered":"2024-05-10T09:58:04.530616+0000","last_clean":"2024-05-10T09:58:04.530616+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:04.530616+0000","last_undegraded":"2024-05-10T09:58:04.530616+0000","last_fullsized":"2024-05-10T09:58:04.530616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530644+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:58:04.530644+0000","last_peered":"2024-05-10T09:58:04.530644+0000","last_clean":"2024-05-10T09:58:04.530644+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:04.530644+0000","last_undegraded":"2024-05-10T09:58:04.530644+0000","last_fullsized":"2024-05-10T09:58:04.530644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649999+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:58:04.649999+0000","last_peered":"2024-05-10T09:58:04.649999+0000","last_clean":"2024-05-10T09:58:04.649999+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:04.649999+0000","last_undegraded":"2024-05-10T09:58:04.649999+0000","last_fullsized":"2024-05-10T09:58:04.649999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652885+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:58:04.652885+0000","last_peered":"2024-05-10T09:58:04.652885+0000","last_clean":"2024-05-10T09:58:04.652885+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:04.652885+0000","last_undegraded":"2024-05-10T09:58:04.652885+0000","last_fullsized":"2024-05-10T09:58:04.652885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'13","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652338+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:58:04.652338+0000","last_peered":"2024-05-10T09:58:04.652338+0000","last_clean":"2024-05-10T09:58:04.652338+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:04.652338+0000","last_undegraded":"2024-05-10T09:58:04.652338+0000","last_fullsized":"2024-05-10T09:58:04.652338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.532396+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:58:04.532396+0000","last_peered":"2024-05-10T09:58:04.532396+0000","last_clean":"2024-05-10T09:58:04.532396+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:04.532396+0000","last_undegraded":"2024-05-10T09:58:04.532396+0000","last_fullsized":"2024-05-10T09:58:04.532396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525699+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:58:04.525699+0000","last_peered":"2024-05-10T09:58:04.525699+0000","last_clean":"2024-05-10T09:58:04.525699+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:04.525699+0000","last_undegraded":"2024-05-10T09:58:04.525699+0000","last_fullsized":"2024-05-10T09:58:04.525699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:28.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'15","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910656+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:58:08.910656+0000","last_peered":"2024-05-10T09:58:08.910656+0000","last_clean":"2024-05-10T09:58:08.910656+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:08.910656+0000","last_undegraded":"2024-05-10T09:58:08.910656+0000","last_fullsized":"2024-05-10T09:58:08.910656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529188+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:58:04.529188+0000","last_peered":"2024-05-10T09:58:04.529188+0000","last_clean":"2024-05-10T09:58:04.529188+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:04.529188+0000","last_undegraded":"2024-05-10T09:58:04.529188+0000","last_fullsized":"2024-05-10T09:58:04.529188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531253+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:58:04.531253+0000","last_peered":"2024-05-10T09:58:04.531253+0000","last_clean":"2024-05-10T09:58:04.531253+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:04.531253+0000","last_undegraded":"2024-05-10T09:58:04.531253+0000","last_fullsized":"2024-05-10T09:58:04.531253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654828+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:58:04.654828+0000","last_peered":"2024-05-10T09:58:04.654828+0000","last_clean":"2024-05-10T09:58:04.654828+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:04.654828+0000","last_undegraded":"2024-05-10T09:58:04.654828+0000","last_fullsized":"2024-05-10T09:58:04.654828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656656+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:58:04.656656+0000","last_peered":"2024-05-10T09:58:04.656656+0000","last_clean":"2024-05-10T09:58:04.656656+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:04.656656+0000","last_undegraded":"2024-05-10T09:58:04.656656+0000","last_fullsized":"2024-05-10T09:58:04.656656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"89'13","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655008+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:58:04.655008+0000","last_peered":"2024-05-10T09:58:04.655008+0000","last_clean":"2024-05-10T09:58:04.655008+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:04.655008+0000","last_undegraded":"2024-05-10T09:58:04.655008+0000","last_fullsized":"2024-05-10T09:58:04.655008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908303+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:58:08.908303+0000","last_peered":"2024-05-10T09:58:08.908303+0000","last_clean":"2024-05-10T09:58:08.908303+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:08.908303+0000","last_undegraded":"2024-05-10T09:58:08.908303+0000","last_fullsized":"2024-05-10T09:58:08.908303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651101+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:58:04.651101+0000","last_peered":"2024-05-10T09:58:04.651101+0000","last_clean":"2024-05-10T09:58:04.651101+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:04.651101+0000","last_undegraded":"2024-05-10T09:58:04.651101+0000","last_fullsized":"2024-05-10T09:58:04.651101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'8","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658091+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:58:04.658091+0000","last_peered":"2024-05-10T09:58:04.658091+0000","last_clean":"2024-05-10T09:58:04.658091+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:04.658091+0000","last_undegraded":"2024-05-10T09:58:04.658091+0000","last_fullsized":"2024-05-10T09:58:04.658091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651083+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:58:04.651083+0000","last_peered":"2024-05-10T09:58:04.651083+0000","last_clean":"2024-05-10T09:58:04.651083+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:04.651083+0000","last_undegraded":"2024-05-10T09:58:04.651083+0000","last_fullsized":"2024-05-10T09:58:04.651083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"89'23","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650787+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:58:04.650787+0000","last_peered":"2024-05-10T09:58:04.650787+0000","last_clean":"2024-05-10T09:58:04.650787+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:04.650787+0000","last_undegraded":"2024-05-10T09:58:04.650787+0000","last_fullsized":"2024-05-10T09:58:04.650787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647210+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:58:04.647210+0000","last_peered":"2024-05-10T09:58:04.647210+0000","last_clean":"2024-05-10T09:58:04.647210+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:04.647210+0000","last_undegraded":"2024-05-10T09:58:04.647210+0000","last_fullsized":"2024-05-10T09:58:04.647210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653582+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:58:04.653582+0000","last_peered":"2024-05-10T09:58:04.653582+0000","last_clean":"2024-05-10T09:58:04.653582+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:04.653582+0000","last_undegraded":"2024-05-10T09:58:04.653582+0000","last_fullsized":"2024-05-10T09:58:04.653582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527921+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:58:04.527921+0000","last_peered":"2024-05-10T09:58:04.527921+0000","last_clean":"2024-05-10T09:58:04.527921+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:04.527921+0000","last_undegraded":"2024-05-10T09:58:04.527921+0000","last_fullsized":"2024-05-10T09:58:04.527921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'13","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656481+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:58:04.656481+0000","last_peered":"2024-05-10T09:58:04.656481+0000","last_clean":"2024-05-10T09:58:04.656481+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:04.656481+0000","last_undegraded":"2024-05-10T09:58:04.656481+0000","last_fullsized":"2024-05-10T09:58:04.656481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525029+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:58:04.525029+0000","last_peered":"2024-05-10T09:58:04.525029+0000","last_clean":"2024-05-10T09:58:04.525029+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:04.525029+0000","last_undegraded":"2024-05-10T09:58:04.525029+0000","last_fullsized":"2024-05-10T09:58:04.525029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"89'15","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531332+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:58:04.531332+0000","last_peered":"2024-05-10T09:58:04.531332+0000","last_clean":"2024-05-10T09:58:04.531332+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:04.531332+0000","last_undegraded":"2024-05-10T09:58:04.531332+0000","last_fullsized":"2024-05-10T09:58:04.531332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527842+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:58:04.527842+0000","last_peered":"2024-05-10T09:58:04.527842+0000","last_clean":"2024-05-10T09:58:04.527842+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:04.527842+0000","last_undegraded":"2024-05-10T09:58:04.527842+0000","last_fullsized":"2024-05-10T09:58:04.527842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660834+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:58:04.660834+0000","last_peered":"2024-05-10T09:58:04.660834+0000","last_clean":"2024-05-10T09:58:04.660834+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:04.660834+0000","last_undegraded":"2024-05-10T09:58:04.660834+0000","last_fullsized":"2024-05-10T09:58:04.660834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655192+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:58:04.655192+0000","last_peered":"2024-05-10T09:58:04.655192+0000","last_clean":"2024-05-10T09:58:04.655192+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:04.655192+0000","last_undegraded":"2024-05-10T09:58:04.655192+0000","last_fullsized":"2024-05-10T09:58:04.655192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656460+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:58:04.656460+0000","last_peered":"2024-05-10T09:58:04.656460+0000","last_clean":"2024-05-10T09:58:04.656460+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:04.656460+0000","last_undegraded":"2024-05-10T09:58:04.656460+0000","last_fullsized":"2024-05-10T09:58:04.656460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527977+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:58:04.527977+0000","last_peered":"2024-05-10T09:58:04.527977+0000","last_clean":"2024-05-10T09:58:04.527977+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:04.527977+0000","last_undegraded":"2024-05-10T09:58:04.527977+0000","last_fullsized":"2024-05-10T09:58:04.527977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"89'19","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650811+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:58:04.650811+0000","last_peered":"2024-05-10T09:58:04.650811+0000","last_clean":"2024-05-10T09:58:04.650811+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:04.650811+0000","last_undegraded":"2024-05-10T09:58:04.650811+0000","last_fullsized":"2024-05-10T09:58:04.650811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908192+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:58:08.908192+0000","last_peered":"2024-05-10T09:58:08.908192+0000","last_clean":"2024-05-10T09:58:08.908192+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:08.908192+0000","last_undegraded":"2024-05-10T09:58:08.908192+0000","last_fullsized":"2024-05-10T09:58:08.908192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652535+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:58:04.652535+0000","last_peered":"2024-05-10T09:58:04.652535+0000","last_clean":"2024-05-10T09:58:04.652535+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:04.652535+0000","last_undegraded":"2024-05-10T09:58:04.652535+0000","last_fullsized":"2024-05-10T09:58:04.652535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651204+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:58:04.651204+0000","last_peered":"2024-05-10T09:58:04.651204+0000","last_clean":"2024-05-10T09:58:04.651204+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:04.651204+0000","last_undegraded":"2024-05-10T09:58:04.651204+0000","last_fullsized":"2024-05-10T09:58:04.651204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'15","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654833+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:58:04.654833+0000","last_peered":"2024-05-10T09:58:04.654833+0000","last_clean":"2024-05-10T09:58:04.654833+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:04.654833+0000","last_undegraded":"2024-05-10T09:58:04.654833+0000","last_fullsized":"2024-05-10T09:58:04.654833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":49170,"num_write":45,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526171+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:58:04.526171+0000","last_peered":"2024-05-10T09:58:04.526171+0000","last_clean":"2024-05-10T09:58:04.526171+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:04.526171+0000","last_undegraded":"2024-05-10T09:58:04.526171+0000","last_fullsized":"2024-05-10T09:58:04.526171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:37.269066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"89'24","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648751+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:58:04.648751+0000","last_peered":"2024-05-10T09:58:04.648751+0000","last_clean":"2024-05-10T09:58:04.648751+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:04.648751+0000","last_undegraded":"2024-05-10T09:58:04.648751+0000","last_fullsized":"2024-05-10T09:58:04.648751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.524822+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:58:04.524822+0000","last_peered":"2024-05-10T09:58:04.524822+0000","last_clean":"2024-05-10T09:58:04.524822+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:04.524822+0000","last_undegraded":"2024-05-10T09:58:04.524822+0000","last_fullsized":"2024-05-10T09:58:04.524822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646874+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:58:04.646874+0000","last_peered":"2024-05-10T09:58:04.646874+0000","last_clean":"2024-05-10T09:58:04.646874+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:04.646874+0000","last_undegraded":"2024-05-10T09:58:04.646874+0000","last_fullsized":"2024-05-10T09:58:04.646874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529824+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:58:04.529824+0000","last_peered":"2024-05-10T09:58:04.529824+0000","last_clean":"2024-05-10T09:58:04.529824+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:04.529824+0000","last_undegraded":"2024-05-10T09:58:04.529824+0000","last_fullsized":"2024-05-10T09:58:04.529824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528967+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:58:04.528967+0000","last_peered":"2024-05-10T09:58:04.528967+0000","last_clean":"2024-05-10T09:58:04.528967+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:04.528967+0000","last_undegraded":"2024-05-10T09:58:04.528967+0000","last_fullsized":"2024-05-10T09:58:04.528967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526622+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:58:04.526622+0000","last_peered":"2024-05-10T09:58:04.526622+0000","last_clean":"2024-05-10T09:58:04.526622+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:04.526622+0000","last_undegraded":"2024-05-10T09:58:04.526622+0000","last_fullsized":"2024-05-10T09:58:04.526622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"94'19","reported_seq":114,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530696+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:58:04.530696+0000","last_peered":"2024-05-10T09:58:04.530696+0000","last_clean":"2024-05-10T09:58:04.530696+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:04.530696+0000","last_undegraded":"2024-05-10T09:58:04.530696+0000","last_fullsized":"2024-05-10T09:58:04.530696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":33,"num_write":28,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653112+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:58:04.653112+0000","last_peered":"2024-05-10T09:58:04.653112+0000","last_clean":"2024-05-10T09:58:04.653112+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:04.653112+0000","last_undegraded":"2024-05-10T09:58:04.653112+0000","last_fullsized":"2024-05-10T09:58:04.653112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525936+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:58:04.525936+0000","last_peered":"2024-05-10T09:58:04.525936+0000","last_clean":"2024-05-10T09:58:04.525936+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:04.525936+0000","last_undegraded":"2024-05-10T09:58:04.525936+0000","last_fullsized":"2024-05-10T09:58:04.525936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529936+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:58:04.529936+0000","last_peered":"2024-05-10T09:58:04.529936+0000","last_clean":"2024-05-10T09:58:04.529936+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:04.529936+0000","last_undegraded":"2024-05-10T09:58:04.529936+0000","last_fullsized":"2024-05-10T09:58:04.529936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'7","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655796+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:58:04.655796+0000","last_peered":"2024-05-10T09:58:04.655796+0000","last_clean":"2024-05-10T09:58:04.655796+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:04.655796+0000","last_undegraded":"2024-05-10T09:58:04.655796+0000","last_fullsized":"2024-05-10T09:58:04.655796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646639+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:58:04.646639+0000","last_peered":"2024-05-10T09:58:04.646639+0000","last_clean":"2024-05-10T09:58:04.646639+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:04.646639+0000","last_undegraded":"2024-05-10T09:58:04.646639+0000","last_fullsized":"2024-05-10T09:58:04.646639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"89'22","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528148+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:58:04.528148+0000","last_peered":"2024-05-10T09:58:04.528148+0000","last_clean":"2024-05-10T09:58:04.528148+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:04.528148+0000","last_undegraded":"2024-05-10T09:58:04.528148+0000","last_fullsized":"2024-05-10T09:58:04.528148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11923,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'15","reported_seq":251,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908366+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:58:08.908366+0000","last_peered":"2024-05-10T09:58:08.908366+0000","last_clean":"2024-05-10T09:58:08.908366+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:08.908366+0000","last_undegraded":"2024-05-10T09:58:08.908366+0000","last_fullsized":"2024-05-10T09:58:08.908366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648186+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:58:04.648186+0000","last_peered":"2024-05-10T09:58:04.648186+0000","last_clean":"2024-05-10T09:58:04.648186+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:04.648186+0000","last_undegraded":"2024-05-10T09:58:04.648186+0000","last_fullsized":"2024-05-10T09:58:04.648186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530492+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:58:04.530492+0000","last_peered":"2024-05-10T09:58:04.530492+0000","last_clean":"2024-05-10T09:58:04.530492+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:04.530492+0000","last_undegraded":"2024-05-10T09:58:04.530492+0000","last_fullsized":"2024-05-10T09:58:04.530492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"78'3","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528266+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:58:04.528266+0000","last_peered":"2024-05-10T09:58:04.528266+0000","last_clean":"2024-05-10T09:58:04.528266+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:04.528266+0000","last_undegraded":"2024-05-10T09:58:04.528266+0000","last_fullsized":"2024-05-10T09:58:04.528266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.217710+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:58:15.217710+0000","last_peered":"2024-05-10T09:58:15.217710+0000","last_clean":"2024-05-10T09:58:15.217710+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:15.217710+0000","last_undegraded":"2024-05-10T09:58:15.217710+0000","last_fullsized":"2024-05-10T09:58:15.217710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528642+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:58:04.528642+0000","last_peered":"2024-05-10T09:58:04.528642+0000","last_clean":"2024-05-10T09:58:04.528642+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:04.528642+0000","last_undegraded":"2024-05-10T09:58:04.528642+0000","last_fullsized":"2024-05-10T09:58:04.528642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'15","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910725+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:58:08.910725+0000","last_peered":"2024-05-10T09:58:08.910725+0000","last_clean":"2024-05-10T09:58:08.910725+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:08.910725+0000","last_undegraded":"2024-05-10T09:58:08.910725+0000","last_fullsized":"2024-05-10T09:58:08.910725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528502+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:58:04.528502+0000","last_peered":"2024-05-10T09:58:04.528502+0000","last_clean":"2024-05-10T09:58:04.528502+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:04.528502+0000","last_undegraded":"2024-05-10T09:58:04.528502+0000","last_fullsized":"2024-05-10T09:58:04.528502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647951+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:58:04.647951+0000","last_peered":"2024-05-10T09:58:04.647951+0000","last_clean":"2024-05-10T09:58:04.647951+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:04.647951+0000","last_undegraded":"2024-05-10T09:58:04.647951+0000","last_fullsized":"2024-05-10T09:58:04.647951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"89'13","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529478+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:58:04.529478+0000","last_peered":"2024-05-10T09:58:04.529478+0000","last_clean":"2024-05-10T09:58:04.529478+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:04.529478+0000","last_undegraded":"2024-05-10T09:58:04.529478+0000","last_fullsized":"2024-05-10T09:58:04.529478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530226+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:58:04.530226+0000","last_peered":"2024-05-10T09:58:04.530226+0000","last_clean":"2024-05-10T09:58:04.530226+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:04.530226+0000","last_undegraded":"2024-05-10T09:58:04.530226+0000","last_fullsized":"2024-05-10T09:58:04.530226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"89'24","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655681+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:58:04.655681+0000","last_peered":"2024-05-10T09:58:04.655681+0000","last_clean":"2024-05-10T09:58:04.655681+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:04.655681+0000","last_undegraded":"2024-05-10T09:58:04.655681+0000","last_fullsized":"2024-05-10T09:58:04.655681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652778+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:58:04.652778+0000","last_peered":"2024-05-10T09:58:04.652778+0000","last_clean":"2024-05-10T09:58:04.652778+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:04.652778+0000","last_undegraded":"2024-05-10T09:58:04.652778+0000","last_fullsized":"2024-05-10T09:58:04.652778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646928+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:58:04.646928+0000","last_peered":"2024-05-10T09:58:04.646928+0000","last_clean":"2024-05-10T09:58:04.646928+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:04.646928+0000","last_undegraded":"2024-05-10T09:58:04.646928+0000","last_fullsized":"2024-05-10T09:58:04.646928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":238,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656709+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:58:04.656709+0000","last_peered":"2024-05-10T09:58:04.656709+0000","last_clean":"2024-05-10T09:58:04.656709+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:04.656709+0000","last_undegraded":"2024-05-10T09:58:04.656709+0000","last_fullsized":"2024-05-10T09:58:04.656709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":285,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651075+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:58:04.651075+0000","last_peered":"2024-05-10T09:58:04.651075+0000","last_clean":"2024-05-10T09:58:04.651075+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:04.651075+0000","last_undegraded":"2024-05-10T09:58:04.651075+0000","last_fullsized":"2024-05-10T09:58:04.651075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651354+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:58:04.651354+0000","last_peered":"2024-05-10T09:58:04.651354+0000","last_clean":"2024-05-10T09:58:04.651354+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:04.651354+0000","last_undegraded":"2024-05-10T09:58:04.651354+0000","last_fullsized":"2024-05-10T09:58:04.651354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528876+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:58:04.528876+0000","last_peered":"2024-05-10T09:58:04.528876+0000","last_clean":"2024-05-10T09:58:04.528876+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:04.528876+0000","last_undegraded":"2024-05-10T09:58:04.528876+0000","last_fullsized":"2024-05-10T09:58:04.528876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657379+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:58:04.657379+0000","last_peered":"2024-05-10T09:58:04.657379+0000","last_clean":"2024-05-10T09:58:04.657379+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:04.657379+0000","last_undegraded":"2024-05-10T09:58:04.657379+0000","last_fullsized":"2024-05-10T09:58:04.657379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"89'31","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657459+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:58:04.657459+0000","last_peered":"2024-05-10T09:58:04.657459+0000","last_clean":"2024-05-10T09:58:04.657459+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:04.657459+0000","last_undegraded":"2024-05-10T09:58:04.657459+0000","last_fullsized":"2024-05-10T09:58:04.657459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":70,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652543+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:58:04.652543+0000","last_peered":"2024-05-10T09:58:04.652543+0000","last_clean":"2024-05-10T09:58:04.652543+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:04.652543+0000","last_undegraded":"2024-05-10T09:58:04.652543+0000","last_fullsized":"2024-05-10T09:58:04.652543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651894+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:58:04.651894+0000","last_peered":"2024-05-10T09:58:04.651894+0000","last_clean":"2024-05-10T09:58:04.651894+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:04.651894+0000","last_undegraded":"2024-05-10T09:58:04.651894+0000","last_fullsized":"2024-05-10T09:58:04.651894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652782+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:58:04.652782+0000","last_peered":"2024-05-10T09:58:04.652782+0000","last_clean":"2024-05-10T09:58:04.652782+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:04.652782+0000","last_undegraded":"2024-05-10T09:58:04.652782+0000","last_fullsized":"2024-05-10T09:58:04.652782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650560+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:58:04.650560+0000","last_peered":"2024-05-10T09:58:04.650560+0000","last_clean":"2024-05-10T09:58:04.650560+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:04.650560+0000","last_undegraded":"2024-05-10T09:58:04.650560+0000","last_fullsized":"2024-05-10T09:58:04.650560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'12","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649016+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:58:04.649016+0000","last_peered":"2024-05-10T09:58:04.649016+0000","last_clean":"2024-05-10T09:58:04.649016+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:04.649016+0000","last_undegraded":"2024-05-10T09:58:04.649016+0000","last_fullsized":"2024-05-10T09:58:04.649016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.015437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658097+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:58:04.658097+0000","last_peered":"2024-05-10T09:58:04.658097+0000","last_clean":"2024-05-10T09:58:04.658097+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:04.658097+0000","last_undegraded":"2024-05-10T09:58:04.658097+0000","last_fullsized":"2024-05-10T09:58:04.658097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'52","reported_seq":284,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908550+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:58:08.908550+0000","last_peered":"2024-05-10T09:58:08.908550+0000","last_clean":"2024-05-10T09:58:08.908550+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:08.908550+0000","last_undegraded":"2024-05-10T09:58:08.908550+0000","last_fullsized":"2024-05-10T09:58:08.908550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20102,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":82,"num_read_kb":100,"num_write":54,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654776+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:58:04.654776+0000","last_peered":"2024-05-10T09:58:04.654776+0000","last_clean":"2024-05-10T09:58:04.654776+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:04.654776+0000","last_undegraded":"2024-05-10T09:58:04.654776+0000","last_fullsized":"2024-05-10T09:58:04.654776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647636+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:58:04.647636+0000","last_peered":"2024-05-10T09:58:04.647636+0000","last_clean":"2024-05-10T09:58:04.647636+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:04.647636+0000","last_undegraded":"2024-05-10T09:58:04.647636+0000","last_fullsized":"2024-05-10T09:58:04.647636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648061+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:58:04.648061+0000","last_peered":"2024-05-10T09:58:04.648061+0000","last_clean":"2024-05-10T09:58:04.648061+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:04.648061+0000","last_undegraded":"2024-05-10T09:58:04.648061+0000","last_fullsized":"2024-05-10T09:58:04.648061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529781+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:58:04.529781+0000","last_peered":"2024-05-10T09:58:04.529781+0000","last_clean":"2024-05-10T09:58:04.529781+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:04.529781+0000","last_undegraded":"2024-05-10T09:58:04.529781+0000","last_fullsized":"2024-05-10T09:58:04.529781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'10","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645674+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:58:04.645674+0000","last_peered":"2024-05-10T09:58:04.645674+0000","last_clean":"2024-05-10T09:58:04.645674+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:04.645674+0000","last_undegraded":"2024-05-10T09:58:04.645674+0000","last_fullsized":"2024-05-10T09:58:04.645674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529576+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:58:04.529576+0000","last_peered":"2024-05-10T09:58:04.529576+0000","last_clean":"2024-05-10T09:58:04.529576+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:04.529576+0000","last_undegraded":"2024-05-10T09:58:04.529576+0000","last_fullsized":"2024-05-10T09:58:04.529576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"110'16","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655641+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:58:04.655641+0000","last_peered":"2024-05-10T09:58:04.655641+0000","last_clean":"2024-05-10T09:58:04.655641+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:04.655641+0000","last_undegraded":"2024-05-10T09:58:04.655641+0000","last_fullsized":"2024-05-10T09:58:04.655641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651737+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:58:04.651737+0000","last_peered":"2024-05-10T09:58:04.651737+0000","last_clean":"2024-05-10T09:58:04.651737+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:04.651737+0000","last_undegraded":"2024-05-10T09:58:04.651737+0000","last_fullsized":"2024-05-10T09:58:04.651737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:06.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530498+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:58:04.530498+0000","last_peered":"2024-05-10T09:58:04.530498+0000","last_clean":"2024-05-10T09:58:04.530498+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:04.530498+0000","last_undegraded":"2024-05-10T09:58:04.530498+0000","last_fullsized":"2024-05-10T09:58:04.530498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647231+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:58:04.647231+0000","last_peered":"2024-05-10T09:58:04.647231+0000","last_clean":"2024-05-10T09:58:04.647231+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:04.647231+0000","last_undegraded":"2024-05-10T09:58:04.647231+0000","last_fullsized":"2024-05-10T09:58:04.647231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653676+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:58:04.653676+0000","last_peered":"2024-05-10T09:58:04.653676+0000","last_clean":"2024-05-10T09:58:04.653676+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:04.653676+0000","last_undegraded":"2024-05-10T09:58:04.653676+0000","last_fullsized":"2024-05-10T09:58:04.653676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'10","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651974+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:58:04.651974+0000","last_peered":"2024-05-10T09:58:04.651974+0000","last_clean":"2024-05-10T09:58:04.651974+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:04.651974+0000","last_undegraded":"2024-05-10T09:58:04.651974+0000","last_fullsized":"2024-05-10T09:58:04.651974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528089+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:58:04.528089+0000","last_peered":"2024-05-10T09:58:04.528089+0000","last_clean":"2024-05-10T09:58:04.528089+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:04.528089+0000","last_undegraded":"2024-05-10T09:58:04.528089+0000","last_fullsized":"2024-05-10T09:58:04.528089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655245+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:58:04.655245+0000","last_peered":"2024-05-10T09:58:04.655245+0000","last_clean":"2024-05-10T09:58:04.655245+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:04.655245+0000","last_undegraded":"2024-05-10T09:58:04.655245+0000","last_fullsized":"2024-05-10T09:58:04.655245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649808+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:58:04.649808+0000","last_peered":"2024-05-10T09:58:04.649808+0000","last_clean":"2024-05-10T09:58:04.649808+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:04.649808+0000","last_undegraded":"2024-05-10T09:58:04.649808+0000","last_fullsized":"2024-05-10T09:58:04.649808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646914+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:58:04.646914+0000","last_peered":"2024-05-10T09:58:04.646914+0000","last_clean":"2024-05-10T09:58:04.646914+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:04.646914+0000","last_undegraded":"2024-05-10T09:58:04.646914+0000","last_fullsized":"2024-05-10T09:58:04.646914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657604+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:58:04.657604+0000","last_peered":"2024-05-10T09:58:04.657604+0000","last_clean":"2024-05-10T09:58:04.657604+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:04.657604+0000","last_undegraded":"2024-05-10T09:58:04.657604+0000","last_fullsized":"2024-05-10T09:58:04.657604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648281+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:58:04.648281+0000","last_peered":"2024-05-10T09:58:04.648281+0000","last_clean":"2024-05-10T09:58:04.648281+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:04.648281+0000","last_undegraded":"2024-05-10T09:58:04.648281+0000","last_fullsized":"2024-05-10T09:58:04.648281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649720+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:58:04.649720+0000","last_peered":"2024-05-10T09:58:04.649720+0000","last_clean":"2024-05-10T09:58:04.649720+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:04.649720+0000","last_undegraded":"2024-05-10T09:58:04.649720+0000","last_fullsized":"2024-05-10T09:58:04.649720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"89'28","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646802+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:58:04.646802+0000","last_peered":"2024-05-10T09:58:04.646802+0000","last_clean":"2024-05-10T09:58:04.646802+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:04.646802+0000","last_undegraded":"2024-05-10T09:58:04.646802+0000","last_fullsized":"2024-05-10T09:58:04.646802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11529,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529488+0000","last_change":"2024-05-10T09:57:19.676469+0000","last_active":"2024-05-10T09:58:04.529488+0000","last_peered":"2024-05-10T09:58:04.529488+0000","last_clean":"2024-05-10T09:58:04.529488+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:58:04.529488+0000","last_undegraded":"2024-05-10T09:58:04.529488+0000","last_fullsized":"2024-05-10T09:58:04.529488+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:07.877322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651956+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:58:04.651956+0000","last_peered":"2024-05-10T09:58:04.651956+0000","last_clean":"2024-05-10T09:58:04.651956+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:04.651956+0000","last_undegraded":"2024-05-10T09:58:04.651956+0000","last_fullsized":"2024-05-10T09:58:04.651956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651063+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:58:04.651063+0000","last_peered":"2024-05-10T09:58:04.651063+0000","last_clean":"2024-05-10T09:58:04.651063+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:04.651063+0000","last_undegraded":"2024-05-10T09:58:04.651063+0000","last_fullsized":"2024-05-10T09:58:04.651063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"77'3","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647490+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:58:04.647490+0000","last_peered":"2024-05-10T09:58:04.647490+0000","last_clean":"2024-05-10T09:58:04.647490+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:04.647490+0000","last_undegraded":"2024-05-10T09:58:04.647490+0000","last_fullsized":"2024-05-10T09:58:04.647490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657133+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:58:04.657133+0000","last_peered":"2024-05-10T09:58:04.657133+0000","last_clean":"2024-05-10T09:58:04.657133+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:04.657133+0000","last_undegraded":"2024-05-10T09:58:04.657133+0000","last_fullsized":"2024-05-10T09:58:04.657133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656579+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:58:04.656579+0000","last_peered":"2024-05-10T09:58:04.656579+0000","last_clean":"2024-05-10T09:58:04.656579+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:04.656579+0000","last_undegraded":"2024-05-10T09:58:04.656579+0000","last_fullsized":"2024-05-10T09:58:04.656579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645778+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:58:04.645778+0000","last_peered":"2024-05-10T09:58:04.645778+0000","last_clean":"2024-05-10T09:58:04.645778+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:04.645778+0000","last_undegraded":"2024-05-10T09:58:04.645778+0000","last_fullsized":"2024-05-10T09:58:04.645778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'17","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.248481+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:58:15.248481+0000","last_peered":"2024-05-10T09:58:15.248481+0000","last_clean":"2024-05-10T09:58:15.248481+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:15.248481+0000","last_undegraded":"2024-05-10T09:58:15.248481+0000","last_fullsized":"2024-05-10T09:58:15.248481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531521+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:58:04.531521+0000","last_peered":"2024-05-10T09:58:04.531521+0000","last_clean":"2024-05-10T09:58:04.531521+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:04.531521+0000","last_undegraded":"2024-05-10T09:58:04.531521+0000","last_fullsized":"2024-05-10T09:58:04.531521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527816+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:58:04.527816+0000","last_peered":"2024-05-10T09:58:04.527816+0000","last_clean":"2024-05-10T09:58:04.527816+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:04.527816+0000","last_undegraded":"2024-05-10T09:58:04.527816+0000","last_fullsized":"2024-05-10T09:58:04.527816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527678+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:58:04.527678+0000","last_peered":"2024-05-10T09:58:04.527678+0000","last_clean":"2024-05-10T09:58:04.527678+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:04.527678+0000","last_undegraded":"2024-05-10T09:58:04.527678+0000","last_fullsized":"2024-05-10T09:58:04.527678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647640+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:58:04.647640+0000","last_peered":"2024-05-10T09:58:04.647640+0000","last_clean":"2024-05-10T09:58:04.647640+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:04.647640+0000","last_undegraded":"2024-05-10T09:58:04.647640+0000","last_fullsized":"2024-05-10T09:58:04.647640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528907+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:58:04.528907+0000","last_peered":"2024-05-10T09:58:04.528907+0000","last_clean":"2024-05-10T09:58:04.528907+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:04.528907+0000","last_undegraded":"2024-05-10T09:58:04.528907+0000","last_fullsized":"2024-05-10T09:58:04.528907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":99,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529276+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:58:04.529276+0000","last_peered":"2024-05-10T09:58:04.529276+0000","last_clean":"2024-05-10T09:58:04.529276+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:04.529276+0000","last_undegraded":"2024-05-10T09:58:04.529276+0000","last_fullsized":"2024-05-10T09:58:04.529276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908200+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:58:08.908200+0000","last_peered":"2024-05-10T09:58:08.908200+0000","last_clean":"2024-05-10T09:58:08.908200+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:08.908200+0000","last_undegraded":"2024-05-10T09:58:08.908200+0000","last_fullsized":"2024-05-10T09:58:08.908200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651782+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:58:04.651782+0000","last_peered":"2024-05-10T09:58:04.651782+0000","last_clean":"2024-05-10T09:58:04.651782+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:04.651782+0000","last_undegraded":"2024-05-10T09:58:04.651782+0000","last_fullsized":"2024-05-10T09:58:04.651782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529167+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:58:04.529167+0000","last_peered":"2024-05-10T09:58:04.529167+0000","last_clean":"2024-05-10T09:58:04.529167+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:04.529167+0000","last_undegraded":"2024-05-10T09:58:04.529167+0000","last_fullsized":"2024-05-10T09:58:04.529167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652922+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:58:04.652922+0000","last_peered":"2024-05-10T09:58:04.652922+0000","last_clean":"2024-05-10T09:58:04.652922+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:04.652922+0000","last_undegraded":"2024-05-10T09:58:04.652922+0000","last_fullsized":"2024-05-10T09:58:04.652922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":41,"num_read_kb":59422,"num_write":71,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656494+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:58:04.656494+0000","last_peered":"2024-05-10T09:58:04.656494+0000","last_clean":"2024-05-10T09:58:04.656494+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:04.656494+0000","last_undegraded":"2024-05-10T09:58:04.656494+0000","last_fullsized":"2024-05-10T09:58:04.656494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527204+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:58:04.527204+0000","last_peered":"2024-05-10T09:58:04.527204+0000","last_clean":"2024-05-10T09:58:04.527204+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:04.527204+0000","last_undegraded":"2024-05-10T09:58:04.527204+0000","last_fullsized":"2024-05-10T09:58:04.527204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"89'35","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653416+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:58:04.653416+0000","last_peered":"2024-05-10T09:58:04.653416+0000","last_clean":"2024-05-10T09:58:04.653416+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:04.653416+0000","last_undegraded":"2024-05-10T09:58:04.653416+0000","last_fullsized":"2024-05-10T09:58:04.653416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17853,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":59,"num_read_kb":66,"num_write":42,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528099+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:58:04.528099+0000","last_peered":"2024-05-10T09:58:04.528099+0000","last_clean":"2024-05-10T09:58:04.528099+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:04.528099+0000","last_undegraded":"2024-05-10T09:58:04.528099+0000","last_fullsized":"2024-05-10T09:58:04.528099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650656+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:58:04.650656+0000","last_peered":"2024-05-10T09:58:04.650656+0000","last_clean":"2024-05-10T09:58:04.650656+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:04.650656+0000","last_undegraded":"2024-05-10T09:58:04.650656+0000","last_fullsized":"2024-05-10T09:58:04.650656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652973+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:58:04.652973+0000","last_peered":"2024-05-10T09:58:04.652973+0000","last_clean":"2024-05-10T09:58:04.652973+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:04.652973+0000","last_undegraded":"2024-05-10T09:58:04.652973+0000","last_fullsized":"2024-05-10T09:58:04.652973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529250+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:58:04.529250+0000","last_peered":"2024-05-10T09:58:04.529250+0000","last_clean":"2024-05-10T09:58:04.529250+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:04.529250+0000","last_undegraded":"2024-05-10T09:58:04.529250+0000","last_fullsized":"2024-05-10T09:58:04.529250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"79'7","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528880+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:58:04.528880+0000","last_peered":"2024-05-10T09:58:04.528880+0000","last_clean":"2024-05-10T09:58:04.528880+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:04.528880+0000","last_undegraded":"2024-05-10T09:58:04.528880+0000","last_fullsized":"2024-05-10T09:58:04.528880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647012+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:58:04.647012+0000","last_peered":"2024-05-10T09:58:04.647012+0000","last_clean":"2024-05-10T09:58:04.647012+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:04.647012+0000","last_undegraded":"2024-05-10T09:58:04.647012+0000","last_fullsized":"2024-05-10T09:58:04.647012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"89'17","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527493+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:58:04.527493+0000","last_peered":"2024-05-10T09:58:04.527493+0000","last_clean":"2024-05-10T09:58:04.527493+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:04.527493+0000","last_undegraded":"2024-05-10T09:58:04.527493+0000","last_fullsized":"2024-05-10T09:58:04.527493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526191+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:58:04.526191+0000","last_peered":"2024-05-10T09:58:04.526191+0000","last_clean":"2024-05-10T09:58:04.526191+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:04.526191+0000","last_undegraded":"2024-05-10T09:58:04.526191+0000","last_fullsized":"2024-05-10T09:58:04.526191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527534+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:58:04.527534+0000","last_peered":"2024-05-10T09:58:04.527534+0000","last_clean":"2024-05-10T09:58:04.527534+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:04.527534+0000","last_undegraded":"2024-05-10T09:58:04.527534+0000","last_fullsized":"2024-05-10T09:58:04.527534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646813+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:58:04.646813+0000","last_peered":"2024-05-10T09:58:04.646813+0000","last_clean":"2024-05-10T09:58:04.646813+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:04.646813+0000","last_undegraded":"2024-05-10T09:58:04.646813+0000","last_fullsized":"2024-05-10T09:58:04.646813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656190+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:58:04.656190+0000","last_peered":"2024-05-10T09:58:04.656190+0000","last_clean":"2024-05-10T09:58:04.656190+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:04.656190+0000","last_undegraded":"2024-05-10T09:58:04.656190+0000","last_fullsized":"2024-05-10T09:58:04.656190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":30738,"num_write":42,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530067+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:58:04.530067+0000","last_peered":"2024-05-10T09:58:04.530067+0000","last_clean":"2024-05-10T09:58:04.530067+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:04.530067+0000","last_undegraded":"2024-05-10T09:58:04.530067+0000","last_fullsized":"2024-05-10T09:58:04.530067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646603+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:58:04.646603+0000","last_peered":"2024-05-10T09:58:04.646603+0000","last_clean":"2024-05-10T09:58:04.646603+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:04.646603+0000","last_undegraded":"2024-05-10T09:58:04.646603+0000","last_fullsized":"2024-05-10T09:58:04.646603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651652+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:58:04.651652+0000","last_peered":"2024-05-10T09:58:04.651652+0000","last_clean":"2024-05-10T09:58:04.651652+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:04.651652+0000","last_undegraded":"2024-05-10T09:58:04.651652+0000","last_fullsized":"2024-05-10T09:58:04.651652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651848+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:58:04.651848+0000","last_peered":"2024-05-10T09:58:04.651848+0000","last_clean":"2024-05-10T09:58:04.651848+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:04.651848+0000","last_undegraded":"2024-05-10T09:58:04.651848+0000","last_fullsized":"2024-05-10T09:58:04.651848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530746+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:58:04.530746+0000","last_peered":"2024-05-10T09:58:04.530746+0000","last_clean":"2024-05-10T09:58:04.530746+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:04.530746+0000","last_undegraded":"2024-05-10T09:58:04.530746+0000","last_fullsized":"2024-05-10T09:58:04.530746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'9","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657229+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:58:04.657229+0000","last_peered":"2024-05-10T09:58:04.657229+0000","last_clean":"2024-05-10T09:58:04.657229+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:04.657229+0000","last_undegraded":"2024-05-10T09:58:04.657229+0000","last_fullsized":"2024-05-10T09:58:04.657229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649736+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:58:04.649736+0000","last_peered":"2024-05-10T09:58:04.649736+0000","last_clean":"2024-05-10T09:58:04.649736+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:04.649736+0000","last_undegraded":"2024-05-10T09:58:04.649736+0000","last_fullsized":"2024-05-10T09:58:04.649736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"89'18","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529286+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:58:04.529286+0000","last_peered":"2024-05-10T09:58:04.529286+0000","last_clean":"2024-05-10T09:58:04.529286+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:04.529286+0000","last_undegraded":"2024-05-10T09:58:04.529286+0000","last_fullsized":"2024-05-10T09:58:04.529286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654262+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:58:04.654262+0000","last_peered":"2024-05-10T09:58:04.654262+0000","last_clean":"2024-05-10T09:58:04.654262+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:04.654262+0000","last_undegraded":"2024-05-10T09:58:04.654262+0000","last_fullsized":"2024-05-10T09:58:04.654262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653292+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:58:04.653292+0000","last_peered":"2024-05-10T09:58:04.653292+0000","last_clean":"2024-05-10T09:58:04.653292+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:04.653292+0000","last_undegraded":"2024-05-10T09:58:04.653292+0000","last_fullsized":"2024-05-10T09:58:04.653292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528375+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:58:04.528375+0000","last_peered":"2024-05-10T09:58:04.528375+0000","last_clean":"2024-05-10T09:58:04.528375+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:04.528375+0000","last_undegraded":"2024-05-10T09:58:04.528375+0000","last_fullsized":"2024-05-10T09:58:04.528375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653595+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:58:04.653595+0000","last_peered":"2024-05-10T09:58:04.653595+0000","last_clean":"2024-05-10T09:58:04.653595+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:04.653595+0000","last_undegraded":"2024-05-10T09:58:04.653595+0000","last_fullsized":"2024-05-10T09:58:04.653595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40978,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654529+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:58:04.654529+0000","last_peered":"2024-05-10T09:58:04.654529+0000","last_clean":"2024-05-10T09:58:04.654529+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:04.654529+0000","last_undegraded":"2024-05-10T09:58:04.654529+0000","last_fullsized":"2024-05-10T09:58:04.654529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"89'15","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653237+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:58:04.653237+0000","last_peered":"2024-05-10T09:58:04.653237+0000","last_clean":"2024-05-10T09:58:04.653237+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:04.653237+0000","last_undegraded":"2024-05-10T09:58:04.653237+0000","last_fullsized":"2024-05-10T09:58:04.653237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648770+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:58:04.648770+0000","last_peered":"2024-05-10T09:58:04.648770+0000","last_clean":"2024-05-10T09:58:04.648770+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:04.648770+0000","last_undegraded":"2024-05-10T09:58:04.648770+0000","last_fullsized":"2024-05-10T09:58:04.648770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656182+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:58:04.656182+0000","last_peered":"2024-05-10T09:58:04.656182+0000","last_clean":"2024-05-10T09:58:04.656182+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:04.656182+0000","last_undegraded":"2024-05-10T09:58:04.656182+0000","last_fullsized":"2024-05-10T09:58:04.656182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529228+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:58:04.529228+0000","last_peered":"2024-05-10T09:58:04.529228+0000","last_clean":"2024-05-10T09:58:04.529228+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:04.529228+0000","last_undegraded":"2024-05-10T09:58:04.529228+0000","last_fullsized":"2024-05-10T09:58:04.529228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":27,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652635+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:58:04.652635+0000","last_peered":"2024-05-10T09:58:04.652635+0000","last_clean":"2024-05-10T09:58:04.652635+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:04.652635+0000","last_undegraded":"2024-05-10T09:58:04.652635+0000","last_fullsized":"2024-05-10T09:58:04.652635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"89'21","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647027+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:58:04.647027+0000","last_peered":"2024-05-10T09:58:04.647027+0000","last_clean":"2024-05-10T09:58:04.647027+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:04.647027+0000","last_undegraded":"2024-05-10T09:58:04.647027+0000","last_fullsized":"2024-05-10T09:58:04.647027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10974,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":24,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653816+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:58:04.653816+0000","last_peered":"2024-05-10T09:58:04.653816+0000","last_clean":"2024-05-10T09:58:04.653816+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:04.653816+0000","last_undegraded":"2024-05-10T09:58:04.653816+0000","last_fullsized":"2024-05-10T09:58:04.653816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528651+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:58:04.528651+0000","last_peered":"2024-05-10T09:58:04.528651+0000","last_clean":"2024-05-10T09:58:04.528651+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:04.528651+0000","last_undegraded":"2024-05-10T09:58:04.528651+0000","last_fullsized":"2024-05-10T09:58:04.528651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652727+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:58:04.652727+0000","last_peered":"2024-05-10T09:58:04.652727+0000","last_clean":"2024-05-10T09:58:04.652727+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:04.652727+0000","last_undegraded":"2024-05-10T09:58:04.652727+0000","last_fullsized":"2024-05-10T09:58:04.652727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646498+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:58:04.646498+0000","last_peered":"2024-05-10T09:58:04.646498+0000","last_clean":"2024-05-10T09:58:04.646498+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:04.646498+0000","last_undegraded":"2024-05-10T09:58:04.646498+0000","last_fullsized":"2024-05-10T09:58:04.646498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":30726,"num_write":21,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.202744+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:58:15.202744+0000","last_peered":"2024-05-10T09:58:15.202744+0000","last_clean":"2024-05-10T09:58:15.202744+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:15.202744+0000","last_undegraded":"2024-05-10T09:58:15.202744+0000","last_fullsized":"2024-05-10T09:58:15.202744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"89'21","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653505+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:58:04.653505+0000","last_peered":"2024-05-10T09:58:04.653505+0000","last_clean":"2024-05-10T09:58:04.653505+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:04.653505+0000","last_undegraded":"2024-05-10T09:58:04.653505+0000","last_fullsized":"2024-05-10T09:58:04.653505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647328+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:58:04.647328+0000","last_peered":"2024-05-10T09:58:04.647328+0000","last_clean":"2024-05-10T09:58:04.647328+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:04.647328+0000","last_undegraded":"2024-05-10T09:58:04.647328+0000","last_fullsized":"2024-05-10T09:58:04.647328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652826+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:58:04.652826+0000","last_peered":"2024-05-10T09:58:04.652826+0000","last_clean":"2024-05-10T09:58:04.652826+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:04.652826+0000","last_undegraded":"2024-05-10T09:58:04.652826+0000","last_fullsized":"2024-05-10T09:58:04.652826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528292+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:58:04.528292+0000","last_peered":"2024-05-10T09:58:04.528292+0000","last_clean":"2024-05-10T09:58:04.528292+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:04.528292+0000","last_undegraded":"2024-05-10T09:58:04.528292+0000","last_fullsized":"2024-05-10T09:58:04.528292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528195+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:58:04.528195+0000","last_peered":"2024-05-10T09:58:04.528195+0000","last_clean":"2024-05-10T09:58:04.528195+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:04.528195+0000","last_undegraded":"2024-05-10T09:58:04.528195+0000","last_fullsized":"2024-05-10T09:58:04.528195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529014+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:58:04.529014+0000","last_peered":"2024-05-10T09:58:04.529014+0000","last_clean":"2024-05-10T09:58:04.529014+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:04.529014+0000","last_undegraded":"2024-05-10T09:58:04.529014+0000","last_fullsized":"2024-05-10T09:58:04.529014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"89'16","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531919+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:58:04.531919+0000","last_peered":"2024-05-10T09:58:04.531919+0000","last_clean":"2024-05-10T09:58:04.531919+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:04.531919+0000","last_undegraded":"2024-05-10T09:58:04.531919+0000","last_fullsized":"2024-05-10T09:58:04.531919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647189+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:58:04.647189+0000","last_peered":"2024-05-10T09:58:04.647189+0000","last_clean":"2024-05-10T09:58:04.647189+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:04.647189+0000","last_undegraded":"2024-05-10T09:58:04.647189+0000","last_fullsized":"2024-05-10T09:58:04.647189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650463+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:58:04.650463+0000","last_peered":"2024-05-10T09:58:04.650463+0000","last_clean":"2024-05-10T09:58:04.650463+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:04.650463+0000","last_undegraded":"2024-05-10T09:58:04.650463+0000","last_fullsized":"2024-05-10T09:58:04.650463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526549+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:58:04.526549+0000","last_peered":"2024-05-10T09:58:04.526549+0000","last_clean":"2024-05-10T09:58:04.526549+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:04.526549+0000","last_undegraded":"2024-05-10T09:58:04.526549+0000","last_fullsized":"2024-05-10T09:58:04.526549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"79'11","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649007+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:58:04.649007+0000","last_peered":"2024-05-10T09:58:04.649007+0000","last_clean":"2024-05-10T09:58:04.649007+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:04.649007+0000","last_undegraded":"2024-05-10T09:58:04.649007+0000","last_fullsized":"2024-05-10T09:58:04.649007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:36.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647618+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:58:04.647618+0000","last_peered":"2024-05-10T09:58:04.647618+0000","last_clean":"2024-05-10T09:58:04.647618+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:04.647618+0000","last_undegraded":"2024-05-10T09:58:04.647618+0000","last_fullsized":"2024-05-10T09:58:04.647618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":103,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530384+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:58:04.530384+0000","last_peered":"2024-05-10T09:58:04.530384+0000","last_clean":"2024-05-10T09:58:04.530384+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:04.530384+0000","last_undegraded":"2024-05-10T09:58:04.530384+0000","last_fullsized":"2024-05-10T09:58:04.530384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'17","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910719+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:58:08.910719+0000","last_peered":"2024-05-10T09:58:08.910719+0000","last_clean":"2024-05-10T09:58:08.910719+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:08.910719+0000","last_undegraded":"2024-05-10T09:58:08.910719+0000","last_fullsized":"2024-05-10T09:58:08.910719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649718+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:58:04.649718+0000","last_peered":"2024-05-10T09:58:04.649718+0000","last_clean":"2024-05-10T09:58:04.649718+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:04.649718+0000","last_undegraded":"2024-05-10T09:58:04.649718+0000","last_fullsized":"2024-05-10T09:58:04.649718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":131,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646678+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:58:04.646678+0000","last_peered":"2024-05-10T09:58:04.646678+0000","last_clean":"2024-05-10T09:58:04.646678+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:04.646678+0000","last_undegraded":"2024-05-10T09:58:04.646678+0000","last_fullsized":"2024-05-10T09:58:04.646678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654431+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:58:04.654431+0000","last_peered":"2024-05-10T09:58:04.654431+0000","last_clean":"2024-05-10T09:58:04.654431+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:04.654431+0000","last_undegraded":"2024-05-10T09:58:04.654431+0000","last_fullsized":"2024-05-10T09:58:04.654431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18450,"num_write":39,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653243+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:58:04.653243+0000","last_peered":"2024-05-10T09:58:04.653243+0000","last_clean":"2024-05-10T09:58:04.653243+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:04.653243+0000","last_undegraded":"2024-05-10T09:58:04.653243+0000","last_fullsized":"2024-05-10T09:58:04.653243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"89'19","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653251+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:58:04.653251+0000","last_peered":"2024-05-10T09:58:04.653251+0000","last_clean":"2024-05-10T09:58:04.653251+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:04.653251+0000","last_undegraded":"2024-05-10T09:58:04.653251+0000","last_fullsized":"2024-05-10T09:58:04.653251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646293+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:58:04.646293+0000","last_peered":"2024-05-10T09:58:04.646293+0000","last_clean":"2024-05-10T09:58:04.646293+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:04.646293+0000","last_undegraded":"2024-05-10T09:58:04.646293+0000","last_fullsized":"2024-05-10T09:58:04.646293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658184+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:58:04.658184+0000","last_peered":"2024-05-10T09:58:04.658184+0000","last_clean":"2024-05-10T09:58:04.658184+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:04.658184+0000","last_undegraded":"2024-05-10T09:58:04.658184+0000","last_fullsized":"2024-05-10T09:58:04.658184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529018+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:58:04.529018+0000","last_peered":"2024-05-10T09:58:04.529018+0000","last_clean":"2024-05-10T09:58:04.529018+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:04.529018+0000","last_undegraded":"2024-05-10T09:58:04.529018+0000","last_fullsized":"2024-05-10T09:58:04.529018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657322+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:58:04.657322+0000","last_peered":"2024-05-10T09:58:04.657322+0000","last_clean":"2024-05-10T09:58:04.657322+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:04.657322+0000","last_undegraded":"2024-05-10T09:58:04.657322+0000","last_fullsized":"2024-05-10T09:58:04.657322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650809+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:58:04.650809+0000","last_peered":"2024-05-10T09:58:04.650809+0000","last_clean":"2024-05-10T09:58:04.650809+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:04.650809+0000","last_undegraded":"2024-05-10T09:58:04.650809+0000","last_fullsized":"2024-05-10T09:58:04.650809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646411+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:58:04.646411+0000","last_peered":"2024-05-10T09:58:04.646411+0000","last_clean":"2024-05-10T09:58:04.646411+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:04.646411+0000","last_undegraded":"2024-05-10T09:58:04.646411+0000","last_fullsized":"2024-05-10T09:58:04.646411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652426+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:58:04.652426+0000","last_peered":"2024-05-10T09:58:04.652426+0000","last_clean":"2024-05-10T09:58:04.652426+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:04.652426+0000","last_undegraded":"2024-05-10T09:58:04.652426+0000","last_fullsized":"2024-05-10T09:58:04.652426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527768+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:58:04.527768+0000","last_peered":"2024-05-10T09:58:04.527768+0000","last_clean":"2024-05-10T09:58:04.527768+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:04.527768+0000","last_undegraded":"2024-05-10T09:58:04.527768+0000","last_fullsized":"2024-05-10T09:58:04.527768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531028+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:58:04.531028+0000","last_peered":"2024-05-10T09:58:04.531028+0000","last_clean":"2024-05-10T09:58:04.531028+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:04.531028+0000","last_undegraded":"2024-05-10T09:58:04.531028+0000","last_fullsized":"2024-05-10T09:58:04.531028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528950+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:58:04.528950+0000","last_peered":"2024-05-10T09:58:04.528950+0000","last_clean":"2024-05-10T09:58:04.528950+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:04.528950+0000","last_undegraded":"2024-05-10T09:58:04.528950+0000","last_fullsized":"2024-05-10T09:58:04.528950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527959+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:58:04.527959+0000","last_peered":"2024-05-10T09:58:04.527959+0000","last_clean":"2024-05-10T09:58:04.527959+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:04.527959+0000","last_undegraded":"2024-05-10T09:58:04.527959+0000","last_fullsized":"2024-05-10T09:58:04.527959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"89'8","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531553+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:58:04.531553+0000","last_peered":"2024-05-10T09:58:04.531553+0000","last_clean":"2024-05-10T09:58:04.531553+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:04.531553+0000","last_undegraded":"2024-05-10T09:58:04.531553+0000","last_fullsized":"2024-05-10T09:58:04.531553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529836+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:58:04.529836+0000","last_peered":"2024-05-10T09:58:04.529836+0000","last_clean":"2024-05-10T09:58:04.529836+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:04.529836+0000","last_undegraded":"2024-05-10T09:58:04.529836+0000","last_fullsized":"2024-05-10T09:58:04.529836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655255+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:58:04.655255+0000","last_peered":"2024-05-10T09:58:04.655255+0000","last_clean":"2024-05-10T09:58:04.655255+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:04.655255+0000","last_undegraded":"2024-05-10T09:58:04.655255+0000","last_fullsized":"2024-05-10T09:58:04.655255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527607+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:58:04.527607+0000","last_peered":"2024-05-10T09:58:04.527607+0000","last_clean":"2024-05-10T09:58:04.527607+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:04.527607+0000","last_undegraded":"2024-05-10T09:58:04.527607+0000","last_fullsized":"2024-05-10T09:58:04.527607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653419+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:58:04.653419+0000","last_peered":"2024-05-10T09:58:04.653419+0000","last_clean":"2024-05-10T09:58:04.653419+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:04.653419+0000","last_undegraded":"2024-05-10T09:58:04.653419+0000","last_fullsized":"2024-05-10T09:58:04.653419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645798+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:58:04.645798+0000","last_peered":"2024-05-10T09:58:04.645798+0000","last_clean":"2024-05-10T09:58:04.645798+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:04.645798+0000","last_undegraded":"2024-05-10T09:58:04.645798+0000","last_fullsized":"2024-05-10T09:58:04.645798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"89'14","reported_seq":107,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528957+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:58:04.528957+0000","last_peered":"2024-05-10T09:58:04.528957+0000","last_clean":"2024-05-10T09:58:04.528957+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:04.528957+0000","last_undegraded":"2024-05-10T09:58:04.528957+0000","last_fullsized":"2024-05-10T09:58:04.528957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648510+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:58:04.648510+0000","last_peered":"2024-05-10T09:58:04.648510+0000","last_clean":"2024-05-10T09:58:04.648510+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:04.648510+0000","last_undegraded":"2024-05-10T09:58:04.648510+0000","last_fullsized":"2024-05-10T09:58:04.648510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529237+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:58:04.529237+0000","last_peered":"2024-05-10T09:58:04.529237+0000","last_clean":"2024-05-10T09:58:04.529237+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:04.529237+0000","last_undegraded":"2024-05-10T09:58:04.529237+0000","last_fullsized":"2024-05-10T09:58:04.529237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647961+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:58:04.647961+0000","last_peered":"2024-05-10T09:58:04.647961+0000","last_clean":"2024-05-10T09:58:04.647961+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:04.647961+0000","last_undegraded":"2024-05-10T09:58:04.647961+0000","last_fullsized":"2024-05-10T09:58:04.647961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654410+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:58:04.654410+0000","last_peered":"2024-05-10T09:58:04.654410+0000","last_clean":"2024-05-10T09:58:04.654410+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:04.654410+0000","last_undegraded":"2024-05-10T09:58:04.654410+0000","last_fullsized":"2024-05-10T09:58:04.654410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647419+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:58:04.647419+0000","last_peered":"2024-05-10T09:58:04.647419+0000","last_clean":"2024-05-10T09:58:04.647419+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:04.647419+0000","last_undegraded":"2024-05-10T09:58:04.647419+0000","last_fullsized":"2024-05-10T09:58:04.647419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'14","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529372+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:58:04.529372+0000","last_peered":"2024-05-10T09:58:04.529372+0000","last_clean":"2024-05-10T09:58:04.529372+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:04.529372+0000","last_undegraded":"2024-05-10T09:58:04.529372+0000","last_fullsized":"2024-05-10T09:58:04.529372+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656340+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:58:04.656340+0000","last_peered":"2024-05-10T09:58:04.656340+0000","last_clean":"2024-05-10T09:58:04.656340+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:04.656340+0000","last_undegraded":"2024-05-10T09:58:04.656340+0000","last_fullsized":"2024-05-10T09:58:04.656340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"79'6","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652452+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:58:04.652452+0000","last_peered":"2024-05-10T09:58:04.652452+0000","last_clean":"2024-05-10T09:58:04.652452+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:04.652452+0000","last_undegraded":"2024-05-10T09:58:04.652452+0000","last_fullsized":"2024-05-10T09:58:04.652452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648308+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:58:04.648308+0000","last_peered":"2024-05-10T09:58:04.648308+0000","last_clean":"2024-05-10T09:58:04.648308+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:04.648308+0000","last_undegraded":"2024-05-10T09:58:04.648308+0000","last_fullsized":"2024-05-10T09:58:04.648308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649477+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:58:04.649477+0000","last_peered":"2024-05-10T09:58:04.649477+0000","last_clean":"2024-05-10T09:58:04.649477+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:04.649477+0000","last_undegraded":"2024-05-10T09:58:04.649477+0000","last_fullsized":"2024-05-10T09:58:04.649477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":29,"num_read_kb":71692,"num_write":41,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530949+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:58:04.530949+0000","last_peered":"2024-05-10T09:58:04.530949+0000","last_clean":"2024-05-10T09:58:04.530949+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:04.530949+0000","last_undegraded":"2024-05-10T09:58:04.530949+0000","last_fullsized":"2024-05-10T09:58:04.530949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'5","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531779+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:58:04.531779+0000","last_peered":"2024-05-10T09:58:04.531779+0000","last_clean":"2024-05-10T09:58:04.531779+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:58:04.531779+0000","last_undegraded":"2024-05-10T09:58:04.531779+0000","last_fullsized":"2024-05-10T09:58:04.531779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528181+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:58:04.528181+0000","last_peered":"2024-05-10T09:58:04.528181+0000","last_clean":"2024-05-10T09:58:04.528181+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:04.528181+0000","last_undegraded":"2024-05-10T09:58:04.528181+0000","last_fullsized":"2024-05-10T09:58:04.528181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"79'8","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648027+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:58:04.648027+0000","last_peered":"2024-05-10T09:58:04.648027+0000","last_clean":"2024-05-10T09:58:04.648027+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:04.648027+0000","last_undegraded":"2024-05-10T09:58:04.648027+0000","last_fullsized":"2024-05-10T09:58:04.648027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":145,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528710+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:58:04.528710+0000","last_peered":"2024-05-10T09:58:04.528710+0000","last_clean":"2024-05-10T09:58:04.528710+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:04.528710+0000","last_undegraded":"2024-05-10T09:58:04.528710+0000","last_fullsized":"2024-05-10T09:58:04.528710+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660880+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:58:04.660880+0000","last_peered":"2024-05-10T09:58:04.660880+0000","last_clean":"2024-05-10T09:58:04.660880+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:04.660880+0000","last_undegraded":"2024-05-10T09:58:04.660880+0000","last_fullsized":"2024-05-10T09:58:04.660880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651663+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:58:04.651663+0000","last_peered":"2024-05-10T09:58:04.651663+0000","last_clean":"2024-05-10T09:58:04.651663+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:04.651663+0000","last_undegraded":"2024-05-10T09:58:04.651663+0000","last_fullsized":"2024-05-10T09:58:04.651663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'11","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531405+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:58:04.531405+0000","last_peered":"2024-05-10T09:58:04.531405+0000","last_clean":"2024-05-10T09:58:04.531405+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:04.531405+0000","last_undegraded":"2024-05-10T09:58:04.531405+0000","last_fullsized":"2024-05-10T09:58:04.531405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36870,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653362+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:58:04.653362+0000","last_peered":"2024-05-10T09:58:04.653362+0000","last_clean":"2024-05-10T09:58:04.653362+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:04.653362+0000","last_undegraded":"2024-05-10T09:58:04.653362+0000","last_fullsized":"2024-05-10T09:58:04.653362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651637+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:58:04.651637+0000","last_peered":"2024-05-10T09:58:04.651637+0000","last_clean":"2024-05-10T09:58:04.651637+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:04.651637+0000","last_undegraded":"2024-05-10T09:58:04.651637+0000","last_fullsized":"2024-05-10T09:58:04.651637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":36870,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529866+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:58:04.529866+0000","last_peered":"2024-05-10T09:58:04.529866+0000","last_clean":"2024-05-10T09:58:04.529866+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:04.529866+0000","last_undegraded":"2024-05-10T09:58:04.529866+0000","last_fullsized":"2024-05-10T09:58:04.529866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'16","reported_seq":243,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531176+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:58:04.531176+0000","last_peered":"2024-05-10T09:58:04.531176+0000","last_clean":"2024-05-10T09:58:04.531176+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:58:04.531176+0000","last_undegraded":"2024-05-10T09:58:04.531176+0000","last_fullsized":"2024-05-10T09:58:04.531176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527324+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:58:04.527324+0000","last_peered":"2024-05-10T09:58:04.527324+0000","last_clean":"2024-05-10T09:58:04.527324+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:04.527324+0000","last_undegraded":"2024-05-10T09:58:04.527324+0000","last_fullsized":"2024-05-10T09:58:04.527324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652210+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:58:04.652210+0000","last_peered":"2024-05-10T09:58:04.652210+0000","last_clean":"2024-05-10T09:58:04.652210+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:04.652210+0000","last_undegraded":"2024-05-10T09:58:04.652210+0000","last_fullsized":"2024-05-10T09:58:04.652210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530261+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:58:04.530261+0000","last_peered":"2024-05-10T09:58:04.530261+0000","last_clean":"2024-05-10T09:58:04.530261+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:04.530261+0000","last_undegraded":"2024-05-10T09:58:04.530261+0000","last_fullsized":"2024-05-10T09:58:04.530261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650076+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:58:04.650076+0000","last_peered":"2024-05-10T09:58:04.650076+0000","last_clean":"2024-05-10T09:58:04.650076+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:04.650076+0000","last_undegraded":"2024-05-10T09:58:04.650076+0000","last_fullsized":"2024-05-10T09:58:04.650076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654023+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:58:04.654023+0000","last_peered":"2024-05-10T09:58:04.654023+0000","last_clean":"2024-05-10T09:58:04.654023+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:04.654023+0000","last_undegraded":"2024-05-10T09:58:04.654023+0000","last_fullsized":"2024-05-10T09:58:04.654023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'14","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655299+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:58:04.655299+0000","last_peered":"2024-05-10T09:58:04.655299+0000","last_clean":"2024-05-10T09:58:04.655299+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:04.655299+0000","last_undegraded":"2024-05-10T09:58:04.655299+0000","last_fullsized":"2024-05-10T09:58:04.655299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":23,"num_read_kb":36880,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649741+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:58:04.649741+0000","last_peered":"2024-05-10T09:58:04.649741+0000","last_clean":"2024-05-10T09:58:04.649741+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:04.649741+0000","last_undegraded":"2024-05-10T09:58:04.649741+0000","last_fullsized":"2024-05-10T09:58:04.649741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'13","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656883+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:58:04.656883+0000","last_peered":"2024-05-10T09:58:04.656883+0000","last_clean":"2024-05-10T09:58:04.656883+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:04.656883+0000","last_undegraded":"2024-05-10T09:58:04.656883+0000","last_fullsized":"2024-05-10T09:58:04.656883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":34834,"num_write":43,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530476+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:58:04.530476+0000","last_peered":"2024-05-10T09:58:04.530476+0000","last_clean":"2024-05-10T09:58:04.530476+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:04.530476+0000","last_undegraded":"2024-05-10T09:58:04.530476+0000","last_fullsized":"2024-05-10T09:58:04.530476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'9","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530270+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:58:04.530270+0000","last_peered":"2024-05-10T09:58:04.530270+0000","last_clean":"2024-05-10T09:58:04.530270+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:04.530270+0000","last_undegraded":"2024-05-10T09:58:04.530270+0000","last_fullsized":"2024-05-10T09:58:04.530270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650180+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:58:04.650180+0000","last_peered":"2024-05-10T09:58:04.650180+0000","last_clean":"2024-05-10T09:58:04.650180+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:04.650180+0000","last_undegraded":"2024-05-10T09:58:04.650180+0000","last_fullsized":"2024-05-10T09:58:04.650180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658360+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:58:04.658360+0000","last_peered":"2024-05-10T09:58:04.658360+0000","last_clean":"2024-05-10T09:58:04.658360+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:04.658360+0000","last_undegraded":"2024-05-10T09:58:04.658360+0000","last_fullsized":"2024-05-10T09:58:04.658360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":36882,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'8","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651346+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:58:04.651346+0000","last_peered":"2024-05-10T09:58:04.651346+0000","last_clean":"2024-05-10T09:58:04.651346+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:04.651346+0000","last_undegraded":"2024-05-10T09:58:04.651346+0000","last_fullsized":"2024-05-10T09:58:04.651346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653196+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:58:04.653196+0000","last_peered":"2024-05-10T09:58:04.653196+0000","last_clean":"2024-05-10T09:58:04.653196+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:04.653196+0000","last_undegraded":"2024-05-10T09:58:04.653196+0000","last_fullsized":"2024-05-10T09:58:04.653196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'9","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646387+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:58:04.646387+0000","last_peered":"2024-05-10T09:58:04.646387+0000","last_clean":"2024-05-10T09:58:04.646387+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:04.646387+0000","last_undegraded":"2024-05-10T09:58:04.646387+0000","last_fullsized":"2024-05-10T09:58:04.646387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657058+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:58:04.657058+0000","last_peered":"2024-05-10T09:58:04.657058+0000","last_clean":"2024-05-10T09:58:04.657058+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:04.657058+0000","last_undegraded":"2024-05-10T09:58:04.657058+0000","last_fullsized":"2024-05-10T09:58:04.657058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242916,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":922,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":230728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1082,"num_read_kb":2003600,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":452980,"kb_used_data":421804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93918860,"statfs":{"total":96636764160,"available":96172912640,"internally_reserved":0,"allocated":431927296,"data_stored":431305753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323332,"kb_used_data":292156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048508,"statfs":{"total":96636764160,"available":96305672192,"internally_reserved":0,"allocated":299167744,"data_stored":298578850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505668,"kb_used_data":474492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866172,"statfs":{"total":96636764160,"available":96118960128,"internally_reserved":0,"allocated":485879808,"data_stored":485241465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285583,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508200,"kb_used_data":476444,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":93863640,"statfs":{"total":96636764160,"available":96116367360,"internally_reserved":0,"allocated":487878656,"data_stored":487316023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538476,"kb_used_data":503140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93833364,"statfs":{"total":96636764160,"available":96085364736,"internally_reserved":0,"allocated":515215360,"data_stored":514612407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263972,"kb_used_data":228636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94107868,"statfs":{"total":96636764160,"available":96366456832,"internally_reserved":0,"allocated":234123264,"data_stored":233561927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555420,"kb_used_data":520076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93816420,"statfs":{"total":96636764160,"available":96068014080,"internally_reserved":0,"allocated":532557824,"data_stored":531963325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329620,"kb_used_data":290124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94042220,"statfs":{"total":96636764160,"available":96299233280,"internally_reserved":0,"allocated":297086976,"data_stored":296483812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":530579456,"data_stored":530579456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":295698432,"data_stored":295698432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":232783872,"data_stored":232783872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":513802240,"data_stored":513802240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":429916160,"data_stored":429916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":31596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":23865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":16540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":48698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":14205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":37700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":37756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:58:16.399 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:58:16.790 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:16.796 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:58:16.811 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-05-10T09:58:16.269400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613457,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3811,"num_read_kb":2005890,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3477668,"kb_used_data":3206872,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":751497052,"statfs":{"total":773094113280,"available":769532981248,"internally_reserved":0,"allocated":3283836928,"data_stored":3279063562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.745101"},"pg_stats":[{"pgid":"3.3f","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657807+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:58:04.657807+0000","last_peered":"2024-05-10T09:58:04.657807+0000","last_clean":"2024-05-10T09:58:04.657807+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:04.657807+0000","last_undegraded":"2024-05-10T09:58:04.657807+0000","last_fullsized":"2024-05-10T09:58:04.657807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650396+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:58:04.650396+0000","last_peered":"2024-05-10T09:58:04.650396+0000","last_clean":"2024-05-10T09:58:04.650396+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:04.650396+0000","last_undegraded":"2024-05-10T09:58:04.650396+0000","last_fullsized":"2024-05-10T09:58:04.650396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'9","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647529+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:58:04.647529+0000","last_peered":"2024-05-10T09:58:04.647529+0000","last_clean":"2024-05-10T09:58:04.647529+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:04.647529+0000","last_undegraded":"2024-05-10T09:58:04.647529+0000","last_fullsized":"2024-05-10T09:58:04.647529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651881+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:58:04.651881+0000","last_peered":"2024-05-10T09:58:04.651881+0000","last_clean":"2024-05-10T09:58:04.651881+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:04.651881+0000","last_undegraded":"2024-05-10T09:58:04.651881+0000","last_fullsized":"2024-05-10T09:58:04.651881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652086+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:58:04.652086+0000","last_peered":"2024-05-10T09:58:04.652086+0000","last_clean":"2024-05-10T09:58:04.652086+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:04.652086+0000","last_undegraded":"2024-05-10T09:58:04.652086+0000","last_fullsized":"2024-05-10T09:58:04.652086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'12","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654181+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:58:04.654181+0000","last_peered":"2024-05-10T09:58:04.654181+0000","last_clean":"2024-05-10T09:58:04.654181+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:04.654181+0000","last_undegraded":"2024-05-10T09:58:04.654181+0000","last_fullsized":"2024-05-10T09:58:04.654181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649254+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:58:04.649254+0000","last_peered":"2024-05-10T09:58:04.649254+0000","last_clean":"2024-05-10T09:58:04.649254+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:04.649254+0000","last_undegraded":"2024-05-10T09:58:04.649254+0000","last_fullsized":"2024-05-10T09:58:04.649254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'16","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654430+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:58:04.654430+0000","last_peered":"2024-05-10T09:58:04.654430+0000","last_clean":"2024-05-10T09:58:04.654430+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:04.654430+0000","last_undegraded":"2024-05-10T09:58:04.654430+0000","last_fullsized":"2024-05-10T09:58:04.654430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":43032,"num_write":56,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655633+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:58:04.655633+0000","last_peered":"2024-05-10T09:58:04.655633+0000","last_clean":"2024-05-10T09:58:04.655633+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:04.655633+0000","last_undegraded":"2024-05-10T09:58:04.655633+0000","last_fullsized":"2024-05-10T09:58:04.655633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'11","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651688+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:58:04.651688+0000","last_peered":"2024-05-10T09:58:04.651688+0000","last_clean":"2024-05-10T09:58:04.651688+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:04.651688+0000","last_undegraded":"2024-05-10T09:58:04.651688+0000","last_fullsized":"2024-05-10T09:58:04.651688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":36876,"num_write":31,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529657+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:58:04.529657+0000","last_peered":"2024-05-10T09:58:04.529657+0000","last_clean":"2024-05-10T09:58:04.529657+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:04.529657+0000","last_undegraded":"2024-05-10T09:58:04.529657+0000","last_fullsized":"2024-05-10T09:58:04.529657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'6","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528952+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:58:04.528952+0000","last_peered":"2024-05-10T09:58:04.528952+0000","last_clean":"2024-05-10T09:58:04.528952+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:04.528952+0000","last_undegraded":"2024-05-10T09:58:04.528952+0000","last_fullsized":"2024-05-10T09:58:04.528952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656752+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:58:04.656752+0000","last_peered":"2024-05-10T09:58:04.656752+0000","last_clean":"2024-05-10T09:58:04.656752+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:04.656752+0000","last_undegraded":"2024-05-10T09:58:04.656752+0000","last_fullsized":"2024-05-10T09:58:04.656752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"78'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528643+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:58:04.528643+0000","last_peered":"2024-05-10T09:58:04.528643+0000","last_clean":"2024-05-10T09:58:04.528643+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:04.528643+0000","last_undegraded":"2024-05-10T09:58:04.528643+0000","last_fullsized":"2024-05-10T09:58:04.528643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528564+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:58:04.528564+0000","last_peered":"2024-05-10T09:58:04.528564+0000","last_clean":"2024-05-10T09:58:04.528564+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:04.528564+0000","last_undegraded":"2024-05-10T09:58:04.528564+0000","last_fullsized":"2024-05-10T09:58:04.528564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527703+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:58:04.527703+0000","last_peered":"2024-05-10T09:58:04.527703+0000","last_clean":"2024-05-10T09:58:04.527703+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:04.527703+0000","last_undegraded":"2024-05-10T09:58:04.527703+0000","last_fullsized":"2024-05-10T09:58:04.527703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657912+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:58:04.657912+0000","last_peered":"2024-05-10T09:58:04.657912+0000","last_clean":"2024-05-10T09:58:04.657912+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:04.657912+0000","last_undegraded":"2024-05-10T09:58:04.657912+0000","last_fullsized":"2024-05-10T09:58:04.657912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652120+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:58:04.652120+0000","last_peered":"2024-05-10T09:58:04.652120+0000","last_clean":"2024-05-10T09:58:04.652120+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:04.652120+0000","last_undegraded":"2024-05-10T09:58:04.652120+0000","last_fullsized":"2024-05-10T09:58:04.652120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'7","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652595+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:58:04.652595+0000","last_peered":"2024-05-10T09:58:04.652595+0000","last_clean":"2024-05-10T09:58:04.652595+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:04.652595+0000","last_undegraded":"2024-05-10T09:58:04.652595+0000","last_fullsized":"2024-05-10T09:58:04.652595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651965+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:58:04.651965+0000","last_peered":"2024-05-10T09:58:04.651965+0000","last_clean":"2024-05-10T09:58:04.651965+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:04.651965+0000","last_undegraded":"2024-05-10T09:58:04.651965+0000","last_fullsized":"2024-05-10T09:58:04.651965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"79'5","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657131+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:58:04.657131+0000","last_peered":"2024-05-10T09:58:04.657131+0000","last_clean":"2024-05-10T09:58:04.657131+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:04.657131+0000","last_undegraded":"2024-05-10T09:58:04.657131+0000","last_fullsized":"2024-05-10T09:58:04.657131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527325+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:58:04.527325+0000","last_peered":"2024-05-10T09:58:04.527325+0000","last_clean":"2024-05-10T09:58:04.527325+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:04.527325+0000","last_undegraded":"2024-05-10T09:58:04.527325+0000","last_fullsized":"2024-05-10T09:58:04.527325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'19","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529749+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:58:04.529749+0000","last_peered":"2024-05-10T09:58:04.529749+0000","last_clean":"2024-05-10T09:58:04.529749+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:04.529749+0000","last_undegraded":"2024-05-10T09:58:04.529749+0000","last_fullsized":"2024-05-10T09:58:04.529749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":25,"num_read_kb":61452,"num_write":39,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":231,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526267+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:58:04.526267+0000","last_peered":"2024-05-10T09:58:04.526267+0000","last_clean":"2024-05-10T09:58:04.526267+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:04.526267+0000","last_undegraded":"2024-05-10T09:58:04.526267+0000","last_fullsized":"2024-05-10T09:58:04.526267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:28.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529605+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:58:04.529605+0000","last_peered":"2024-05-10T09:58:04.529605+0000","last_clean":"2024-05-10T09:58:04.529605+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:04.529605+0000","last_undegraded":"2024-05-10T09:58:04.529605+0000","last_fullsized":"2024-05-10T09:58:04.529605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529511+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:58:04.529511+0000","last_peered":"2024-05-10T09:58:04.529511+0000","last_clean":"2024-05-10T09:58:04.529511+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:04.529511+0000","last_undegraded":"2024-05-10T09:58:04.529511+0000","last_fullsized":"2024-05-10T09:58:04.529511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"79'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650655+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:58:04.650655+0000","last_peered":"2024-05-10T09:58:04.650655+0000","last_clean":"2024-05-10T09:58:04.650655+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:04.650655+0000","last_undegraded":"2024-05-10T09:58:04.650655+0000","last_fullsized":"2024-05-10T09:58:04.650655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528133+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:58:04.528133+0000","last_peered":"2024-05-10T09:58:04.528133+0000","last_clean":"2024-05-10T09:58:04.528133+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:04.528133+0000","last_undegraded":"2024-05-10T09:58:04.528133+0000","last_fullsized":"2024-05-10T09:58:04.528133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530920+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:58:04.530920+0000","last_peered":"2024-05-10T09:58:04.530920+0000","last_clean":"2024-05-10T09:58:04.530920+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:04.530920+0000","last_undegraded":"2024-05-10T09:58:04.530920+0000","last_fullsized":"2024-05-10T09:58:04.530920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'10","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654850+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:58:04.654850+0000","last_peered":"2024-05-10T09:58:04.654850+0000","last_clean":"2024-05-10T09:58:04.654850+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:04.654850+0000","last_undegraded":"2024-05-10T09:58:04.654850+0000","last_fullsized":"2024-05-10T09:58:04.654850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":18442,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655953+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:58:04.655953+0000","last_peered":"2024-05-10T09:58:04.655953+0000","last_clean":"2024-05-10T09:58:04.655953+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:04.655953+0000","last_undegraded":"2024-05-10T09:58:04.655953+0000","last_fullsized":"2024-05-10T09:58:04.655953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652475+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:58:04.652475+0000","last_peered":"2024-05-10T09:58:04.652475+0000","last_clean":"2024-05-10T09:58:04.652475+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:04.652475+0000","last_undegraded":"2024-05-10T09:58:04.652475+0000","last_fullsized":"2024-05-10T09:58:04.652475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655116+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:58:04.655116+0000","last_peered":"2024-05-10T09:58:04.655116+0000","last_clean":"2024-05-10T09:58:04.655116+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:04.655116+0000","last_undegraded":"2024-05-10T09:58:04.655116+0000","last_fullsized":"2024-05-10T09:58:04.655116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650200+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:58:04.650200+0000","last_peered":"2024-05-10T09:58:04.650200+0000","last_clean":"2024-05-10T09:58:04.650200+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:04.650200+0000","last_undegraded":"2024-05-10T09:58:04.650200+0000","last_fullsized":"2024-05-10T09:58:04.650200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657074+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:58:04.657074+0000","last_peered":"2024-05-10T09:58:04.657074+0000","last_clean":"2024-05-10T09:58:04.657074+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:04.657074+0000","last_undegraded":"2024-05-10T09:58:04.657074+0000","last_fullsized":"2024-05-10T09:58:04.657074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650910+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:58:04.650910+0000","last_peered":"2024-05-10T09:58:04.650910+0000","last_clean":"2024-05-10T09:58:04.650910+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:04.650910+0000","last_undegraded":"2024-05-10T09:58:04.650910+0000","last_fullsized":"2024-05-10T09:58:04.650910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530366+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:58:04.530366+0000","last_peered":"2024-05-10T09:58:04.530366+0000","last_clean":"2024-05-10T09:58:04.530366+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:04.530366+0000","last_undegraded":"2024-05-10T09:58:04.530366+0000","last_fullsized":"2024-05-10T09:58:04.530366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":93,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530616+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:58:04.530616+0000","last_peered":"2024-05-10T09:58:04.530616+0000","last_clean":"2024-05-10T09:58:04.530616+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:04.530616+0000","last_undegraded":"2024-05-10T09:58:04.530616+0000","last_fullsized":"2024-05-10T09:58:04.530616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530644+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:58:04.530644+0000","last_peered":"2024-05-10T09:58:04.530644+0000","last_clean":"2024-05-10T09:58:04.530644+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:04.530644+0000","last_undegraded":"2024-05-10T09:58:04.530644+0000","last_fullsized":"2024-05-10T09:58:04.530644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649999+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:58:04.649999+0000","last_peered":"2024-05-10T09:58:04.649999+0000","last_clean":"2024-05-10T09:58:04.649999+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:04.649999+0000","last_undegraded":"2024-05-10T09:58:04.649999+0000","last_fullsized":"2024-05-10T09:58:04.649999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652885+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:58:04.652885+0000","last_peered":"2024-05-10T09:58:04.652885+0000","last_clean":"2024-05-10T09:58:04.652885+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:04.652885+0000","last_undegraded":"2024-05-10T09:58:04.652885+0000","last_fullsized":"2024-05-10T09:58:04.652885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'13","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652338+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:58:04.652338+0000","last_peered":"2024-05-10T09:58:04.652338+0000","last_clean":"2024-05-10T09:58:04.652338+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:04.652338+0000","last_undegraded":"2024-05-10T09:58:04.652338+0000","last_fullsized":"2024-05-10T09:58:04.652338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.532396+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:58:04.532396+0000","last_peered":"2024-05-10T09:58:04.532396+0000","last_clean":"2024-05-10T09:58:04.532396+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:04.532396+0000","last_undegraded":"2024-05-10T09:58:04.532396+0000","last_fullsized":"2024-05-10T09:58:04.532396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525699+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:58:04.525699+0000","last_peered":"2024-05-10T09:58:04.525699+0000","last_clean":"2024-05-10T09:58:04.525699+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:04.525699+0000","last_undegraded":"2024-05-10T09:58:04.525699+0000","last_fullsized":"2024-05-10T09:58:04.525699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:28.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'15","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910656+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:58:08.910656+0000","last_peered":"2024-05-10T09:58:08.910656+0000","last_clean":"2024-05-10T09:58:08.910656+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:08.910656+0000","last_undegraded":"2024-05-10T09:58:08.910656+0000","last_fullsized":"2024-05-10T09:58:08.910656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529188+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:58:04.529188+0000","last_peered":"2024-05-10T09:58:04.529188+0000","last_clean":"2024-05-10T09:58:04.529188+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:04.529188+0000","last_undegraded":"2024-05-10T09:58:04.529188+0000","last_fullsized":"2024-05-10T09:58:04.529188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531253+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:58:04.531253+0000","last_peered":"2024-05-10T09:58:04.531253+0000","last_clean":"2024-05-10T09:58:04.531253+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:04.531253+0000","last_undegraded":"2024-05-10T09:58:04.531253+0000","last_fullsized":"2024-05-10T09:58:04.531253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654828+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:58:04.654828+0000","last_peered":"2024-05-10T09:58:04.654828+0000","last_clean":"2024-05-10T09:58:04.654828+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:04.654828+0000","last_undegraded":"2024-05-10T09:58:04.654828+0000","last_fullsized":"2024-05-10T09:58:04.654828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656656+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:58:04.656656+0000","last_peered":"2024-05-10T09:58:04.656656+0000","last_clean":"2024-05-10T09:58:04.656656+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:04.656656+0000","last_undegraded":"2024-05-10T09:58:04.656656+0000","last_fullsized":"2024-05-10T09:58:04.656656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"89'13","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655008+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:58:04.655008+0000","last_peered":"2024-05-10T09:58:04.655008+0000","last_clean":"2024-05-10T09:58:04.655008+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:04.655008+0000","last_undegraded":"2024-05-10T09:58:04.655008+0000","last_fullsized":"2024-05-10T09:58:04.655008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908303+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:58:08.908303+0000","last_peered":"2024-05-10T09:58:08.908303+0000","last_clean":"2024-05-10T09:58:08.908303+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:08.908303+0000","last_undegraded":"2024-05-10T09:58:08.908303+0000","last_fullsized":"2024-05-10T09:58:08.908303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651101+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:58:04.651101+0000","last_peered":"2024-05-10T09:58:04.651101+0000","last_clean":"2024-05-10T09:58:04.651101+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:04.651101+0000","last_undegraded":"2024-05-10T09:58:04.651101+0000","last_fullsized":"2024-05-10T09:58:04.651101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'8","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658091+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:58:04.658091+0000","last_peered":"2024-05-10T09:58:04.658091+0000","last_clean":"2024-05-10T09:58:04.658091+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:04.658091+0000","last_undegraded":"2024-05-10T09:58:04.658091+0000","last_fullsized":"2024-05-10T09:58:04.658091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651083+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:58:04.651083+0000","last_peered":"2024-05-10T09:58:04.651083+0000","last_clean":"2024-05-10T09:58:04.651083+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:04.651083+0000","last_undegraded":"2024-05-10T09:58:04.651083+0000","last_fullsized":"2024-05-10T09:58:04.651083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"89'23","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650787+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:58:04.650787+0000","last_peered":"2024-05-10T09:58:04.650787+0000","last_clean":"2024-05-10T09:58:04.650787+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:04.650787+0000","last_undegraded":"2024-05-10T09:58:04.650787+0000","last_fullsized":"2024-05-10T09:58:04.650787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647210+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:58:04.647210+0000","last_peered":"2024-05-10T09:58:04.647210+0000","last_clean":"2024-05-10T09:58:04.647210+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:04.647210+0000","last_undegraded":"2024-05-10T09:58:04.647210+0000","last_fullsized":"2024-05-10T09:58:04.647210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653582+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:58:04.653582+0000","last_peered":"2024-05-10T09:58:04.653582+0000","last_clean":"2024-05-10T09:58:04.653582+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:04.653582+0000","last_undegraded":"2024-05-10T09:58:04.653582+0000","last_fullsized":"2024-05-10T09:58:04.653582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527921+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:58:04.527921+0000","last_peered":"2024-05-10T09:58:04.527921+0000","last_clean":"2024-05-10T09:58:04.527921+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:04.527921+0000","last_undegraded":"2024-05-10T09:58:04.527921+0000","last_fullsized":"2024-05-10T09:58:04.527921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'13","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656481+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:58:04.656481+0000","last_peered":"2024-05-10T09:58:04.656481+0000","last_clean":"2024-05-10T09:58:04.656481+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:04.656481+0000","last_undegraded":"2024-05-10T09:58:04.656481+0000","last_fullsized":"2024-05-10T09:58:04.656481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525029+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:58:04.525029+0000","last_peered":"2024-05-10T09:58:04.525029+0000","last_clean":"2024-05-10T09:58:04.525029+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:04.525029+0000","last_undegraded":"2024-05-10T09:58:04.525029+0000","last_fullsized":"2024-05-10T09:58:04.525029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"89'15","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531332+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:58:04.531332+0000","last_peered":"2024-05-10T09:58:04.531332+0000","last_clean":"2024-05-10T09:58:04.531332+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:04.531332+0000","last_undegraded":"2024-05-10T09:58:04.531332+0000","last_fullsized":"2024-05-10T09:58:04.531332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527842+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:58:04.527842+0000","last_peered":"2024-05-10T09:58:04.527842+0000","last_clean":"2024-05-10T09:58:04.527842+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:04.527842+0000","last_undegraded":"2024-05-10T09:58:04.527842+0000","last_fullsized":"2024-05-10T09:58:04.527842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660834+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:58:04.660834+0000","last_peered":"2024-05-10T09:58:04.660834+0000","last_clean":"2024-05-10T09:58:04.660834+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:04.660834+0000","last_undegraded":"2024-05-10T09:58:04.660834+0000","last_fullsized":"2024-05-10T09:58:04.660834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655192+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:58:04.655192+0000","last_peered":"2024-05-10T09:58:04.655192+0000","last_clean":"2024-05-10T09:58:04.655192+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:04.655192+0000","last_undegraded":"2024-05-10T09:58:04.655192+0000","last_fullsized":"2024-05-10T09:58:04.655192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656460+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:58:04.656460+0000","last_peered":"2024-05-10T09:58:04.656460+0000","last_clean":"2024-05-10T09:58:04.656460+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:04.656460+0000","last_undegraded":"2024-05-10T09:58:04.656460+0000","last_fullsized":"2024-05-10T09:58:04.656460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527977+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:58:04.527977+0000","last_peered":"2024-05-10T09:58:04.527977+0000","last_clean":"2024-05-10T09:58:04.527977+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:04.527977+0000","last_undegraded":"2024-05-10T09:58:04.527977+0000","last_fullsized":"2024-05-10T09:58:04.527977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"89'19","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650811+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:58:04.650811+0000","last_peered":"2024-05-10T09:58:04.650811+0000","last_clean":"2024-05-10T09:58:04.650811+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:04.650811+0000","last_undegraded":"2024-05-10T09:58:04.650811+0000","last_fullsized":"2024-05-10T09:58:04.650811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908192+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:58:08.908192+0000","last_peered":"2024-05-10T09:58:08.908192+0000","last_clean":"2024-05-10T09:58:08.908192+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:08.908192+0000","last_undegraded":"2024-05-10T09:58:08.908192+0000","last_fullsized":"2024-05-10T09:58:08.908192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652535+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:58:04.652535+0000","last_peered":"2024-05-10T09:58:04.652535+0000","last_clean":"2024-05-10T09:58:04.652535+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:04.652535+0000","last_undegraded":"2024-05-10T09:58:04.652535+0000","last_fullsized":"2024-05-10T09:58:04.652535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651204+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:58:04.651204+0000","last_peered":"2024-05-10T09:58:04.651204+0000","last_clean":"2024-05-10T09:58:04.651204+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:04.651204+0000","last_undegraded":"2024-05-10T09:58:04.651204+0000","last_fullsized":"2024-05-10T09:58:04.651204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'15","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654833+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:58:04.654833+0000","last_peered":"2024-05-10T09:58:04.654833+0000","last_clean":"2024-05-10T09:58:04.654833+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:04.654833+0000","last_undegraded":"2024-05-10T09:58:04.654833+0000","last_fullsized":"2024-05-10T09:58:04.654833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":49170,"num_write":45,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526171+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:58:04.526171+0000","last_peered":"2024-05-10T09:58:04.526171+0000","last_clean":"2024-05-10T09:58:04.526171+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:04.526171+0000","last_undegraded":"2024-05-10T09:58:04.526171+0000","last_fullsized":"2024-05-10T09:58:04.526171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:37.269066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"89'24","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648751+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:58:04.648751+0000","last_peered":"2024-05-10T09:58:04.648751+0000","last_clean":"2024-05-10T09:58:04.648751+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:04.648751+0000","last_undegraded":"2024-05-10T09:58:04.648751+0000","last_fullsized":"2024-05-10T09:58:04.648751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.524822+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:58:04.524822+0000","last_peered":"2024-05-10T09:58:04.524822+0000","last_clean":"2024-05-10T09:58:04.524822+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:04.524822+0000","last_undegraded":"2024-05-10T09:58:04.524822+0000","last_fullsized":"2024-05-10T09:58:04.524822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646874+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:58:04.646874+0000","last_peered":"2024-05-10T09:58:04.646874+0000","last_clean":"2024-05-10T09:58:04.646874+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:04.646874+0000","last_undegraded":"2024-05-10T09:58:04.646874+0000","last_fullsized":"2024-05-10T09:58:04.646874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529824+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:58:04.529824+0000","last_peered":"2024-05-10T09:58:04.529824+0000","last_clean":"2024-05-10T09:58:04.529824+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:04.529824+0000","last_undegraded":"2024-05-10T09:58:04.529824+0000","last_fullsized":"2024-05-10T09:58:04.529824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528967+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:58:04.528967+0000","last_peered":"2024-05-10T09:58:04.528967+0000","last_clean":"2024-05-10T09:58:04.528967+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:04.528967+0000","last_undegraded":"2024-05-10T09:58:04.528967+0000","last_fullsized":"2024-05-10T09:58:04.528967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526622+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:58:04.526622+0000","last_peered":"2024-05-10T09:58:04.526622+0000","last_clean":"2024-05-10T09:58:04.526622+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:04.526622+0000","last_undegraded":"2024-05-10T09:58:04.526622+0000","last_fullsized":"2024-05-10T09:58:04.526622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"94'19","reported_seq":114,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530696+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:58:04.530696+0000","last_peered":"2024-05-10T09:58:04.530696+0000","last_clean":"2024-05-10T09:58:04.530696+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:04.530696+0000","last_undegraded":"2024-05-10T09:58:04.530696+0000","last_fullsized":"2024-05-10T09:58:04.530696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":33,"num_write":28,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653112+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:58:04.653112+0000","last_peered":"2024-05-10T09:58:04.653112+0000","last_clean":"2024-05-10T09:58:04.653112+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:04.653112+0000","last_undegraded":"2024-05-10T09:58:04.653112+0000","last_fullsized":"2024-05-10T09:58:04.653112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525936+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:58:04.525936+0000","last_peered":"2024-05-10T09:58:04.525936+0000","last_clean":"2024-05-10T09:58:04.525936+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:04.525936+0000","last_undegraded":"2024-05-10T09:58:04.525936+0000","last_fullsized":"2024-05-10T09:58:04.525936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529936+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:58:04.529936+0000","last_peered":"2024-05-10T09:58:04.529936+0000","last_clean":"2024-05-10T09:58:04.529936+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:04.529936+0000","last_undegraded":"2024-05-10T09:58:04.529936+0000","last_fullsized":"2024-05-10T09:58:04.529936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'7","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655796+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:58:04.655796+0000","last_peered":"2024-05-10T09:58:04.655796+0000","last_clean":"2024-05-10T09:58:04.655796+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:04.655796+0000","last_undegraded":"2024-05-10T09:58:04.655796+0000","last_fullsized":"2024-05-10T09:58:04.655796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646639+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:58:04.646639+0000","last_peered":"2024-05-10T09:58:04.646639+0000","last_clean":"2024-05-10T09:58:04.646639+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:04.646639+0000","last_undegraded":"2024-05-10T09:58:04.646639+0000","last_fullsized":"2024-05-10T09:58:04.646639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"89'22","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528148+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:58:04.528148+0000","last_peered":"2024-05-10T09:58:04.528148+0000","last_clean":"2024-05-10T09:58:04.528148+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:04.528148+0000","last_undegraded":"2024-05-10T09:58:04.528148+0000","last_fullsized":"2024-05-10T09:58:04.528148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11923,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'15","reported_seq":251,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908366+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:58:08.908366+0000","last_peered":"2024-05-10T09:58:08.908366+0000","last_clean":"2024-05-10T09:58:08.908366+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:08.908366+0000","last_undegraded":"2024-05-10T09:58:08.908366+0000","last_fullsized":"2024-05-10T09:58:08.908366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648186+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:58:04.648186+0000","last_peered":"2024-05-10T09:58:04.648186+0000","last_clean":"2024-05-10T09:58:04.648186+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:04.648186+0000","last_undegraded":"2024-05-10T09:58:04.648186+0000","last_fullsized":"2024-05-10T09:58:04.648186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530492+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:58:04.530492+0000","last_peered":"2024-05-10T09:58:04.530492+0000","last_clean":"2024-05-10T09:58:04.530492+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:04.530492+0000","last_undegraded":"2024-05-10T09:58:04.530492+0000","last_fullsized":"2024-05-10T09:58:04.530492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"78'3","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528266+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:58:04.528266+0000","last_peered":"2024-05-10T09:58:04.528266+0000","last_clean":"2024-05-10T09:58:04.528266+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:04.528266+0000","last_undegraded":"2024-05-10T09:58:04.528266+0000","last_fullsized":"2024-05-10T09:58:04.528266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.217710+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:58:15.217710+0000","last_peered":"2024-05-10T09:58:15.217710+0000","last_clean":"2024-05-10T09:58:15.217710+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:15.217710+0000","last_undegraded":"2024-05-10T09:58:15.217710+0000","last_fullsized":"2024-05-10T09:58:15.217710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528642+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:58:04.528642+0000","last_peered":"2024-05-10T09:58:04.528642+0000","last_clean":"2024-05-10T09:58:04.528642+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:04.528642+0000","last_undegraded":"2024-05-10T09:58:04.528642+0000","last_fullsized":"2024-05-10T09:58:04.528642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'15","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910725+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:58:08.910725+0000","last_peered":"2024-05-10T09:58:08.910725+0000","last_clean":"2024-05-10T09:58:08.910725+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:08.910725+0000","last_undegraded":"2024-05-10T09:58:08.910725+0000","last_fullsized":"2024-05-10T09:58:08.910725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528502+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:58:04.528502+0000","last_peered":"2024-05-10T09:58:04.528502+0000","last_clean":"2024-05-10T09:58:04.528502+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:04.528502+0000","last_undegraded":"2024-05-10T09:58:04.528502+0000","last_fullsized":"2024-05-10T09:58:04.528502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647951+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:58:04.647951+0000","last_peered":"2024-05-10T09:58:04.647951+0000","last_clean":"2024-05-10T09:58:04.647951+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:04.647951+0000","last_undegraded":"2024-05-10T09:58:04.647951+0000","last_fullsized":"2024-05-10T09:58:04.647951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"89'13","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529478+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:58:04.529478+0000","last_peered":"2024-05-10T09:58:04.529478+0000","last_clean":"2024-05-10T09:58:04.529478+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:04.529478+0000","last_undegraded":"2024-05-10T09:58:04.529478+0000","last_fullsized":"2024-05-10T09:58:04.529478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530226+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:58:04.530226+0000","last_peered":"2024-05-10T09:58:04.530226+0000","last_clean":"2024-05-10T09:58:04.530226+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:04.530226+0000","last_undegraded":"2024-05-10T09:58:04.530226+0000","last_fullsized":"2024-05-10T09:58:04.530226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"89'24","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655681+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:58:04.655681+0000","last_peered":"2024-05-10T09:58:04.655681+0000","last_clean":"2024-05-10T09:58:04.655681+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:04.655681+0000","last_undegraded":"2024-05-10T09:58:04.655681+0000","last_fullsized":"2024-05-10T09:58:04.655681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652778+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:58:04.652778+0000","last_peered":"2024-05-10T09:58:04.652778+0000","last_clean":"2024-05-10T09:58:04.652778+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:04.652778+0000","last_undegraded":"2024-05-10T09:58:04.652778+0000","last_fullsized":"2024-05-10T09:58:04.652778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646928+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:58:04.646928+0000","last_peered":"2024-05-10T09:58:04.646928+0000","last_clean":"2024-05-10T09:58:04.646928+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:04.646928+0000","last_undegraded":"2024-05-10T09:58:04.646928+0000","last_fullsized":"2024-05-10T09:58:04.646928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":238,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656709+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:58:04.656709+0000","last_peered":"2024-05-10T09:58:04.656709+0000","last_clean":"2024-05-10T09:58:04.656709+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:04.656709+0000","last_undegraded":"2024-05-10T09:58:04.656709+0000","last_fullsized":"2024-05-10T09:58:04.656709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":285,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651075+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:58:04.651075+0000","last_peered":"2024-05-10T09:58:04.651075+0000","last_clean":"2024-05-10T09:58:04.651075+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:04.651075+0000","last_undegraded":"2024-05-10T09:58:04.651075+0000","last_fullsized":"2024-05-10T09:58:04.651075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651354+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:58:04.651354+0000","last_peered":"2024-05-10T09:58:04.651354+0000","last_clean":"2024-05-10T09:58:04.651354+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:04.651354+0000","last_undegraded":"2024-05-10T09:58:04.651354+0000","last_fullsized":"2024-05-10T09:58:04.651354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528876+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:58:04.528876+0000","last_peered":"2024-05-10T09:58:04.528876+0000","last_clean":"2024-05-10T09:58:04.528876+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:04.528876+0000","last_undegraded":"2024-05-10T09:58:04.528876+0000","last_fullsized":"2024-05-10T09:58:04.528876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657379+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:58:04.657379+0000","last_peered":"2024-05-10T09:58:04.657379+0000","last_clean":"2024-05-10T09:58:04.657379+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:04.657379+0000","last_undegraded":"2024-05-10T09:58:04.657379+0000","last_fullsized":"2024-05-10T09:58:04.657379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"89'31","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657459+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:58:04.657459+0000","last_peered":"2024-05-10T09:58:04.657459+0000","last_clean":"2024-05-10T09:58:04.657459+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:04.657459+0000","last_undegraded":"2024-05-10T09:58:04.657459+0000","last_fullsized":"2024-05-10T09:58:04.657459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":70,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652543+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:58:04.652543+0000","last_peered":"2024-05-10T09:58:04.652543+0000","last_clean":"2024-05-10T09:58:04.652543+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:04.652543+0000","last_undegraded":"2024-05-10T09:58:04.652543+0000","last_fullsized":"2024-05-10T09:58:04.652543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651894+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:58:04.651894+0000","last_peered":"2024-05-10T09:58:04.651894+0000","last_clean":"2024-05-10T09:58:04.651894+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:04.651894+0000","last_undegraded":"2024-05-10T09:58:04.651894+0000","last_fullsized":"2024-05-10T09:58:04.651894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652782+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:58:04.652782+0000","last_peered":"2024-05-10T09:58:04.652782+0000","last_clean":"2024-05-10T09:58:04.652782+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:04.652782+0000","last_undegraded":"2024-05-10T09:58:04.652782+0000","last_fullsized":"2024-05-10T09:58:04.652782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650560+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:58:04.650560+0000","last_peered":"2024-05-10T09:58:04.650560+0000","last_clean":"2024-05-10T09:58:04.650560+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:04.650560+0000","last_undegraded":"2024-05-10T09:58:04.650560+0000","last_fullsized":"2024-05-10T09:58:04.650560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'12","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649016+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:58:04.649016+0000","last_peered":"2024-05-10T09:58:04.649016+0000","last_clean":"2024-05-10T09:58:04.649016+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:04.649016+0000","last_undegraded":"2024-05-10T09:58:04.649016+0000","last_fullsized":"2024-05-10T09:58:04.649016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.015437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658097+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:58:04.658097+0000","last_peered":"2024-05-10T09:58:04.658097+0000","last_clean":"2024-05-10T09:58:04.658097+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:04.658097+0000","last_undegraded":"2024-05-10T09:58:04.658097+0000","last_fullsized":"2024-05-10T09:58:04.658097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'52","reported_seq":284,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908550+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:58:08.908550+0000","last_peered":"2024-05-10T09:58:08.908550+0000","last_clean":"2024-05-10T09:58:08.908550+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:08.908550+0000","last_undegraded":"2024-05-10T09:58:08.908550+0000","last_fullsized":"2024-05-10T09:58:08.908550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20102,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":82,"num_read_kb":100,"num_write":54,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654776+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:58:04.654776+0000","last_peered":"2024-05-10T09:58:04.654776+0000","last_clean":"2024-05-10T09:58:04.654776+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:04.654776+0000","last_undegraded":"2024-05-10T09:58:04.654776+0000","last_fullsized":"2024-05-10T09:58:04.654776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647636+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:58:04.647636+0000","last_peered":"2024-05-10T09:58:04.647636+0000","last_clean":"2024-05-10T09:58:04.647636+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:04.647636+0000","last_undegraded":"2024-05-10T09:58:04.647636+0000","last_fullsized":"2024-05-10T09:58:04.647636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648061+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:58:04.648061+0000","last_peered":"2024-05-10T09:58:04.648061+0000","last_clean":"2024-05-10T09:58:04.648061+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:04.648061+0000","last_undegraded":"2024-05-10T09:58:04.648061+0000","last_fullsized":"2024-05-10T09:58:04.648061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529781+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:58:04.529781+0000","last_peered":"2024-05-10T09:58:04.529781+0000","last_clean":"2024-05-10T09:58:04.529781+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:04.529781+0000","last_undegraded":"2024-05-10T09:58:04.529781+0000","last_fullsized":"2024-05-10T09:58:04.529781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'10","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645674+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:58:04.645674+0000","last_peered":"2024-05-10T09:58:04.645674+0000","last_clean":"2024-05-10T09:58:04.645674+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:04.645674+0000","last_undegraded":"2024-05-10T09:58:04.645674+0000","last_fullsized":"2024-05-10T09:58:04.645674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529576+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:58:04.529576+0000","last_peered":"2024-05-10T09:58:04.529576+0000","last_clean":"2024-05-10T09:58:04.529576+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:04.529576+0000","last_undegraded":"2024-05-10T09:58:04.529576+0000","last_fullsized":"2024-05-10T09:58:04.529576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"110'16","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655641+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:58:04.655641+0000","last_peered":"2024-05-10T09:58:04.655641+0000","last_clean":"2024-05-10T09:58:04.655641+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:04.655641+0000","last_undegraded":"2024-05-10T09:58:04.655641+0000","last_fullsized":"2024-05-10T09:58:04.655641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651737+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:58:04.651737+0000","last_peered":"2024-05-10T09:58:04.651737+0000","last_clean":"2024-05-10T09:58:04.651737+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:04.651737+0000","last_undegraded":"2024-05-10T09:58:04.651737+0000","last_fullsized":"2024-05-10T09:58:04.651737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:06.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530498+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:58:04.530498+0000","last_peered":"2024-05-10T09:58:04.530498+0000","last_clean":"2024-05-10T09:58:04.530498+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:04.530498+0000","last_undegraded":"2024-05-10T09:58:04.530498+0000","last_fullsized":"2024-05-10T09:58:04.530498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647231+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:58:04.647231+0000","last_peered":"2024-05-10T09:58:04.647231+0000","last_clean":"2024-05-10T09:58:04.647231+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:04.647231+0000","last_undegraded":"2024-05-10T09:58:04.647231+0000","last_fullsized":"2024-05-10T09:58:04.647231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653676+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:58:04.653676+0000","last_peered":"2024-05-10T09:58:04.653676+0000","last_clean":"2024-05-10T09:58:04.653676+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:04.653676+0000","last_undegraded":"2024-05-10T09:58:04.653676+0000","last_fullsized":"2024-05-10T09:58:04.653676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'10","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651974+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:58:04.651974+0000","last_peered":"2024-05-10T09:58:04.651974+0000","last_clean":"2024-05-10T09:58:04.651974+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:04.651974+0000","last_undegraded":"2024-05-10T09:58:04.651974+0000","last_fullsized":"2024-05-10T09:58:04.651974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528089+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:58:04.528089+0000","last_peered":"2024-05-10T09:58:04.528089+0000","last_clean":"2024-05-10T09:58:04.528089+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:04.528089+0000","last_undegraded":"2024-05-10T09:58:04.528089+0000","last_fullsized":"2024-05-10T09:58:04.528089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655245+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:58:04.655245+0000","last_peered":"2024-05-10T09:58:04.655245+0000","last_clean":"2024-05-10T09:58:04.655245+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:04.655245+0000","last_undegraded":"2024-05-10T09:58:04.655245+0000","last_fullsized":"2024-05-10T09:58:04.655245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649808+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:58:04.649808+0000","last_peered":"2024-05-10T09:58:04.649808+0000","last_clean":"2024-05-10T09:58:04.649808+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:04.649808+0000","last_undegraded":"2024-05-10T09:58:04.649808+0000","last_fullsized":"2024-05-10T09:58:04.649808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646914+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:58:04.646914+0000","last_peered":"2024-05-10T09:58:04.646914+0000","last_clean":"2024-05-10T09:58:04.646914+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:04.646914+0000","last_undegraded":"2024-05-10T09:58:04.646914+0000","last_fullsized":"2024-05-10T09:58:04.646914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657604+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:58:04.657604+0000","last_peered":"2024-05-10T09:58:04.657604+0000","last_clean":"2024-05-10T09:58:04.657604+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:04.657604+0000","last_undegraded":"2024-05-10T09:58:04.657604+0000","last_fullsized":"2024-05-10T09:58:04.657604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648281+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:58:04.648281+0000","last_peered":"2024-05-10T09:58:04.648281+0000","last_clean":"2024-05-10T09:58:04.648281+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:04.648281+0000","last_undegraded":"2024-05-10T09:58:04.648281+0000","last_fullsized":"2024-05-10T09:58:04.648281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649720+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:58:04.649720+0000","last_peered":"2024-05-10T09:58:04.649720+0000","last_clean":"2024-05-10T09:58:04.649720+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:04.649720+0000","last_undegraded":"2024-05-10T09:58:04.649720+0000","last_fullsized":"2024-05-10T09:58:04.649720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"89'28","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646802+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:58:04.646802+0000","last_peered":"2024-05-10T09:58:04.646802+0000","last_clean":"2024-05-10T09:58:04.646802+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:04.646802+0000","last_undegraded":"2024-05-10T09:58:04.646802+0000","last_fullsized":"2024-05-10T09:58:04.646802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11529,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529488+0000","last_change":"2024-05-10T09:57:19.676469+0000","last_active":"2024-05-10T09:58:04.529488+0000","last_peered":"2024-05-10T09:58:04.529488+0000","last_clean":"2024-05-10T09:58:04.529488+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:58:04.529488+0000","last_undegraded":"2024-05-10T09:58:04.529488+0000","last_fullsized":"2024-05-10T09:58:04.529488+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:07.877322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651956+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:58:04.651956+0000","last_peered":"2024-05-10T09:58:04.651956+0000","last_clean":"2024-05-10T09:58:04.651956+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:04.651956+0000","last_undegraded":"2024-05-10T09:58:04.651956+0000","last_fullsized":"2024-05-10T09:58:04.651956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651063+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:58:04.651063+0000","last_peered":"2024-05-10T09:58:04.651063+0000","last_clean":"2024-05-10T09:58:04.651063+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:04.651063+0000","last_undegraded":"2024-05-10T09:58:04.651063+0000","last_fullsized":"2024-05-10T09:58:04.651063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"77'3","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647490+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:58:04.647490+0000","last_peered":"2024-05-10T09:58:04.647490+0000","last_clean":"2024-05-10T09:58:04.647490+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:04.647490+0000","last_undegraded":"2024-05-10T09:58:04.647490+0000","last_fullsized":"2024-05-10T09:58:04.647490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657133+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:58:04.657133+0000","last_peered":"2024-05-10T09:58:04.657133+0000","last_clean":"2024-05-10T09:58:04.657133+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:04.657133+0000","last_undegraded":"2024-05-10T09:58:04.657133+0000","last_fullsized":"2024-05-10T09:58:04.657133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656579+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:58:04.656579+0000","last_peered":"2024-05-10T09:58:04.656579+0000","last_clean":"2024-05-10T09:58:04.656579+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:04.656579+0000","last_undegraded":"2024-05-10T09:58:04.656579+0000","last_fullsized":"2024-05-10T09:58:04.656579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645778+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:58:04.645778+0000","last_peered":"2024-05-10T09:58:04.645778+0000","last_clean":"2024-05-10T09:58:04.645778+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:04.645778+0000","last_undegraded":"2024-05-10T09:58:04.645778+0000","last_fullsized":"2024-05-10T09:58:04.645778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'17","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.248481+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:58:15.248481+0000","last_peered":"2024-05-10T09:58:15.248481+0000","last_clean":"2024-05-10T09:58:15.248481+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:15.248481+0000","last_undegraded":"2024-05-10T09:58:15.248481+0000","last_fullsized":"2024-05-10T09:58:15.248481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531521+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:58:04.531521+0000","last_peered":"2024-05-10T09:58:04.531521+0000","last_clean":"2024-05-10T09:58:04.531521+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:04.531521+0000","last_undegraded":"2024-05-10T09:58:04.531521+0000","last_fullsized":"2024-05-10T09:58:04.531521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527816+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:58:04.527816+0000","last_peered":"2024-05-10T09:58:04.527816+0000","last_clean":"2024-05-10T09:58:04.527816+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:04.527816+0000","last_undegraded":"2024-05-10T09:58:04.527816+0000","last_fullsized":"2024-05-10T09:58:04.527816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527678+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:58:04.527678+0000","last_peered":"2024-05-10T09:58:04.527678+0000","last_clean":"2024-05-10T09:58:04.527678+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:04.527678+0000","last_undegraded":"2024-05-10T09:58:04.527678+0000","last_fullsized":"2024-05-10T09:58:04.527678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647640+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:58:04.647640+0000","last_peered":"2024-05-10T09:58:04.647640+0000","last_clean":"2024-05-10T09:58:04.647640+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:04.647640+0000","last_undegraded":"2024-05-10T09:58:04.647640+0000","last_fullsized":"2024-05-10T09:58:04.647640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528907+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:58:04.528907+0000","last_peered":"2024-05-10T09:58:04.528907+0000","last_clean":"2024-05-10T09:58:04.528907+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:04.528907+0000","last_undegraded":"2024-05-10T09:58:04.528907+0000","last_fullsized":"2024-05-10T09:58:04.528907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":99,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529276+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:58:04.529276+0000","last_peered":"2024-05-10T09:58:04.529276+0000","last_clean":"2024-05-10T09:58:04.529276+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:04.529276+0000","last_undegraded":"2024-05-10T09:58:04.529276+0000","last_fullsized":"2024-05-10T09:58:04.529276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908200+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:58:08.908200+0000","last_peered":"2024-05-10T09:58:08.908200+0000","last_clean":"2024-05-10T09:58:08.908200+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:08.908200+0000","last_undegraded":"2024-05-10T09:58:08.908200+0000","last_fullsized":"2024-05-10T09:58:08.908200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651782+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:58:04.651782+0000","last_peered":"2024-05-10T09:58:04.651782+0000","last_clean":"2024-05-10T09:58:04.651782+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:04.651782+0000","last_undegraded":"2024-05-10T09:58:04.651782+0000","last_fullsized":"2024-05-10T09:58:04.651782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529167+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:58:04.529167+0000","last_peered":"2024-05-10T09:58:04.529167+0000","last_clean":"2024-05-10T09:58:04.529167+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:04.529167+0000","last_undegraded":"2024-05-10T09:58:04.529167+0000","last_fullsized":"2024-05-10T09:58:04.529167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652922+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:58:04.652922+0000","last_peered":"2024-05-10T09:58:04.652922+0000","last_clean":"2024-05-10T09:58:04.652922+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:04.652922+0000","last_undegraded":"2024-05-10T09:58:04.652922+0000","last_fullsized":"2024-05-10T09:58:04.652922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":41,"num_read_kb":59422,"num_write":71,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656494+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:58:04.656494+0000","last_peered":"2024-05-10T09:58:04.656494+0000","last_clean":"2024-05-10T09:58:04.656494+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:04.656494+0000","last_undegraded":"2024-05-10T09:58:04.656494+0000","last_fullsized":"2024-05-10T09:58:04.656494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527204+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:58:04.527204+0000","last_peered":"2024-05-10T09:58:04.527204+0000","last_clean":"2024-05-10T09:58:04.527204+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:04.527204+0000","last_undegraded":"2024-05-10T09:58:04.527204+0000","last_fullsized":"2024-05-10T09:58:04.527204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"89'35","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653416+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:58:04.653416+0000","last_peered":"2024-05-10T09:58:04.653416+0000","last_clean":"2024-05-10T09:58:04.653416+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:04.653416+0000","last_undegraded":"2024-05-10T09:58:04.653416+0000","last_fullsized":"2024-05-10T09:58:04.653416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17853,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":59,"num_read_kb":66,"num_write":42,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528099+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:58:04.528099+0000","last_peered":"2024-05-10T09:58:04.528099+0000","last_clean":"2024-05-10T09:58:04.528099+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:04.528099+0000","last_undegraded":"2024-05-10T09:58:04.528099+0000","last_fullsized":"2024-05-10T09:58:04.528099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650656+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:58:04.650656+0000","last_peered":"2024-05-10T09:58:04.650656+0000","last_clean":"2024-05-10T09:58:04.650656+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:04.650656+0000","last_undegraded":"2024-05-10T09:58:04.650656+0000","last_fullsized":"2024-05-10T09:58:04.650656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652973+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:58:04.652973+0000","last_peered":"2024-05-10T09:58:04.652973+0000","last_clean":"2024-05-10T09:58:04.652973+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:04.652973+0000","last_undegraded":"2024-05-10T09:58:04.652973+0000","last_fullsized":"2024-05-10T09:58:04.652973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529250+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:58:04.529250+0000","last_peered":"2024-05-10T09:58:04.529250+0000","last_clean":"2024-05-10T09:58:04.529250+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:04.529250+0000","last_undegraded":"2024-05-10T09:58:04.529250+0000","last_fullsized":"2024-05-10T09:58:04.529250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"79'7","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528880+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:58:04.528880+0000","last_peered":"2024-05-10T09:58:04.528880+0000","last_clean":"2024-05-10T09:58:04.528880+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:04.528880+0000","last_undegraded":"2024-05-10T09:58:04.528880+0000","last_fullsized":"2024-05-10T09:58:04.528880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647012+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:58:04.647012+0000","last_peered":"2024-05-10T09:58:04.647012+0000","last_clean":"2024-05-10T09:58:04.647012+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:04.647012+0000","last_undegraded":"2024-05-10T09:58:04.647012+0000","last_fullsized":"2024-05-10T09:58:04.647012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"89'17","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527493+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:58:04.527493+0000","last_peered":"2024-05-10T09:58:04.527493+0000","last_clean":"2024-05-10T09:58:04.527493+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:04.527493+0000","last_undegraded":"2024-05-10T09:58:04.527493+0000","last_fullsized":"2024-05-10T09:58:04.527493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526191+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:58:04.526191+0000","last_peered":"2024-05-10T09:58:04.526191+0000","last_clean":"2024-05-10T09:58:04.526191+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:04.526191+0000","last_undegraded":"2024-05-10T09:58:04.526191+0000","last_fullsized":"2024-05-10T09:58:04.526191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527534+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:58:04.527534+0000","last_peered":"2024-05-10T09:58:04.527534+0000","last_clean":"2024-05-10T09:58:04.527534+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:04.527534+0000","last_undegraded":"2024-05-10T09:58:04.527534+0000","last_fullsized":"2024-05-10T09:58:04.527534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646813+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:58:04.646813+0000","last_peered":"2024-05-10T09:58:04.646813+0000","last_clean":"2024-05-10T09:58:04.646813+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:04.646813+0000","last_undegraded":"2024-05-10T09:58:04.646813+0000","last_fullsized":"2024-05-10T09:58:04.646813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656190+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:58:04.656190+0000","last_peered":"2024-05-10T09:58:04.656190+0000","last_clean":"2024-05-10T09:58:04.656190+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:04.656190+0000","last_undegraded":"2024-05-10T09:58:04.656190+0000","last_fullsized":"2024-05-10T09:58:04.656190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":30738,"num_write":42,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530067+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:58:04.530067+0000","last_peered":"2024-05-10T09:58:04.530067+0000","last_clean":"2024-05-10T09:58:04.530067+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:04.530067+0000","last_undegraded":"2024-05-10T09:58:04.530067+0000","last_fullsized":"2024-05-10T09:58:04.530067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646603+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:58:04.646603+0000","last_peered":"2024-05-10T09:58:04.646603+0000","last_clean":"2024-05-10T09:58:04.646603+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:04.646603+0000","last_undegraded":"2024-05-10T09:58:04.646603+0000","last_fullsized":"2024-05-10T09:58:04.646603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651652+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:58:04.651652+0000","last_peered":"2024-05-10T09:58:04.651652+0000","last_clean":"2024-05-10T09:58:04.651652+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:04.651652+0000","last_undegraded":"2024-05-10T09:58:04.651652+0000","last_fullsized":"2024-05-10T09:58:04.651652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651848+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:58:04.651848+0000","last_peered":"2024-05-10T09:58:04.651848+0000","last_clean":"2024-05-10T09:58:04.651848+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:04.651848+0000","last_undegraded":"2024-05-10T09:58:04.651848+0000","last_fullsized":"2024-05-10T09:58:04.651848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530746+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:58:04.530746+0000","last_peered":"2024-05-10T09:58:04.530746+0000","last_clean":"2024-05-10T09:58:04.530746+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:04.530746+0000","last_undegraded":"2024-05-10T09:58:04.530746+0000","last_fullsized":"2024-05-10T09:58:04.530746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'9","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657229+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:58:04.657229+0000","last_peered":"2024-05-10T09:58:04.657229+0000","last_clean":"2024-05-10T09:58:04.657229+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:04.657229+0000","last_undegraded":"2024-05-10T09:58:04.657229+0000","last_fullsized":"2024-05-10T09:58:04.657229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649736+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:58:04.649736+0000","last_peered":"2024-05-10T09:58:04.649736+0000","last_clean":"2024-05-10T09:58:04.649736+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:04.649736+0000","last_undegraded":"2024-05-10T09:58:04.649736+0000","last_fullsized":"2024-05-10T09:58:04.649736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"89'18","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529286+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:58:04.529286+0000","last_peered":"2024-05-10T09:58:04.529286+0000","last_clean":"2024-05-10T09:58:04.529286+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:04.529286+0000","last_undegraded":"2024-05-10T09:58:04.529286+0000","last_fullsized":"2024-05-10T09:58:04.529286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654262+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:58:04.654262+0000","last_peered":"2024-05-10T09:58:04.654262+0000","last_clean":"2024-05-10T09:58:04.654262+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:04.654262+0000","last_undegraded":"2024-05-10T09:58:04.654262+0000","last_fullsized":"2024-05-10T09:58:04.654262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653292+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:58:04.653292+0000","last_peered":"2024-05-10T09:58:04.653292+0000","last_clean":"2024-05-10T09:58:04.653292+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:04.653292+0000","last_undegraded":"2024-05-10T09:58:04.653292+0000","last_fullsized":"2024-05-10T09:58:04.653292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528375+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:58:04.528375+0000","last_peered":"2024-05-10T09:58:04.528375+0000","last_clean":"2024-05-10T09:58:04.528375+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:04.528375+0000","last_undegraded":"2024-05-10T09:58:04.528375+0000","last_fullsized":"2024-05-10T09:58:04.528375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653595+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:58:04.653595+0000","last_peered":"2024-05-10T09:58:04.653595+0000","last_clean":"2024-05-10T09:58:04.653595+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:04.653595+0000","last_undegraded":"2024-05-10T09:58:04.653595+0000","last_fullsized":"2024-05-10T09:58:04.653595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40978,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654529+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:58:04.654529+0000","last_peered":"2024-05-10T09:58:04.654529+0000","last_clean":"2024-05-10T09:58:04.654529+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:04.654529+0000","last_undegraded":"2024-05-10T09:58:04.654529+0000","last_fullsized":"2024-05-10T09:58:04.654529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"89'15","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653237+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:58:04.653237+0000","last_peered":"2024-05-10T09:58:04.653237+0000","last_clean":"2024-05-10T09:58:04.653237+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:04.653237+0000","last_undegraded":"2024-05-10T09:58:04.653237+0000","last_fullsized":"2024-05-10T09:58:04.653237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648770+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:58:04.648770+0000","last_peered":"2024-05-10T09:58:04.648770+0000","last_clean":"2024-05-10T09:58:04.648770+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:04.648770+0000","last_undegraded":"2024-05-10T09:58:04.648770+0000","last_fullsized":"2024-05-10T09:58:04.648770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656182+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:58:04.656182+0000","last_peered":"2024-05-10T09:58:04.656182+0000","last_clean":"2024-05-10T09:58:04.656182+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:04.656182+0000","last_undegraded":"2024-05-10T09:58:04.656182+0000","last_fullsized":"2024-05-10T09:58:04.656182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529228+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:58:04.529228+0000","last_peered":"2024-05-10T09:58:04.529228+0000","last_clean":"2024-05-10T09:58:04.529228+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:04.529228+0000","last_undegraded":"2024-05-10T09:58:04.529228+0000","last_fullsized":"2024-05-10T09:58:04.529228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":27,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652635+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:58:04.652635+0000","last_peered":"2024-05-10T09:58:04.652635+0000","last_clean":"2024-05-10T09:58:04.652635+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:04.652635+0000","last_undegraded":"2024-05-10T09:58:04.652635+0000","last_fullsized":"2024-05-10T09:58:04.652635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"89'21","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647027+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:58:04.647027+0000","last_peered":"2024-05-10T09:58:04.647027+0000","last_clean":"2024-05-10T09:58:04.647027+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:04.647027+0000","last_undegraded":"2024-05-10T09:58:04.647027+0000","last_fullsized":"2024-05-10T09:58:04.647027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10974,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":24,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653816+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:58:04.653816+0000","last_peered":"2024-05-10T09:58:04.653816+0000","last_clean":"2024-05-10T09:58:04.653816+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:04.653816+0000","last_undegraded":"2024-05-10T09:58:04.653816+0000","last_fullsized":"2024-05-10T09:58:04.653816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528651+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:58:04.528651+0000","last_peered":"2024-05-10T09:58:04.528651+0000","last_clean":"2024-05-10T09:58:04.528651+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:04.528651+0000","last_undegraded":"2024-05-10T09:58:04.528651+0000","last_fullsized":"2024-05-10T09:58:04.528651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652727+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:58:04.652727+0000","last_peered":"2024-05-10T09:58:04.652727+0000","last_clean":"2024-05-10T09:58:04.652727+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:04.652727+0000","last_undegraded":"2024-05-10T09:58:04.652727+0000","last_fullsized":"2024-05-10T09:58:04.652727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646498+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:58:04.646498+0000","last_peered":"2024-05-10T09:58:04.646498+0000","last_clean":"2024-05-10T09:58:04.646498+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:04.646498+0000","last_undegraded":"2024-05-10T09:58:04.646498+0000","last_fullsized":"2024-05-10T09:58:04.646498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":30726,"num_write":21,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.202744+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:58:15.202744+0000","last_peered":"2024-05-10T09:58:15.202744+0000","last_clean":"2024-05-10T09:58:15.202744+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:15.202744+0000","last_undegraded":"2024-05-10T09:58:15.202744+0000","last_fullsized":"2024-05-10T09:58:15.202744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"89'21","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653505+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:58:04.653505+0000","last_peered":"2024-05-10T09:58:04.653505+0000","last_clean":"2024-05-10T09:58:04.653505+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:04.653505+0000","last_undegraded":"2024-05-10T09:58:04.653505+0000","last_fullsized":"2024-05-10T09:58:04.653505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647328+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:58:04.647328+0000","last_peered":"2024-05-10T09:58:04.647328+0000","last_clean":"2024-05-10T09:58:04.647328+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:04.647328+0000","last_undegraded":"2024-05-10T09:58:04.647328+0000","last_fullsized":"2024-05-10T09:58:04.647328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652826+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:58:04.652826+0000","last_peered":"2024-05-10T09:58:04.652826+0000","last_clean":"2024-05-10T09:58:04.652826+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:04.652826+0000","last_undegraded":"2024-05-10T09:58:04.652826+0000","last_fullsized":"2024-05-10T09:58:04.652826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528292+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:58:04.528292+0000","last_peered":"2024-05-10T09:58:04.528292+0000","last_clean":"2024-05-10T09:58:04.528292+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:04.528292+0000","last_undegraded":"2024-05-10T09:58:04.528292+0000","last_fullsized":"2024-05-10T09:58:04.528292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528195+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:58:04.528195+0000","last_peered":"2024-05-10T09:58:04.528195+0000","last_clean":"2024-05-10T09:58:04.528195+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:04.528195+0000","last_undegraded":"2024-05-10T09:58:04.528195+0000","last_fullsized":"2024-05-10T09:58:04.528195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529014+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:58:04.529014+0000","last_peered":"2024-05-10T09:58:04.529014+0000","last_clean":"2024-05-10T09:58:04.529014+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:04.529014+0000","last_undegraded":"2024-05-10T09:58:04.529014+0000","last_fullsized":"2024-05-10T09:58:04.529014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"89'16","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531919+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:58:04.531919+0000","last_peered":"2024-05-10T09:58:04.531919+0000","last_clean":"2024-05-10T09:58:04.531919+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:04.531919+0000","last_undegraded":"2024-05-10T09:58:04.531919+0000","last_fullsized":"2024-05-10T09:58:04.531919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647189+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:58:04.647189+0000","last_peered":"2024-05-10T09:58:04.647189+0000","last_clean":"2024-05-10T09:58:04.647189+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:04.647189+0000","last_undegraded":"2024-05-10T09:58:04.647189+0000","last_fullsized":"2024-05-10T09:58:04.647189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650463+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:58:04.650463+0000","last_peered":"2024-05-10T09:58:04.650463+0000","last_clean":"2024-05-10T09:58:04.650463+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:04.650463+0000","last_undegraded":"2024-05-10T09:58:04.650463+0000","last_fullsized":"2024-05-10T09:58:04.650463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526549+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:58:04.526549+0000","last_peered":"2024-05-10T09:58:04.526549+0000","last_clean":"2024-05-10T09:58:04.526549+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:04.526549+0000","last_undegraded":"2024-05-10T09:58:04.526549+0000","last_fullsized":"2024-05-10T09:58:04.526549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"79'11","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649007+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:58:04.649007+0000","last_peered":"2024-05-10T09:58:04.649007+0000","last_clean":"2024-05-10T09:58:04.649007+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:04.649007+0000","last_undegraded":"2024-05-10T09:58:04.649007+0000","last_fullsized":"2024-05-10T09:58:04.649007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:36.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647618+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:58:04.647618+0000","last_peered":"2024-05-10T09:58:04.647618+0000","last_clean":"2024-05-10T09:58:04.647618+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:04.647618+0000","last_undegraded":"2024-05-10T09:58:04.647618+0000","last_fullsized":"2024-05-10T09:58:04.647618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":103,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530384+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:58:04.530384+0000","last_peered":"2024-05-10T09:58:04.530384+0000","last_clean":"2024-05-10T09:58:04.530384+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:04.530384+0000","last_undegraded":"2024-05-10T09:58:04.530384+0000","last_fullsized":"2024-05-10T09:58:04.530384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'17","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910719+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:58:08.910719+0000","last_peered":"2024-05-10T09:58:08.910719+0000","last_clean":"2024-05-10T09:58:08.910719+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:08.910719+0000","last_undegraded":"2024-05-10T09:58:08.910719+0000","last_fullsized":"2024-05-10T09:58:08.910719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649718+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:58:04.649718+0000","last_peered":"2024-05-10T09:58:04.649718+0000","last_clean":"2024-05-10T09:58:04.649718+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:04.649718+0000","last_undegraded":"2024-05-10T09:58:04.649718+0000","last_fullsized":"2024-05-10T09:58:04.649718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":131,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646678+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:58:04.646678+0000","last_peered":"2024-05-10T09:58:04.646678+0000","last_clean":"2024-05-10T09:58:04.646678+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:04.646678+0000","last_undegraded":"2024-05-10T09:58:04.646678+0000","last_fullsized":"2024-05-10T09:58:04.646678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654431+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:58:04.654431+0000","last_peered":"2024-05-10T09:58:04.654431+0000","last_clean":"2024-05-10T09:58:04.654431+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:04.654431+0000","last_undegraded":"2024-05-10T09:58:04.654431+0000","last_fullsized":"2024-05-10T09:58:04.654431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18450,"num_write":39,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653243+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:58:04.653243+0000","last_peered":"2024-05-10T09:58:04.653243+0000","last_clean":"2024-05-10T09:58:04.653243+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:04.653243+0000","last_undegraded":"2024-05-10T09:58:04.653243+0000","last_fullsized":"2024-05-10T09:58:04.653243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"89'19","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653251+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:58:04.653251+0000","last_peered":"2024-05-10T09:58:04.653251+0000","last_clean":"2024-05-10T09:58:04.653251+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:04.653251+0000","last_undegraded":"2024-05-10T09:58:04.653251+0000","last_fullsized":"2024-05-10T09:58:04.653251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646293+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:58:04.646293+0000","last_peered":"2024-05-10T09:58:04.646293+0000","last_clean":"2024-05-10T09:58:04.646293+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:04.646293+0000","last_undegraded":"2024-05-10T09:58:04.646293+0000","last_fullsized":"2024-05-10T09:58:04.646293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658184+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:58:04.658184+0000","last_peered":"2024-05-10T09:58:04.658184+0000","last_clean":"2024-05-10T09:58:04.658184+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:04.658184+0000","last_undegraded":"2024-05-10T09:58:04.658184+0000","last_fullsized":"2024-05-10T09:58:04.658184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529018+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:58:04.529018+0000","last_peered":"2024-05-10T09:58:04.529018+0000","last_clean":"2024-05-10T09:58:04.529018+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:04.529018+0000","last_undegraded":"2024-05-10T09:58:04.529018+0000","last_fullsized":"2024-05-10T09:58:04.529018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657322+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:58:04.657322+0000","last_peered":"2024-05-10T09:58:04.657322+0000","last_clean":"2024-05-10T09:58:04.657322+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:04.657322+0000","last_undegraded":"2024-05-10T09:58:04.657322+0000","last_fullsized":"2024-05-10T09:58:04.657322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650809+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:58:04.650809+0000","last_peered":"2024-05-10T09:58:04.650809+0000","last_clean":"2024-05-10T09:58:04.650809+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:04.650809+0000","last_undegraded":"2024-05-10T09:58:04.650809+0000","last_fullsized":"2024-05-10T09:58:04.650809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646411+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:58:04.646411+0000","last_peered":"2024-05-10T09:58:04.646411+0000","last_clean":"2024-05-10T09:58:04.646411+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:04.646411+0000","last_undegraded":"2024-05-10T09:58:04.646411+0000","last_fullsized":"2024-05-10T09:58:04.646411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652426+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:58:04.652426+0000","last_peered":"2024-05-10T09:58:04.652426+0000","last_clean":"2024-05-10T09:58:04.652426+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:04.652426+0000","last_undegraded":"2024-05-10T09:58:04.652426+0000","last_fullsized":"2024-05-10T09:58:04.652426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527768+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:58:04.527768+0000","last_peered":"2024-05-10T09:58:04.527768+0000","last_clean":"2024-05-10T09:58:04.527768+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:04.527768+0000","last_undegraded":"2024-05-10T09:58:04.527768+0000","last_fullsized":"2024-05-10T09:58:04.527768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531028+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:58:04.531028+0000","last_peered":"2024-05-10T09:58:04.531028+0000","last_clean":"2024-05-10T09:58:04.531028+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:04.531028+0000","last_undegraded":"2024-05-10T09:58:04.531028+0000","last_fullsized":"2024-05-10T09:58:04.531028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528950+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:58:04.528950+0000","last_peered":"2024-05-10T09:58:04.528950+0000","last_clean":"2024-05-10T09:58:04.528950+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:04.528950+0000","last_undegraded":"2024-05-10T09:58:04.528950+0000","last_fullsized":"2024-05-10T09:58:04.528950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527959+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:58:04.527959+0000","last_peered":"2024-05-10T09:58:04.527959+0000","last_clean":"2024-05-10T09:58:04.527959+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:04.527959+0000","last_undegraded":"2024-05-10T09:58:04.527959+0000","last_fullsized":"2024-05-10T09:58:04.527959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"89'8","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531553+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:58:04.531553+0000","last_peered":"2024-05-10T09:58:04.531553+0000","last_clean":"2024-05-10T09:58:04.531553+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:04.531553+0000","last_undegraded":"2024-05-10T09:58:04.531553+0000","last_fullsized":"2024-05-10T09:58:04.531553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529836+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:58:04.529836+0000","last_peered":"2024-05-10T09:58:04.529836+0000","last_clean":"2024-05-10T09:58:04.529836+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:04.529836+0000","last_undegraded":"2024-05-10T09:58:04.529836+0000","last_fullsized":"2024-05-10T09:58:04.529836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655255+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:58:04.655255+0000","last_peered":"2024-05-10T09:58:04.655255+0000","last_clean":"2024-05-10T09:58:04.655255+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:04.655255+0000","last_undegraded":"2024-05-10T09:58:04.655255+0000","last_fullsized":"2024-05-10T09:58:04.655255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527607+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:58:04.527607+0000","last_peered":"2024-05-10T09:58:04.527607+0000","last_clean":"2024-05-10T09:58:04.527607+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:04.527607+0000","last_undegraded":"2024-05-10T09:58:04.527607+0000","last_fullsized":"2024-05-10T09:58:04.527607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653419+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:58:04.653419+0000","last_peered":"2024-05-10T09:58:04.653419+0000","last_clean":"2024-05-10T09:58:04.653419+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:04.653419+0000","last_undegraded":"2024-05-10T09:58:04.653419+0000","last_fullsized":"2024-05-10T09:58:04.653419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645798+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:58:04.645798+0000","last_peered":"2024-05-10T09:58:04.645798+0000","last_clean":"2024-05-10T09:58:04.645798+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:04.645798+0000","last_undegraded":"2024-05-10T09:58:04.645798+0000","last_fullsized":"2024-05-10T09:58:04.645798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"89'14","reported_seq":107,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528957+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:58:04.528957+0000","last_peered":"2024-05-10T09:58:04.528957+0000","last_clean":"2024-05-10T09:58:04.528957+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:04.528957+0000","last_undegraded":"2024-05-10T09:58:04.528957+0000","last_fullsized":"2024-05-10T09:58:04.528957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648510+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:58:04.648510+0000","last_peered":"2024-05-10T09:58:04.648510+0000","last_clean":"2024-05-10T09:58:04.648510+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:04.648510+0000","last_undegraded":"2024-05-10T09:58:04.648510+0000","last_fullsized":"2024-05-10T09:58:04.648510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529237+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:58:04.529237+0000","last_peered":"2024-05-10T09:58:04.529237+0000","last_clean":"2024-05-10T09:58:04.529237+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:04.529237+0000","last_undegraded":"2024-05-10T09:58:04.529237+0000","last_fullsized":"2024-05-10T09:58:04.529237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647961+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:58:04.647961+0000","last_peered":"2024-05-10T09:58:04.647961+0000","last_clean":"2024-05-10T09:58:04.647961+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:04.647961+0000","last_undegraded":"2024-05-10T09:58:04.647961+0000","last_fullsized":"2024-05-10T09:58:04.647961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654410+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:58:04.654410+0000","last_peered":"2024-05-10T09:58:04.654410+0000","last_clean":"2024-05-10T09:58:04.654410+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:04.654410+0000","last_undegraded":"2024-05-10T09:58:04.654410+0000","last_fullsized":"2024-05-10T09:58:04.654410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647419+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:58:04.647419+0000","last_peered":"2024-05-10T09:58:04.647419+0000","last_clean":"2024-05-10T09:58:04.647419+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:04.647419+0000","last_undegraded":"2024-05-10T09:58:04.647419+0000","last_fullsized":"2024-05-10T09:58:04.647419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'14","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529372+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:58:04.529372+0000","last_peered":"2024-05-10T09:58:04.529372+0000","last_clean":"2024-05-10T09:58:04.529372+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:04.529372+0000","last_undegraded":"2024-05-10T09:58:04.529372+0000","last_fullsized":"2024-05-10T09:58:04.529372+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656340+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:58:04.656340+0000","last_peered":"2024-05-10T09:58:04.656340+0000","last_clean":"2024-05-10T09:58:04.656340+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:04.656340+0000","last_undegraded":"2024-05-10T09:58:04.656340+0000","last_fullsized":"2024-05-10T09:58:04.656340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"79'6","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652452+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:58:04.652452+0000","last_peered":"2024-05-10T09:58:04.652452+0000","last_clean":"2024-05-10T09:58:04.652452+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:04.652452+0000","last_undegraded":"2024-05-10T09:58:04.652452+0000","last_fullsized":"2024-05-10T09:58:04.652452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648308+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:58:04.648308+0000","last_peered":"2024-05-10T09:58:04.648308+0000","last_clean":"2024-05-10T09:58:04.648308+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:04.648308+0000","last_undegraded":"2024-05-10T09:58:04.648308+0000","last_fullsized":"2024-05-10T09:58:04.648308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649477+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:58:04.649477+0000","last_peered":"2024-05-10T09:58:04.649477+0000","last_clean":"2024-05-10T09:58:04.649477+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:04.649477+0000","last_undegraded":"2024-05-10T09:58:04.649477+0000","last_fullsized":"2024-05-10T09:58:04.649477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":29,"num_read_kb":71692,"num_write":41,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530949+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:58:04.530949+0000","last_peered":"2024-05-10T09:58:04.530949+0000","last_clean":"2024-05-10T09:58:04.530949+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:04.530949+0000","last_undegraded":"2024-05-10T09:58:04.530949+0000","last_fullsized":"2024-05-10T09:58:04.530949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'5","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531779+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:58:04.531779+0000","last_peered":"2024-05-10T09:58:04.531779+0000","last_clean":"2024-05-10T09:58:04.531779+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:58:04.531779+0000","last_undegraded":"2024-05-10T09:58:04.531779+0000","last_fullsized":"2024-05-10T09:58:04.531779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528181+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:58:04.528181+0000","last_peered":"2024-05-10T09:58:04.528181+0000","last_clean":"2024-05-10T09:58:04.528181+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:04.528181+0000","last_undegraded":"2024-05-10T09:58:04.528181+0000","last_fullsized":"2024-05-10T09:58:04.528181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"79'8","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648027+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:58:04.648027+0000","last_peered":"2024-05-10T09:58:04.648027+0000","last_clean":"2024-05-10T09:58:04.648027+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:04.648027+0000","last_undegraded":"2024-05-10T09:58:04.648027+0000","last_fullsized":"2024-05-10T09:58:04.648027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":145,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528710+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:58:04.528710+0000","last_peered":"2024-05-10T09:58:04.528710+0000","last_clean":"2024-05-10T09:58:04.528710+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:04.528710+0000","last_undegraded":"2024-05-10T09:58:04.528710+0000","last_fullsized":"2024-05-10T09:58:04.528710+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660880+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:58:04.660880+0000","last_peered":"2024-05-10T09:58:04.660880+0000","last_clean":"2024-05-10T09:58:04.660880+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:04.660880+0000","last_undegraded":"2024-05-10T09:58:04.660880+0000","last_fullsized":"2024-05-10T09:58:04.660880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651663+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:58:04.651663+0000","last_peered":"2024-05-10T09:58:04.651663+0000","last_clean":"2024-05-10T09:58:04.651663+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:04.651663+0000","last_undegraded":"2024-05-10T09:58:04.651663+0000","last_fullsized":"2024-05-10T09:58:04.651663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'11","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531405+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:58:04.531405+0000","last_peered":"2024-05-10T09:58:04.531405+0000","last_clean":"2024-05-10T09:58:04.531405+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:04.531405+0000","last_undegraded":"2024-05-10T09:58:04.531405+0000","last_fullsized":"2024-05-10T09:58:04.531405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36870,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653362+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:58:04.653362+0000","last_peered":"2024-05-10T09:58:04.653362+0000","last_clean":"2024-05-10T09:58:04.653362+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:04.653362+0000","last_undegraded":"2024-05-10T09:58:04.653362+0000","last_fullsized":"2024-05-10T09:58:04.653362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651637+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:58:04.651637+0000","last_peered":"2024-05-10T09:58:04.651637+0000","last_clean":"2024-05-10T09:58:04.651637+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:04.651637+0000","last_undegraded":"2024-05-10T09:58:04.651637+0000","last_fullsized":"2024-05-10T09:58:04.651637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":36870,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529866+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:58:04.529866+0000","last_peered":"2024-05-10T09:58:04.529866+0000","last_clean":"2024-05-10T09:58:04.529866+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:04.529866+0000","last_undegraded":"2024-05-10T09:58:04.529866+0000","last_fullsized":"2024-05-10T09:58:04.529866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'16","reported_seq":243,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531176+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:58:04.531176+0000","last_peered":"2024-05-10T09:58:04.531176+0000","last_clean":"2024-05-10T09:58:04.531176+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:58:04.531176+0000","last_undegraded":"2024-05-10T09:58:04.531176+0000","last_fullsized":"2024-05-10T09:58:04.531176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527324+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:58:04.527324+0000","last_peered":"2024-05-10T09:58:04.527324+0000","last_clean":"2024-05-10T09:58:04.527324+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:04.527324+0000","last_undegraded":"2024-05-10T09:58:04.527324+0000","last_fullsized":"2024-05-10T09:58:04.527324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652210+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:58:04.652210+0000","last_peered":"2024-05-10T09:58:04.652210+0000","last_clean":"2024-05-10T09:58:04.652210+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:04.652210+0000","last_undegraded":"2024-05-10T09:58:04.652210+0000","last_fullsized":"2024-05-10T09:58:04.652210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530261+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:58:04.530261+0000","last_peered":"2024-05-10T09:58:04.530261+0000","last_clean":"2024-05-10T09:58:04.530261+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:04.530261+0000","last_undegraded":"2024-05-10T09:58:04.530261+0000","last_fullsized":"2024-05-10T09:58:04.530261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650076+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:58:04.650076+0000","last_peered":"2024-05-10T09:58:04.650076+0000","last_clean":"2024-05-10T09:58:04.650076+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:04.650076+0000","last_undegraded":"2024-05-10T09:58:04.650076+0000","last_fullsized":"2024-05-10T09:58:04.650076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654023+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:58:04.654023+0000","last_peered":"2024-05-10T09:58:04.654023+0000","last_clean":"2024-05-10T09:58:04.654023+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:04.654023+0000","last_undegraded":"2024-05-10T09:58:04.654023+0000","last_fullsized":"2024-05-10T09:58:04.654023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'14","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655299+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:58:04.655299+0000","last_peered":"2024-05-10T09:58:04.655299+0000","last_clean":"2024-05-10T09:58:04.655299+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:04.655299+0000","last_undegraded":"2024-05-10T09:58:04.655299+0000","last_fullsized":"2024-05-10T09:58:04.655299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":23,"num_read_kb":36880,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649741+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:58:04.649741+0000","last_peered":"2024-05-10T09:58:04.649741+0000","last_clean":"2024-05-10T09:58:04.649741+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:04.649741+0000","last_undegraded":"2024-05-10T09:58:04.649741+0000","last_fullsized":"2024-05-10T09:58:04.649741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'13","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656883+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:58:04.656883+0000","last_peered":"2024-05-10T09:58:04.656883+0000","last_clean":"2024-05-10T09:58:04.656883+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:04.656883+0000","last_undegraded":"2024-05-10T09:58:04.656883+0000","last_fullsized":"2024-05-10T09:58:04.656883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":34834,"num_write":43,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530476+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:58:04.530476+0000","last_peered":"2024-05-10T09:58:04.530476+0000","last_clean":"2024-05-10T09:58:04.530476+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:04.530476+0000","last_undegraded":"2024-05-10T09:58:04.530476+0000","last_fullsized":"2024-05-10T09:58:04.530476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'9","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530270+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:58:04.530270+0000","last_peered":"2024-05-10T09:58:04.530270+0000","last_clean":"2024-05-10T09:58:04.530270+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:04.530270+0000","last_undegraded":"2024-05-10T09:58:04.530270+0000","last_fullsized":"2024-05-10T09:58:04.530270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650180+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:58:04.650180+0000","last_peered":"2024-05-10T09:58:04.650180+0000","last_clean":"2024-05-10T09:58:04.650180+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:04.650180+0000","last_undegraded":"2024-05-10T09:58:04.650180+0000","last_fullsized":"2024-05-10T09:58:04.650180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658360+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:58:04.658360+0000","last_peered":"2024-05-10T09:58:04.658360+0000","last_clean":"2024-05-10T09:58:04.658360+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:04.658360+0000","last_undegraded":"2024-05-10T09:58:04.658360+0000","last_fullsized":"2024-05-10T09:58:04.658360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":36882,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'8","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651346+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:58:04.651346+0000","last_peered":"2024-05-10T09:58:04.651346+0000","last_clean":"2024-05-10T09:58:04.651346+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:04.651346+0000","last_undegraded":"2024-05-10T09:58:04.651346+0000","last_fullsized":"2024-05-10T09:58:04.651346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653196+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:58:04.653196+0000","last_peered":"2024-05-10T09:58:04.653196+0000","last_clean":"2024-05-10T09:58:04.653196+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:04.653196+0000","last_undegraded":"2024-05-10T09:58:04.653196+0000","last_fullsized":"2024-05-10T09:58:04.653196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'9","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646387+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:58:04.646387+0000","last_peered":"2024-05-10T09:58:04.646387+0000","last_clean":"2024-05-10T09:58:04.646387+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:04.646387+0000","last_undegraded":"2024-05-10T09:58:04.646387+0000","last_fullsized":"2024-05-10T09:58:04.646387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657058+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:58:04.657058+0000","last_peered":"2024-05-10T09:58:04.657058+0000","last_clean":"2024-05-10T09:58:04.657058+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:04.657058+0000","last_undegraded":"2024-05-10T09:58:04.657058+0000","last_fullsized":"2024-05-10T09:58:04.657058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242916,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":922,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":230728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1082,"num_read_kb":2003600,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":452980,"kb_used_data":421804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93918860,"statfs":{"total":96636764160,"available":96172912640,"internally_reserved":0,"allocated":431927296,"data_stored":431305753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323332,"kb_used_data":292156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048508,"statfs":{"total":96636764160,"available":96305672192,"internally_reserved":0,"allocated":299167744,"data_stored":298578850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505668,"kb_used_data":474492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866172,"statfs":{"total":96636764160,"available":96118960128,"internally_reserved":0,"allocated":485879808,"data_stored":485241465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285583,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508200,"kb_used_data":476444,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":93863640,"statfs":{"total":96636764160,"available":96116367360,"internally_reserved":0,"allocated":487878656,"data_stored":487316023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538476,"kb_used_data":503140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93833364,"statfs":{"total":96636764160,"available":96085364736,"internally_reserved":0,"allocated":515215360,"data_stored":514612407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263972,"kb_used_data":228636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94107868,"statfs":{"total":96636764160,"available":96366456832,"internally_reserved":0,"allocated":234123264,"data_stored":233561927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555420,"kb_used_data":520076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93816420,"statfs":{"total":96636764160,"available":96068014080,"internally_reserved":0,"allocated":532557824,"data_stored":531963325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329620,"kb_used_data":290124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94042220,"statfs":{"total":96636764160,"available":96299233280,"internally_reserved":0,"allocated":297086976,"data_stored":296483812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":530579456,"data_stored":530579456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":295698432,"data_stored":295698432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":232783872,"data_stored":232783872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":513802240,"data_stored":513802240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":429916160,"data_stored":429916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":31596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":23865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":16540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":48698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":14205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":37700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":37756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:58:16.851 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T09:58:16.851 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:58:17.205 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:17.211 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:58:17.222 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-05-10T09:58:16.269400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613457,"num_objects":637,"num_object_clones":0,"num_object_copies":1274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":637,"num_whiteouts":0,"num_read":3811,"num_read_kb":2005890,"num_write":3270,"num_write_kb":2050294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1947,"ondisk_log_size":1947,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3477668,"kb_used_data":3206872,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":751497052,"statfs":{"total":773094113280,"available":769532981248,"internally_reserved":0,"allocated":3283836928,"data_stored":3279063562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.745101"},"pg_stats":[{"pgid":"3.3f","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657807+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:58:04.657807+0000","last_peered":"2024-05-10T09:58:04.657807+0000","last_clean":"2024-05-10T09:58:04.657807+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:04.657807+0000","last_undegraded":"2024-05-10T09:58:04.657807+0000","last_fullsized":"2024-05-10T09:58:04.657807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650396+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:58:04.650396+0000","last_peered":"2024-05-10T09:58:04.650396+0000","last_clean":"2024-05-10T09:58:04.650396+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:04.650396+0000","last_undegraded":"2024-05-10T09:58:04.650396+0000","last_fullsized":"2024-05-10T09:58:04.650396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"89'9","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647529+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:58:04.647529+0000","last_peered":"2024-05-10T09:58:04.647529+0000","last_clean":"2024-05-10T09:58:04.647529+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:04.647529+0000","last_undegraded":"2024-05-10T09:58:04.647529+0000","last_fullsized":"2024-05-10T09:58:04.647529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651881+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:58:04.651881+0000","last_peered":"2024-05-10T09:58:04.651881+0000","last_clean":"2024-05-10T09:58:04.651881+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:04.651881+0000","last_undegraded":"2024-05-10T09:58:04.651881+0000","last_fullsized":"2024-05-10T09:58:04.651881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652086+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:58:04.652086+0000","last_peered":"2024-05-10T09:58:04.652086+0000","last_clean":"2024-05-10T09:58:04.652086+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:04.652086+0000","last_undegraded":"2024-05-10T09:58:04.652086+0000","last_fullsized":"2024-05-10T09:58:04.652086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":28690,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"89'12","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654181+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:58:04.654181+0000","last_peered":"2024-05-10T09:58:04.654181+0000","last_clean":"2024-05-10T09:58:04.654181+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:04.654181+0000","last_undegraded":"2024-05-10T09:58:04.654181+0000","last_fullsized":"2024-05-10T09:58:04.654181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32792,"num_write":52,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649254+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:58:04.649254+0000","last_peered":"2024-05-10T09:58:04.649254+0000","last_clean":"2024-05-10T09:58:04.649254+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:04.649254+0000","last_undegraded":"2024-05-10T09:58:04.649254+0000","last_fullsized":"2024-05-10T09:58:04.649254+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"89'16","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654430+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:58:04.654430+0000","last_peered":"2024-05-10T09:58:04.654430+0000","last_clean":"2024-05-10T09:58:04.654430+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:04.654430+0000","last_undegraded":"2024-05-10T09:58:04.654430+0000","last_fullsized":"2024-05-10T09:58:04.654430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":43032,"num_write":56,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655633+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:58:04.655633+0000","last_peered":"2024-05-10T09:58:04.655633+0000","last_clean":"2024-05-10T09:58:04.655633+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:04.655633+0000","last_undegraded":"2024-05-10T09:58:04.655633+0000","last_fullsized":"2024-05-10T09:58:04.655633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"89'11","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651688+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:58:04.651688+0000","last_peered":"2024-05-10T09:58:04.651688+0000","last_clean":"2024-05-10T09:58:04.651688+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:04.651688+0000","last_undegraded":"2024-05-10T09:58:04.651688+0000","last_fullsized":"2024-05-10T09:58:04.651688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":36876,"num_write":31,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529657+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:58:04.529657+0000","last_peered":"2024-05-10T09:58:04.529657+0000","last_clean":"2024-05-10T09:58:04.529657+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:04.529657+0000","last_undegraded":"2024-05-10T09:58:04.529657+0000","last_fullsized":"2024-05-10T09:58:04.529657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"89'6","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528952+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:58:04.528952+0000","last_peered":"2024-05-10T09:58:04.528952+0000","last_clean":"2024-05-10T09:58:04.528952+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:04.528952+0000","last_undegraded":"2024-05-10T09:58:04.528952+0000","last_fullsized":"2024-05-10T09:58:04.528952+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:49.424545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656752+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:58:04.656752+0000","last_peered":"2024-05-10T09:58:04.656752+0000","last_clean":"2024-05-10T09:58:04.656752+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:04.656752+0000","last_undegraded":"2024-05-10T09:58:04.656752+0000","last_fullsized":"2024-05-10T09:58:04.656752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"78'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528643+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:58:04.528643+0000","last_peered":"2024-05-10T09:58:04.528643+0000","last_clean":"2024-05-10T09:58:04.528643+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:04.528643+0000","last_undegraded":"2024-05-10T09:58:04.528643+0000","last_fullsized":"2024-05-10T09:58:04.528643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528564+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:58:04.528564+0000","last_peered":"2024-05-10T09:58:04.528564+0000","last_clean":"2024-05-10T09:58:04.528564+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:04.528564+0000","last_undegraded":"2024-05-10T09:58:04.528564+0000","last_fullsized":"2024-05-10T09:58:04.528564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:43.806629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527703+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:58:04.527703+0000","last_peered":"2024-05-10T09:58:04.527703+0000","last_clean":"2024-05-10T09:58:04.527703+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:04.527703+0000","last_undegraded":"2024-05-10T09:58:04.527703+0000","last_fullsized":"2024-05-10T09:58:04.527703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"89'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657912+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:58:04.657912+0000","last_peered":"2024-05-10T09:58:04.657912+0000","last_clean":"2024-05-10T09:58:04.657912+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:04.657912+0000","last_undegraded":"2024-05-10T09:58:04.657912+0000","last_fullsized":"2024-05-10T09:58:04.657912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652120+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:58:04.652120+0000","last_peered":"2024-05-10T09:58:04.652120+0000","last_clean":"2024-05-10T09:58:04.652120+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:04.652120+0000","last_undegraded":"2024-05-10T09:58:04.652120+0000","last_fullsized":"2024-05-10T09:58:04.652120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'7","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652595+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:58:04.652595+0000","last_peered":"2024-05-10T09:58:04.652595+0000","last_clean":"2024-05-10T09:58:04.652595+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:04.652595+0000","last_undegraded":"2024-05-10T09:58:04.652595+0000","last_fullsized":"2024-05-10T09:58:04.652595+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651965+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:58:04.651965+0000","last_peered":"2024-05-10T09:58:04.651965+0000","last_clean":"2024-05-10T09:58:04.651965+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:04.651965+0000","last_undegraded":"2024-05-10T09:58:04.651965+0000","last_fullsized":"2024-05-10T09:58:04.651965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"79'5","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657131+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:58:04.657131+0000","last_peered":"2024-05-10T09:58:04.657131+0000","last_clean":"2024-05-10T09:58:04.657131+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:04.657131+0000","last_undegraded":"2024-05-10T09:58:04.657131+0000","last_fullsized":"2024-05-10T09:58:04.657131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527325+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:58:04.527325+0000","last_peered":"2024-05-10T09:58:04.527325+0000","last_clean":"2024-05-10T09:58:04.527325+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:04.527325+0000","last_undegraded":"2024-05-10T09:58:04.527325+0000","last_fullsized":"2024-05-10T09:58:04.527325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:12:48.393198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"89'19","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529749+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:58:04.529749+0000","last_peered":"2024-05-10T09:58:04.529749+0000","last_clean":"2024-05-10T09:58:04.529749+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:04.529749+0000","last_undegraded":"2024-05-10T09:58:04.529749+0000","last_fullsized":"2024-05-10T09:58:04.529749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":25,"num_read_kb":61452,"num_write":39,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":231,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526267+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:58:04.526267+0000","last_peered":"2024-05-10T09:58:04.526267+0000","last_clean":"2024-05-10T09:58:04.526267+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:04.526267+0000","last_undegraded":"2024-05-10T09:58:04.526267+0000","last_fullsized":"2024-05-10T09:58:04.526267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:28.344402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529605+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:58:04.529605+0000","last_peered":"2024-05-10T09:58:04.529605+0000","last_clean":"2024-05-10T09:58:04.529605+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:04.529605+0000","last_undegraded":"2024-05-10T09:58:04.529605+0000","last_fullsized":"2024-05-10T09:58:04.529605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16396,"num_write":26,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529511+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:58:04.529511+0000","last_peered":"2024-05-10T09:58:04.529511+0000","last_clean":"2024-05-10T09:58:04.529511+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:04.529511+0000","last_undegraded":"2024-05-10T09:58:04.529511+0000","last_fullsized":"2024-05-10T09:58:04.529511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"79'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650655+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:58:04.650655+0000","last_peered":"2024-05-10T09:58:04.650655+0000","last_clean":"2024-05-10T09:58:04.650655+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:04.650655+0000","last_undegraded":"2024-05-10T09:58:04.650655+0000","last_fullsized":"2024-05-10T09:58:04.650655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":30720,"num_write":9,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528133+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:58:04.528133+0000","last_peered":"2024-05-10T09:58:04.528133+0000","last_clean":"2024-05-10T09:58:04.528133+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:04.528133+0000","last_undegraded":"2024-05-10T09:58:04.528133+0000","last_fullsized":"2024-05-10T09:58:04.528133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530920+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:58:04.530920+0000","last_peered":"2024-05-10T09:58:04.530920+0000","last_clean":"2024-05-10T09:58:04.530920+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:04.530920+0000","last_undegraded":"2024-05-10T09:58:04.530920+0000","last_fullsized":"2024-05-10T09:58:04.530920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"89'10","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654850+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:58:04.654850+0000","last_peered":"2024-05-10T09:58:04.654850+0000","last_clean":"2024-05-10T09:58:04.654850+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:04.654850+0000","last_undegraded":"2024-05-10T09:58:04.654850+0000","last_fullsized":"2024-05-10T09:58:04.654850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":18442,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655953+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:58:04.655953+0000","last_peered":"2024-05-10T09:58:04.655953+0000","last_clean":"2024-05-10T09:58:04.655953+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:04.655953+0000","last_undegraded":"2024-05-10T09:58:04.655953+0000","last_fullsized":"2024-05-10T09:58:04.655953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652475+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:58:04.652475+0000","last_peered":"2024-05-10T09:58:04.652475+0000","last_clean":"2024-05-10T09:58:04.652475+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:04.652475+0000","last_undegraded":"2024-05-10T09:58:04.652475+0000","last_fullsized":"2024-05-10T09:58:04.652475+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655116+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:58:04.655116+0000","last_peered":"2024-05-10T09:58:04.655116+0000","last_clean":"2024-05-10T09:58:04.655116+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:04.655116+0000","last_undegraded":"2024-05-10T09:58:04.655116+0000","last_fullsized":"2024-05-10T09:58:04.655116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650200+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:58:04.650200+0000","last_peered":"2024-05-10T09:58:04.650200+0000","last_clean":"2024-05-10T09:58:04.650200+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:04.650200+0000","last_undegraded":"2024-05-10T09:58:04.650200+0000","last_fullsized":"2024-05-10T09:58:04.650200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657074+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:58:04.657074+0000","last_peered":"2024-05-10T09:58:04.657074+0000","last_clean":"2024-05-10T09:58:04.657074+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:04.657074+0000","last_undegraded":"2024-05-10T09:58:04.657074+0000","last_fullsized":"2024-05-10T09:58:04.657074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650910+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:58:04.650910+0000","last_peered":"2024-05-10T09:58:04.650910+0000","last_clean":"2024-05-10T09:58:04.650910+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:04.650910+0000","last_undegraded":"2024-05-10T09:58:04.650910+0000","last_fullsized":"2024-05-10T09:58:04.650910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:35:41.781269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530366+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:58:04.530366+0000","last_peered":"2024-05-10T09:58:04.530366+0000","last_clean":"2024-05-10T09:58:04.530366+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:04.530366+0000","last_undegraded":"2024-05-10T09:58:04.530366+0000","last_fullsized":"2024-05-10T09:58:04.530366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":93,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530616+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:58:04.530616+0000","last_peered":"2024-05-10T09:58:04.530616+0000","last_clean":"2024-05-10T09:58:04.530616+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:04.530616+0000","last_undegraded":"2024-05-10T09:58:04.530616+0000","last_fullsized":"2024-05-10T09:58:04.530616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530644+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:58:04.530644+0000","last_peered":"2024-05-10T09:58:04.530644+0000","last_clean":"2024-05-10T09:58:04.530644+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:04.530644+0000","last_undegraded":"2024-05-10T09:58:04.530644+0000","last_fullsized":"2024-05-10T09:58:04.530644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649999+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:58:04.649999+0000","last_peered":"2024-05-10T09:58:04.649999+0000","last_clean":"2024-05-10T09:58:04.649999+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:04.649999+0000","last_undegraded":"2024-05-10T09:58:04.649999+0000","last_fullsized":"2024-05-10T09:58:04.649999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:37.678838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652885+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:58:04.652885+0000","last_peered":"2024-05-10T09:58:04.652885+0000","last_clean":"2024-05-10T09:58:04.652885+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:04.652885+0000","last_undegraded":"2024-05-10T09:58:04.652885+0000","last_fullsized":"2024-05-10T09:58:04.652885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"89'13","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652338+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:58:04.652338+0000","last_peered":"2024-05-10T09:58:04.652338+0000","last_clean":"2024-05-10T09:58:04.652338+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:04.652338+0000","last_undegraded":"2024-05-10T09:58:04.652338+0000","last_fullsized":"2024-05-10T09:58:04.652338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":24,"num_read_kb":34834,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.532396+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:58:04.532396+0000","last_peered":"2024-05-10T09:58:04.532396+0000","last_clean":"2024-05-10T09:58:04.532396+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:04.532396+0000","last_undegraded":"2024-05-10T09:58:04.532396+0000","last_fullsized":"2024-05-10T09:58:04.532396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525699+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:58:04.525699+0000","last_peered":"2024-05-10T09:58:04.525699+0000","last_clean":"2024-05-10T09:58:04.525699+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:04.525699+0000","last_undegraded":"2024-05-10T09:58:04.525699+0000","last_fullsized":"2024-05-10T09:58:04.525699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:28.966556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'15","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910656+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:58:08.910656+0000","last_peered":"2024-05-10T09:58:08.910656+0000","last_clean":"2024-05-10T09:58:08.910656+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:08.910656+0000","last_undegraded":"2024-05-10T09:58:08.910656+0000","last_fullsized":"2024-05-10T09:58:08.910656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529188+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:58:04.529188+0000","last_peered":"2024-05-10T09:58:04.529188+0000","last_clean":"2024-05-10T09:58:04.529188+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:04.529188+0000","last_undegraded":"2024-05-10T09:58:04.529188+0000","last_fullsized":"2024-05-10T09:58:04.529188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531253+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:58:04.531253+0000","last_peered":"2024-05-10T09:58:04.531253+0000","last_clean":"2024-05-10T09:58:04.531253+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:04.531253+0000","last_undegraded":"2024-05-10T09:58:04.531253+0000","last_fullsized":"2024-05-10T09:58:04.531253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654828+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:58:04.654828+0000","last_peered":"2024-05-10T09:58:04.654828+0000","last_clean":"2024-05-10T09:58:04.654828+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:04.654828+0000","last_undegraded":"2024-05-10T09:58:04.654828+0000","last_fullsized":"2024-05-10T09:58:04.654828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656656+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:58:04.656656+0000","last_peered":"2024-05-10T09:58:04.656656+0000","last_clean":"2024-05-10T09:58:04.656656+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:04.656656+0000","last_undegraded":"2024-05-10T09:58:04.656656+0000","last_fullsized":"2024-05-10T09:58:04.656656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"89'13","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655008+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:58:04.655008+0000","last_peered":"2024-05-10T09:58:04.655008+0000","last_clean":"2024-05-10T09:58:04.655008+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:04.655008+0000","last_undegraded":"2024-05-10T09:58:04.655008+0000","last_fullsized":"2024-05-10T09:58:04.655008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908303+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:58:08.908303+0000","last_peered":"2024-05-10T09:58:08.908303+0000","last_clean":"2024-05-10T09:58:08.908303+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:08.908303+0000","last_undegraded":"2024-05-10T09:58:08.908303+0000","last_fullsized":"2024-05-10T09:58:08.908303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651101+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:58:04.651101+0000","last_peered":"2024-05-10T09:58:04.651101+0000","last_clean":"2024-05-10T09:58:04.651101+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:04.651101+0000","last_undegraded":"2024-05-10T09:58:04.651101+0000","last_fullsized":"2024-05-10T09:58:04.651101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"89'8","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658091+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:58:04.658091+0000","last_peered":"2024-05-10T09:58:04.658091+0000","last_clean":"2024-05-10T09:58:04.658091+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:04.658091+0000","last_undegraded":"2024-05-10T09:58:04.658091+0000","last_fullsized":"2024-05-10T09:58:04.658091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651083+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:58:04.651083+0000","last_peered":"2024-05-10T09:58:04.651083+0000","last_clean":"2024-05-10T09:58:04.651083+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:04.651083+0000","last_undegraded":"2024-05-10T09:58:04.651083+0000","last_fullsized":"2024-05-10T09:58:04.651083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"89'23","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650787+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:58:04.650787+0000","last_peered":"2024-05-10T09:58:04.650787+0000","last_clean":"2024-05-10T09:58:04.650787+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:04.650787+0000","last_undegraded":"2024-05-10T09:58:04.650787+0000","last_fullsized":"2024-05-10T09:58:04.650787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647210+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:58:04.647210+0000","last_peered":"2024-05-10T09:58:04.647210+0000","last_clean":"2024-05-10T09:58:04.647210+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:04.647210+0000","last_undegraded":"2024-05-10T09:58:04.647210+0000","last_fullsized":"2024-05-10T09:58:04.647210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653582+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:58:04.653582+0000","last_peered":"2024-05-10T09:58:04.653582+0000","last_clean":"2024-05-10T09:58:04.653582+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:04.653582+0000","last_undegraded":"2024-05-10T09:58:04.653582+0000","last_fullsized":"2024-05-10T09:58:04.653582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527921+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:58:04.527921+0000","last_peered":"2024-05-10T09:58:04.527921+0000","last_clean":"2024-05-10T09:58:04.527921+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:04.527921+0000","last_undegraded":"2024-05-10T09:58:04.527921+0000","last_fullsized":"2024-05-10T09:58:04.527921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"89'13","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656481+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:58:04.656481+0000","last_peered":"2024-05-10T09:58:04.656481+0000","last_clean":"2024-05-10T09:58:04.656481+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:04.656481+0000","last_undegraded":"2024-05-10T09:58:04.656481+0000","last_fullsized":"2024-05-10T09:58:04.656481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525029+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:58:04.525029+0000","last_peered":"2024-05-10T09:58:04.525029+0000","last_clean":"2024-05-10T09:58:04.525029+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:04.525029+0000","last_undegraded":"2024-05-10T09:58:04.525029+0000","last_fullsized":"2024-05-10T09:58:04.525029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:19.920175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"89'15","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531332+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:58:04.531332+0000","last_peered":"2024-05-10T09:58:04.531332+0000","last_clean":"2024-05-10T09:58:04.531332+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:04.531332+0000","last_undegraded":"2024-05-10T09:58:04.531332+0000","last_fullsized":"2024-05-10T09:58:04.531332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527842+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:58:04.527842+0000","last_peered":"2024-05-10T09:58:04.527842+0000","last_clean":"2024-05-10T09:58:04.527842+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:04.527842+0000","last_undegraded":"2024-05-10T09:58:04.527842+0000","last_fullsized":"2024-05-10T09:58:04.527842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660834+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:58:04.660834+0000","last_peered":"2024-05-10T09:58:04.660834+0000","last_clean":"2024-05-10T09:58:04.660834+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:04.660834+0000","last_undegraded":"2024-05-10T09:58:04.660834+0000","last_fullsized":"2024-05-10T09:58:04.660834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655192+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:58:04.655192+0000","last_peered":"2024-05-10T09:58:04.655192+0000","last_clean":"2024-05-10T09:58:04.655192+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:04.655192+0000","last_undegraded":"2024-05-10T09:58:04.655192+0000","last_fullsized":"2024-05-10T09:58:04.655192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"79'8","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656460+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:58:04.656460+0000","last_peered":"2024-05-10T09:58:04.656460+0000","last_clean":"2024-05-10T09:58:04.656460+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:04.656460+0000","last_undegraded":"2024-05-10T09:58:04.656460+0000","last_fullsized":"2024-05-10T09:58:04.656460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527977+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:58:04.527977+0000","last_peered":"2024-05-10T09:58:04.527977+0000","last_clean":"2024-05-10T09:58:04.527977+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:04.527977+0000","last_undegraded":"2024-05-10T09:58:04.527977+0000","last_fullsized":"2024-05-10T09:58:04.527977+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:43.953138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"89'19","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650811+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:58:04.650811+0000","last_peered":"2024-05-10T09:58:04.650811+0000","last_clean":"2024-05-10T09:58:04.650811+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:04.650811+0000","last_undegraded":"2024-05-10T09:58:04.650811+0000","last_fullsized":"2024-05-10T09:58:04.650811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908192+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:58:08.908192+0000","last_peered":"2024-05-10T09:58:08.908192+0000","last_clean":"2024-05-10T09:58:08.908192+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:08.908192+0000","last_undegraded":"2024-05-10T09:58:08.908192+0000","last_fullsized":"2024-05-10T09:58:08.908192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652535+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:58:04.652535+0000","last_peered":"2024-05-10T09:58:04.652535+0000","last_clean":"2024-05-10T09:58:04.652535+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:04.652535+0000","last_undegraded":"2024-05-10T09:58:04.652535+0000","last_fullsized":"2024-05-10T09:58:04.652535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651204+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:58:04.651204+0000","last_peered":"2024-05-10T09:58:04.651204+0000","last_clean":"2024-05-10T09:58:04.651204+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:04.651204+0000","last_undegraded":"2024-05-10T09:58:04.651204+0000","last_fullsized":"2024-05-10T09:58:04.651204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:54.829685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"89'15","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654833+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:58:04.654833+0000","last_peered":"2024-05-10T09:58:04.654833+0000","last_clean":"2024-05-10T09:58:04.654833+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:04.654833+0000","last_undegraded":"2024-05-10T09:58:04.654833+0000","last_fullsized":"2024-05-10T09:58:04.654833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":49170,"num_write":45,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526171+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:58:04.526171+0000","last_peered":"2024-05-10T09:58:04.526171+0000","last_clean":"2024-05-10T09:58:04.526171+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:04.526171+0000","last_undegraded":"2024-05-10T09:58:04.526171+0000","last_fullsized":"2024-05-10T09:58:04.526171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:42:37.269066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"89'24","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648751+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:58:04.648751+0000","last_peered":"2024-05-10T09:58:04.648751+0000","last_clean":"2024-05-10T09:58:04.648751+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:04.648751+0000","last_undegraded":"2024-05-10T09:58:04.648751+0000","last_fullsized":"2024-05-10T09:58:04.648751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":50,"num_write":30,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.524822+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:58:04.524822+0000","last_peered":"2024-05-10T09:58:04.524822+0000","last_clean":"2024-05-10T09:58:04.524822+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:04.524822+0000","last_undegraded":"2024-05-10T09:58:04.524822+0000","last_fullsized":"2024-05-10T09:58:04.524822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.856688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646874+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:58:04.646874+0000","last_peered":"2024-05-10T09:58:04.646874+0000","last_clean":"2024-05-10T09:58:04.646874+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:04.646874+0000","last_undegraded":"2024-05-10T09:58:04.646874+0000","last_fullsized":"2024-05-10T09:58:04.646874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529824+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:58:04.529824+0000","last_peered":"2024-05-10T09:58:04.529824+0000","last_clean":"2024-05-10T09:58:04.529824+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:04.529824+0000","last_undegraded":"2024-05-10T09:58:04.529824+0000","last_fullsized":"2024-05-10T09:58:04.529824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528967+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:58:04.528967+0000","last_peered":"2024-05-10T09:58:04.528967+0000","last_clean":"2024-05-10T09:58:04.528967+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:04.528967+0000","last_undegraded":"2024-05-10T09:58:04.528967+0000","last_fullsized":"2024-05-10T09:58:04.528967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526622+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:58:04.526622+0000","last_peered":"2024-05-10T09:58:04.526622+0000","last_clean":"2024-05-10T09:58:04.526622+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:04.526622+0000","last_undegraded":"2024-05-10T09:58:04.526622+0000","last_fullsized":"2024-05-10T09:58:04.526622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:50.877532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"94'19","reported_seq":114,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530696+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:58:04.530696+0000","last_peered":"2024-05-10T09:58:04.530696+0000","last_clean":"2024-05-10T09:58:04.530696+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:04.530696+0000","last_undegraded":"2024-05-10T09:58:04.530696+0000","last_fullsized":"2024-05-10T09:58:04.530696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":31,"num_read_kb":33,"num_write":28,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653112+0000","last_change":"2024-05-10T09:54:47.720537+0000","last_active":"2024-05-10T09:58:04.653112+0000","last_peered":"2024-05-10T09:58:04.653112+0000","last_clean":"2024-05-10T09:58:04.653112+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:04.653112+0000","last_undegraded":"2024-05-10T09:58:04.653112+0000","last_fullsized":"2024-05-10T09:58:04.653112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:22:18.164088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525936+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:58:04.525936+0000","last_peered":"2024-05-10T09:58:04.525936+0000","last_clean":"2024-05-10T09:58:04.525936+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:04.525936+0000","last_undegraded":"2024-05-10T09:58:04.525936+0000","last_fullsized":"2024-05-10T09:58:04.525936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529936+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:58:04.529936+0000","last_peered":"2024-05-10T09:58:04.529936+0000","last_clean":"2024-05-10T09:58:04.529936+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:04.529936+0000","last_undegraded":"2024-05-10T09:58:04.529936+0000","last_fullsized":"2024-05-10T09:58:04.529936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'7","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655796+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:58:04.655796+0000","last_peered":"2024-05-10T09:58:04.655796+0000","last_clean":"2024-05-10T09:58:04.655796+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:04.655796+0000","last_undegraded":"2024-05-10T09:58:04.655796+0000","last_fullsized":"2024-05-10T09:58:04.655796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24582,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646639+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:58:04.646639+0000","last_peered":"2024-05-10T09:58:04.646639+0000","last_clean":"2024-05-10T09:58:04.646639+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:04.646639+0000","last_undegraded":"2024-05-10T09:58:04.646639+0000","last_fullsized":"2024-05-10T09:58:04.646639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"89'22","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528148+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:58:04.528148+0000","last_peered":"2024-05-10T09:58:04.528148+0000","last_clean":"2024-05-10T09:58:04.528148+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:04.528148+0000","last_undegraded":"2024-05-10T09:58:04.528148+0000","last_fullsized":"2024-05-10T09:58:04.528148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:36.410049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11923,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'15","reported_seq":251,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908366+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:58:08.908366+0000","last_peered":"2024-05-10T09:58:08.908366+0000","last_clean":"2024-05-10T09:58:08.908366+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:08.908366+0000","last_undegraded":"2024-05-10T09:58:08.908366+0000","last_fullsized":"2024-05-10T09:58:08.908366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:41.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648186+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:58:04.648186+0000","last_peered":"2024-05-10T09:58:04.648186+0000","last_clean":"2024-05-10T09:58:04.648186+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:04.648186+0000","last_undegraded":"2024-05-10T09:58:04.648186+0000","last_fullsized":"2024-05-10T09:58:04.648186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530492+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:58:04.530492+0000","last_peered":"2024-05-10T09:58:04.530492+0000","last_clean":"2024-05-10T09:58:04.530492+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:04.530492+0000","last_undegraded":"2024-05-10T09:58:04.530492+0000","last_fullsized":"2024-05-10T09:58:04.530492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"78'3","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528266+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:58:04.528266+0000","last_peered":"2024-05-10T09:58:04.528266+0000","last_clean":"2024-05-10T09:58:04.528266+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:04.528266+0000","last_undegraded":"2024-05-10T09:58:04.528266+0000","last_fullsized":"2024-05-10T09:58:04.528266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.217710+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:58:15.217710+0000","last_peered":"2024-05-10T09:58:15.217710+0000","last_clean":"2024-05-10T09:58:15.217710+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:15.217710+0000","last_undegraded":"2024-05-10T09:58:15.217710+0000","last_fullsized":"2024-05-10T09:58:15.217710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528642+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:58:04.528642+0000","last_peered":"2024-05-10T09:58:04.528642+0000","last_clean":"2024-05-10T09:58:04.528642+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:04.528642+0000","last_undegraded":"2024-05-10T09:58:04.528642+0000","last_fullsized":"2024-05-10T09:58:04.528642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'15","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910725+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:58:08.910725+0000","last_peered":"2024-05-10T09:58:08.910725+0000","last_clean":"2024-05-10T09:58:08.910725+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:08.910725+0000","last_undegraded":"2024-05-10T09:58:08.910725+0000","last_fullsized":"2024-05-10T09:58:08.910725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528502+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:58:04.528502+0000","last_peered":"2024-05-10T09:58:04.528502+0000","last_clean":"2024-05-10T09:58:04.528502+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:04.528502+0000","last_undegraded":"2024-05-10T09:58:04.528502+0000","last_fullsized":"2024-05-10T09:58:04.528502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647951+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:58:04.647951+0000","last_peered":"2024-05-10T09:58:04.647951+0000","last_clean":"2024-05-10T09:58:04.647951+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:04.647951+0000","last_undegraded":"2024-05-10T09:58:04.647951+0000","last_fullsized":"2024-05-10T09:58:04.647951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"89'13","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529478+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:58:04.529478+0000","last_peered":"2024-05-10T09:58:04.529478+0000","last_clean":"2024-05-10T09:58:04.529478+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:04.529478+0000","last_undegraded":"2024-05-10T09:58:04.529478+0000","last_fullsized":"2024-05-10T09:58:04.529478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530226+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:58:04.530226+0000","last_peered":"2024-05-10T09:58:04.530226+0000","last_clean":"2024-05-10T09:58:04.530226+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:04.530226+0000","last_undegraded":"2024-05-10T09:58:04.530226+0000","last_fullsized":"2024-05-10T09:58:04.530226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"89'24","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655681+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:58:04.655681+0000","last_peered":"2024-05-10T09:58:04.655681+0000","last_clean":"2024-05-10T09:58:04.655681+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:04.655681+0000","last_undegraded":"2024-05-10T09:58:04.655681+0000","last_fullsized":"2024-05-10T09:58:04.655681+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6878,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652778+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:58:04.652778+0000","last_peered":"2024-05-10T09:58:04.652778+0000","last_clean":"2024-05-10T09:58:04.652778+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:04.652778+0000","last_undegraded":"2024-05-10T09:58:04.652778+0000","last_fullsized":"2024-05-10T09:58:04.652778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646928+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:58:04.646928+0000","last_peered":"2024-05-10T09:58:04.646928+0000","last_clean":"2024-05-10T09:58:04.646928+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:04.646928+0000","last_undegraded":"2024-05-10T09:58:04.646928+0000","last_fullsized":"2024-05-10T09:58:04.646928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":238,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656709+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:58:04.656709+0000","last_peered":"2024-05-10T09:58:04.656709+0000","last_clean":"2024-05-10T09:58:04.656709+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:04.656709+0000","last_undegraded":"2024-05-10T09:58:04.656709+0000","last_fullsized":"2024-05-10T09:58:04.656709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":285,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651075+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:58:04.651075+0000","last_peered":"2024-05-10T09:58:04.651075+0000","last_clean":"2024-05-10T09:58:04.651075+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:04.651075+0000","last_undegraded":"2024-05-10T09:58:04.651075+0000","last_fullsized":"2024-05-10T09:58:04.651075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651354+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:58:04.651354+0000","last_peered":"2024-05-10T09:58:04.651354+0000","last_clean":"2024-05-10T09:58:04.651354+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:04.651354+0000","last_undegraded":"2024-05-10T09:58:04.651354+0000","last_fullsized":"2024-05-10T09:58:04.651354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528876+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:58:04.528876+0000","last_peered":"2024-05-10T09:58:04.528876+0000","last_clean":"2024-05-10T09:58:04.528876+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:04.528876+0000","last_undegraded":"2024-05-10T09:58:04.528876+0000","last_fullsized":"2024-05-10T09:58:04.528876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657379+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:58:04.657379+0000","last_peered":"2024-05-10T09:58:04.657379+0000","last_clean":"2024-05-10T09:58:04.657379+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:04.657379+0000","last_undegraded":"2024-05-10T09:58:04.657379+0000","last_fullsized":"2024-05-10T09:58:04.657379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"89'31","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657459+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:58:04.657459+0000","last_peered":"2024-05-10T09:58:04.657459+0000","last_clean":"2024-05-10T09:58:04.657459+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:04.657459+0000","last_undegraded":"2024-05-10T09:58:04.657459+0000","last_fullsized":"2024-05-10T09:58:04.657459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18966,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":54,"num_read_kb":70,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652543+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:58:04.652543+0000","last_peered":"2024-05-10T09:58:04.652543+0000","last_clean":"2024-05-10T09:58:04.652543+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:04.652543+0000","last_undegraded":"2024-05-10T09:58:04.652543+0000","last_fullsized":"2024-05-10T09:58:04.652543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651894+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:58:04.651894+0000","last_peered":"2024-05-10T09:58:04.651894+0000","last_clean":"2024-05-10T09:58:04.651894+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:04.651894+0000","last_undegraded":"2024-05-10T09:58:04.651894+0000","last_fullsized":"2024-05-10T09:58:04.651894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652782+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:58:04.652782+0000","last_peered":"2024-05-10T09:58:04.652782+0000","last_clean":"2024-05-10T09:58:04.652782+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:04.652782+0000","last_undegraded":"2024-05-10T09:58:04.652782+0000","last_fullsized":"2024-05-10T09:58:04.652782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650560+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:58:04.650560+0000","last_peered":"2024-05-10T09:58:04.650560+0000","last_clean":"2024-05-10T09:58:04.650560+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:04.650560+0000","last_undegraded":"2024-05-10T09:58:04.650560+0000","last_fullsized":"2024-05-10T09:58:04.650560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'12","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649016+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:58:04.649016+0000","last_peered":"2024-05-10T09:58:04.649016+0000","last_clean":"2024-05-10T09:58:04.649016+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:04.649016+0000","last_undegraded":"2024-05-10T09:58:04.649016+0000","last_fullsized":"2024-05-10T09:58:04.649016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:36.015437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":11,"num_read_kb":45056,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658097+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:58:04.658097+0000","last_peered":"2024-05-10T09:58:04.658097+0000","last_clean":"2024-05-10T09:58:04.658097+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:04.658097+0000","last_undegraded":"2024-05-10T09:58:04.658097+0000","last_fullsized":"2024-05-10T09:58:04.658097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'52","reported_seq":284,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908550+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:58:08.908550+0000","last_peered":"2024-05-10T09:58:08.908550+0000","last_clean":"2024-05-10T09:58:08.908550+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:08.908550+0000","last_undegraded":"2024-05-10T09:58:08.908550+0000","last_fullsized":"2024-05-10T09:58:08.908550+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20102,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":82,"num_read_kb":100,"num_write":54,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654776+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:58:04.654776+0000","last_peered":"2024-05-10T09:58:04.654776+0000","last_clean":"2024-05-10T09:58:04.654776+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:04.654776+0000","last_undegraded":"2024-05-10T09:58:04.654776+0000","last_fullsized":"2024-05-10T09:58:04.654776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647636+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:58:04.647636+0000","last_peered":"2024-05-10T09:58:04.647636+0000","last_clean":"2024-05-10T09:58:04.647636+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:04.647636+0000","last_undegraded":"2024-05-10T09:58:04.647636+0000","last_fullsized":"2024-05-10T09:58:04.647636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648061+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:58:04.648061+0000","last_peered":"2024-05-10T09:58:04.648061+0000","last_clean":"2024-05-10T09:58:04.648061+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:04.648061+0000","last_undegraded":"2024-05-10T09:58:04.648061+0000","last_fullsized":"2024-05-10T09:58:04.648061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529781+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:58:04.529781+0000","last_peered":"2024-05-10T09:58:04.529781+0000","last_clean":"2024-05-10T09:58:04.529781+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:04.529781+0000","last_undegraded":"2024-05-10T09:58:04.529781+0000","last_fullsized":"2024-05-10T09:58:04.529781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:30:23.508811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"89'10","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645674+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:58:04.645674+0000","last_peered":"2024-05-10T09:58:04.645674+0000","last_clean":"2024-05-10T09:58:04.645674+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:04.645674+0000","last_undegraded":"2024-05-10T09:58:04.645674+0000","last_fullsized":"2024-05-10T09:58:04.645674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":26636,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529576+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:58:04.529576+0000","last_peered":"2024-05-10T09:58:04.529576+0000","last_clean":"2024-05-10T09:58:04.529576+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:04.529576+0000","last_undegraded":"2024-05-10T09:58:04.529576+0000","last_fullsized":"2024-05-10T09:58:04.529576+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:39.336133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"110'16","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655641+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:58:04.655641+0000","last_peered":"2024-05-10T09:58:04.655641+0000","last_clean":"2024-05-10T09:58:04.655641+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:04.655641+0000","last_undegraded":"2024-05-10T09:58:04.655641+0000","last_fullsized":"2024-05-10T09:58:04.655641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651737+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:58:04.651737+0000","last_peered":"2024-05-10T09:58:04.651737+0000","last_clean":"2024-05-10T09:58:04.651737+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:04.651737+0000","last_undegraded":"2024-05-10T09:58:04.651737+0000","last_fullsized":"2024-05-10T09:58:04.651737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:06.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530498+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:58:04.530498+0000","last_peered":"2024-05-10T09:58:04.530498+0000","last_clean":"2024-05-10T09:58:04.530498+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:04.530498+0000","last_undegraded":"2024-05-10T09:58:04.530498+0000","last_fullsized":"2024-05-10T09:58:04.530498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647231+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:58:04.647231+0000","last_peered":"2024-05-10T09:58:04.647231+0000","last_clean":"2024-05-10T09:58:04.647231+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:04.647231+0000","last_undegraded":"2024-05-10T09:58:04.647231+0000","last_fullsized":"2024-05-10T09:58:04.647231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653676+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:58:04.653676+0000","last_peered":"2024-05-10T09:58:04.653676+0000","last_clean":"2024-05-10T09:58:04.653676+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:04.653676+0000","last_undegraded":"2024-05-10T09:58:04.653676+0000","last_fullsized":"2024-05-10T09:58:04.653676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"89'10","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651974+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:58:04.651974+0000","last_peered":"2024-05-10T09:58:04.651974+0000","last_clean":"2024-05-10T09:58:04.651974+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:04.651974+0000","last_undegraded":"2024-05-10T09:58:04.651974+0000","last_fullsized":"2024-05-10T09:58:04.651974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528089+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:58:04.528089+0000","last_peered":"2024-05-10T09:58:04.528089+0000","last_clean":"2024-05-10T09:58:04.528089+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:04.528089+0000","last_undegraded":"2024-05-10T09:58:04.528089+0000","last_fullsized":"2024-05-10T09:58:04.528089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655245+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:58:04.655245+0000","last_peered":"2024-05-10T09:58:04.655245+0000","last_clean":"2024-05-10T09:58:04.655245+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:04.655245+0000","last_undegraded":"2024-05-10T09:58:04.655245+0000","last_fullsized":"2024-05-10T09:58:04.655245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649808+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:58:04.649808+0000","last_peered":"2024-05-10T09:58:04.649808+0000","last_clean":"2024-05-10T09:58:04.649808+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:04.649808+0000","last_undegraded":"2024-05-10T09:58:04.649808+0000","last_fullsized":"2024-05-10T09:58:04.649808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646914+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:58:04.646914+0000","last_peered":"2024-05-10T09:58:04.646914+0000","last_clean":"2024-05-10T09:58:04.646914+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:04.646914+0000","last_undegraded":"2024-05-10T09:58:04.646914+0000","last_fullsized":"2024-05-10T09:58:04.646914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657604+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:58:04.657604+0000","last_peered":"2024-05-10T09:58:04.657604+0000","last_clean":"2024-05-10T09:58:04.657604+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:04.657604+0000","last_undegraded":"2024-05-10T09:58:04.657604+0000","last_fullsized":"2024-05-10T09:58:04.657604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45068,"num_write":34,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648281+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:58:04.648281+0000","last_peered":"2024-05-10T09:58:04.648281+0000","last_clean":"2024-05-10T09:58:04.648281+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:04.648281+0000","last_undegraded":"2024-05-10T09:58:04.648281+0000","last_fullsized":"2024-05-10T09:58:04.648281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649720+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:58:04.649720+0000","last_peered":"2024-05-10T09:58:04.649720+0000","last_clean":"2024-05-10T09:58:04.649720+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:04.649720+0000","last_undegraded":"2024-05-10T09:58:04.649720+0000","last_fullsized":"2024-05-10T09:58:04.649720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:08.591786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"89'28","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646802+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:58:04.646802+0000","last_peered":"2024-05-10T09:58:04.646802+0000","last_clean":"2024-05-10T09:58:04.646802+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:04.646802+0000","last_undegraded":"2024-05-10T09:58:04.646802+0000","last_fullsized":"2024-05-10T09:58:04.646802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11529,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529488+0000","last_change":"2024-05-10T09:57:19.676469+0000","last_active":"2024-05-10T09:58:04.529488+0000","last_peered":"2024-05-10T09:58:04.529488+0000","last_clean":"2024-05-10T09:58:04.529488+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:58:04.529488+0000","last_undegraded":"2024-05-10T09:58:04.529488+0000","last_fullsized":"2024-05-10T09:58:04.529488+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:07.877322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651956+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:58:04.651956+0000","last_peered":"2024-05-10T09:58:04.651956+0000","last_clean":"2024-05-10T09:58:04.651956+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:04.651956+0000","last_undegraded":"2024-05-10T09:58:04.651956+0000","last_fullsized":"2024-05-10T09:58:04.651956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651063+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:58:04.651063+0000","last_peered":"2024-05-10T09:58:04.651063+0000","last_clean":"2024-05-10T09:58:04.651063+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:04.651063+0000","last_undegraded":"2024-05-10T09:58:04.651063+0000","last_fullsized":"2024-05-10T09:58:04.651063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"77'3","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647490+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:58:04.647490+0000","last_peered":"2024-05-10T09:58:04.647490+0000","last_clean":"2024-05-10T09:58:04.647490+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:04.647490+0000","last_undegraded":"2024-05-10T09:58:04.647490+0000","last_fullsized":"2024-05-10T09:58:04.647490+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657133+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:58:04.657133+0000","last_peered":"2024-05-10T09:58:04.657133+0000","last_clean":"2024-05-10T09:58:04.657133+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:04.657133+0000","last_undegraded":"2024-05-10T09:58:04.657133+0000","last_fullsized":"2024-05-10T09:58:04.657133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656579+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:58:04.656579+0000","last_peered":"2024-05-10T09:58:04.656579+0000","last_clean":"2024-05-10T09:58:04.656579+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:04.656579+0000","last_undegraded":"2024-05-10T09:58:04.656579+0000","last_fullsized":"2024-05-10T09:58:04.656579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645778+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:58:04.645778+0000","last_peered":"2024-05-10T09:58:04.645778+0000","last_clean":"2024-05-10T09:58:04.645778+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:04.645778+0000","last_undegraded":"2024-05-10T09:58:04.645778+0000","last_fullsized":"2024-05-10T09:58:04.645778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'17","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.248481+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:58:15.248481+0000","last_peered":"2024-05-10T09:58:15.248481+0000","last_clean":"2024-05-10T09:58:15.248481+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:15.248481+0000","last_undegraded":"2024-05-10T09:58:15.248481+0000","last_fullsized":"2024-05-10T09:58:15.248481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531521+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:58:04.531521+0000","last_peered":"2024-05-10T09:58:04.531521+0000","last_clean":"2024-05-10T09:58:04.531521+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:04.531521+0000","last_undegraded":"2024-05-10T09:58:04.531521+0000","last_fullsized":"2024-05-10T09:58:04.531521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527816+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:58:04.527816+0000","last_peered":"2024-05-10T09:58:04.527816+0000","last_clean":"2024-05-10T09:58:04.527816+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:04.527816+0000","last_undegraded":"2024-05-10T09:58:04.527816+0000","last_fullsized":"2024-05-10T09:58:04.527816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"89'11","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527678+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:58:04.527678+0000","last_peered":"2024-05-10T09:58:04.527678+0000","last_clean":"2024-05-10T09:58:04.527678+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:04.527678+0000","last_undegraded":"2024-05-10T09:58:04.527678+0000","last_fullsized":"2024-05-10T09:58:04.527678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647640+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:58:04.647640+0000","last_peered":"2024-05-10T09:58:04.647640+0000","last_clean":"2024-05-10T09:58:04.647640+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:04.647640+0000","last_undegraded":"2024-05-10T09:58:04.647640+0000","last_fullsized":"2024-05-10T09:58:04.647640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528907+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:58:04.528907+0000","last_peered":"2024-05-10T09:58:04.528907+0000","last_clean":"2024-05-10T09:58:04.528907+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:04.528907+0000","last_undegraded":"2024-05-10T09:58:04.528907+0000","last_fullsized":"2024-05-10T09:58:04.528907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":99,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529276+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:58:04.529276+0000","last_peered":"2024-05-10T09:58:04.529276+0000","last_clean":"2024-05-10T09:58:04.529276+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:04.529276+0000","last_undegraded":"2024-05-10T09:58:04.529276+0000","last_fullsized":"2024-05-10T09:58:04.529276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"110'15","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.908200+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:58:08.908200+0000","last_peered":"2024-05-10T09:58:08.908200+0000","last_clean":"2024-05-10T09:58:08.908200+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:08.908200+0000","last_undegraded":"2024-05-10T09:58:08.908200+0000","last_fullsized":"2024-05-10T09:58:08.908200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651782+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:58:04.651782+0000","last_peered":"2024-05-10T09:58:04.651782+0000","last_clean":"2024-05-10T09:58:04.651782+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:04.651782+0000","last_undegraded":"2024-05-10T09:58:04.651782+0000","last_fullsized":"2024-05-10T09:58:04.651782+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529167+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:58:04.529167+0000","last_peered":"2024-05-10T09:58:04.529167+0000","last_clean":"2024-05-10T09:58:04.529167+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:04.529167+0000","last_undegraded":"2024-05-10T09:58:04.529167+0000","last_fullsized":"2024-05-10T09:58:04.529167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652922+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:58:04.652922+0000","last_peered":"2024-05-10T09:58:04.652922+0000","last_clean":"2024-05-10T09:58:04.652922+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:04.652922+0000","last_undegraded":"2024-05-10T09:58:04.652922+0000","last_fullsized":"2024-05-10T09:58:04.652922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":41,"num_read_kb":59422,"num_write":71,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656494+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:58:04.656494+0000","last_peered":"2024-05-10T09:58:04.656494+0000","last_clean":"2024-05-10T09:58:04.656494+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:04.656494+0000","last_undegraded":"2024-05-10T09:58:04.656494+0000","last_fullsized":"2024-05-10T09:58:04.656494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527204+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:58:04.527204+0000","last_peered":"2024-05-10T09:58:04.527204+0000","last_clean":"2024-05-10T09:58:04.527204+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:04.527204+0000","last_undegraded":"2024-05-10T09:58:04.527204+0000","last_fullsized":"2024-05-10T09:58:04.527204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"89'35","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653416+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:58:04.653416+0000","last_peered":"2024-05-10T09:58:04.653416+0000","last_clean":"2024-05-10T09:58:04.653416+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:04.653416+0000","last_undegraded":"2024-05-10T09:58:04.653416+0000","last_fullsized":"2024-05-10T09:58:04.653416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17853,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":59,"num_read_kb":66,"num_write":42,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528099+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:58:04.528099+0000","last_peered":"2024-05-10T09:58:04.528099+0000","last_clean":"2024-05-10T09:58:04.528099+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:04.528099+0000","last_undegraded":"2024-05-10T09:58:04.528099+0000","last_fullsized":"2024-05-10T09:58:04.528099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650656+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:58:04.650656+0000","last_peered":"2024-05-10T09:58:04.650656+0000","last_clean":"2024-05-10T09:58:04.650656+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:04.650656+0000","last_undegraded":"2024-05-10T09:58:04.650656+0000","last_fullsized":"2024-05-10T09:58:04.650656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652973+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:58:04.652973+0000","last_peered":"2024-05-10T09:58:04.652973+0000","last_clean":"2024-05-10T09:58:04.652973+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:04.652973+0000","last_undegraded":"2024-05-10T09:58:04.652973+0000","last_fullsized":"2024-05-10T09:58:04.652973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:28:56.895029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529250+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:58:04.529250+0000","last_peered":"2024-05-10T09:58:04.529250+0000","last_clean":"2024-05-10T09:58:04.529250+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:04.529250+0000","last_undegraded":"2024-05-10T09:58:04.529250+0000","last_fullsized":"2024-05-10T09:58:04.529250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"79'7","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528880+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:58:04.528880+0000","last_peered":"2024-05-10T09:58:04.528880+0000","last_clean":"2024-05-10T09:58:04.528880+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:04.528880+0000","last_undegraded":"2024-05-10T09:58:04.528880+0000","last_fullsized":"2024-05-10T09:58:04.528880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647012+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:58:04.647012+0000","last_peered":"2024-05-10T09:58:04.647012+0000","last_clean":"2024-05-10T09:58:04.647012+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:04.647012+0000","last_undegraded":"2024-05-10T09:58:04.647012+0000","last_fullsized":"2024-05-10T09:58:04.647012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"89'17","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527493+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:58:04.527493+0000","last_peered":"2024-05-10T09:58:04.527493+0000","last_clean":"2024-05-10T09:58:04.527493+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:04.527493+0000","last_undegraded":"2024-05-10T09:58:04.527493+0000","last_fullsized":"2024-05-10T09:58:04.527493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526191+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:58:04.526191+0000","last_peered":"2024-05-10T09:58:04.526191+0000","last_clean":"2024-05-10T09:58:04.526191+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:04.526191+0000","last_undegraded":"2024-05-10T09:58:04.526191+0000","last_fullsized":"2024-05-10T09:58:04.526191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527534+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:58:04.527534+0000","last_peered":"2024-05-10T09:58:04.527534+0000","last_clean":"2024-05-10T09:58:04.527534+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:04.527534+0000","last_undegraded":"2024-05-10T09:58:04.527534+0000","last_fullsized":"2024-05-10T09:58:04.527534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646813+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:58:04.646813+0000","last_peered":"2024-05-10T09:58:04.646813+0000","last_clean":"2024-05-10T09:58:04.646813+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:04.646813+0000","last_undegraded":"2024-05-10T09:58:04.646813+0000","last_fullsized":"2024-05-10T09:58:04.646813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"89'12","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656190+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:58:04.656190+0000","last_peered":"2024-05-10T09:58:04.656190+0000","last_clean":"2024-05-10T09:58:04.656190+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:04.656190+0000","last_undegraded":"2024-05-10T09:58:04.656190+0000","last_fullsized":"2024-05-10T09:58:04.656190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":30738,"num_write":42,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530067+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:58:04.530067+0000","last_peered":"2024-05-10T09:58:04.530067+0000","last_clean":"2024-05-10T09:58:04.530067+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:04.530067+0000","last_undegraded":"2024-05-10T09:58:04.530067+0000","last_fullsized":"2024-05-10T09:58:04.530067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646603+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:58:04.646603+0000","last_peered":"2024-05-10T09:58:04.646603+0000","last_clean":"2024-05-10T09:58:04.646603+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:04.646603+0000","last_undegraded":"2024-05-10T09:58:04.646603+0000","last_fullsized":"2024-05-10T09:58:04.646603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651652+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:58:04.651652+0000","last_peered":"2024-05-10T09:58:04.651652+0000","last_clean":"2024-05-10T09:58:04.651652+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:04.651652+0000","last_undegraded":"2024-05-10T09:58:04.651652+0000","last_fullsized":"2024-05-10T09:58:04.651652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651848+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:58:04.651848+0000","last_peered":"2024-05-10T09:58:04.651848+0000","last_clean":"2024-05-10T09:58:04.651848+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:04.651848+0000","last_undegraded":"2024-05-10T09:58:04.651848+0000","last_fullsized":"2024-05-10T09:58:04.651848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530746+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:58:04.530746+0000","last_peered":"2024-05-10T09:58:04.530746+0000","last_clean":"2024-05-10T09:58:04.530746+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:04.530746+0000","last_undegraded":"2024-05-10T09:58:04.530746+0000","last_fullsized":"2024-05-10T09:58:04.530746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"89'9","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657229+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:58:04.657229+0000","last_peered":"2024-05-10T09:58:04.657229+0000","last_clean":"2024-05-10T09:58:04.657229+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:04.657229+0000","last_undegraded":"2024-05-10T09:58:04.657229+0000","last_fullsized":"2024-05-10T09:58:04.657229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649736+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:58:04.649736+0000","last_peered":"2024-05-10T09:58:04.649736+0000","last_clean":"2024-05-10T09:58:04.649736+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:04.649736+0000","last_undegraded":"2024-05-10T09:58:04.649736+0000","last_fullsized":"2024-05-10T09:58:04.649736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"89'18","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529286+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:58:04.529286+0000","last_peered":"2024-05-10T09:58:04.529286+0000","last_clean":"2024-05-10T09:58:04.529286+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:04.529286+0000","last_undegraded":"2024-05-10T09:58:04.529286+0000","last_fullsized":"2024-05-10T09:58:04.529286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654262+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:58:04.654262+0000","last_peered":"2024-05-10T09:58:04.654262+0000","last_clean":"2024-05-10T09:58:04.654262+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:04.654262+0000","last_undegraded":"2024-05-10T09:58:04.654262+0000","last_fullsized":"2024-05-10T09:58:04.654262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653292+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:58:04.653292+0000","last_peered":"2024-05-10T09:58:04.653292+0000","last_clean":"2024-05-10T09:58:04.653292+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:04.653292+0000","last_undegraded":"2024-05-10T09:58:04.653292+0000","last_fullsized":"2024-05-10T09:58:04.653292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528375+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:58:04.528375+0000","last_peered":"2024-05-10T09:58:04.528375+0000","last_clean":"2024-05-10T09:58:04.528375+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:04.528375+0000","last_undegraded":"2024-05-10T09:58:04.528375+0000","last_fullsized":"2024-05-10T09:58:04.528375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653595+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:58:04.653595+0000","last_peered":"2024-05-10T09:58:04.653595+0000","last_clean":"2024-05-10T09:58:04.653595+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:04.653595+0000","last_undegraded":"2024-05-10T09:58:04.653595+0000","last_fullsized":"2024-05-10T09:58:04.653595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40978,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654529+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:58:04.654529+0000","last_peered":"2024-05-10T09:58:04.654529+0000","last_clean":"2024-05-10T09:58:04.654529+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:04.654529+0000","last_undegraded":"2024-05-10T09:58:04.654529+0000","last_fullsized":"2024-05-10T09:58:04.654529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"89'15","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653237+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:58:04.653237+0000","last_peered":"2024-05-10T09:58:04.653237+0000","last_clean":"2024-05-10T09:58:04.653237+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:04.653237+0000","last_undegraded":"2024-05-10T09:58:04.653237+0000","last_fullsized":"2024-05-10T09:58:04.653237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648770+0000","last_change":"2024-05-10T09:54:47.704534+0000","last_active":"2024-05-10T09:58:04.648770+0000","last_peered":"2024-05-10T09:58:04.648770+0000","last_clean":"2024-05-10T09:58:04.648770+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:04.648770+0000","last_undegraded":"2024-05-10T09:58:04.648770+0000","last_fullsized":"2024-05-10T09:58:04.648770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:16:49.769580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656182+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:58:04.656182+0000","last_peered":"2024-05-10T09:58:04.656182+0000","last_clean":"2024-05-10T09:58:04.656182+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:04.656182+0000","last_undegraded":"2024-05-10T09:58:04.656182+0000","last_fullsized":"2024-05-10T09:58:04.656182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529228+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:58:04.529228+0000","last_peered":"2024-05-10T09:58:04.529228+0000","last_clean":"2024-05-10T09:58:04.529228+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:04.529228+0000","last_undegraded":"2024-05-10T09:58:04.529228+0000","last_fullsized":"2024-05-10T09:58:04.529228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":18444,"num_write":27,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652635+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:58:04.652635+0000","last_peered":"2024-05-10T09:58:04.652635+0000","last_clean":"2024-05-10T09:58:04.652635+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:04.652635+0000","last_undegraded":"2024-05-10T09:58:04.652635+0000","last_fullsized":"2024-05-10T09:58:04.652635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:19.853823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"89'21","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647027+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:58:04.647027+0000","last_peered":"2024-05-10T09:58:04.647027+0000","last_clean":"2024-05-10T09:58:04.647027+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:04.647027+0000","last_undegraded":"2024-05-10T09:58:04.647027+0000","last_fullsized":"2024-05-10T09:58:04.647027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10974,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":24,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653816+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:58:04.653816+0000","last_peered":"2024-05-10T09:58:04.653816+0000","last_clean":"2024-05-10T09:58:04.653816+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:04.653816+0000","last_undegraded":"2024-05-10T09:58:04.653816+0000","last_fullsized":"2024-05-10T09:58:04.653816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528651+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:58:04.528651+0000","last_peered":"2024-05-10T09:58:04.528651+0000","last_clean":"2024-05-10T09:58:04.528651+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:04.528651+0000","last_undegraded":"2024-05-10T09:58:04.528651+0000","last_fullsized":"2024-05-10T09:58:04.528651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652727+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:58:04.652727+0000","last_peered":"2024-05-10T09:58:04.652727+0000","last_clean":"2024-05-10T09:58:04.652727+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:04.652727+0000","last_undegraded":"2024-05-10T09:58:04.652727+0000","last_fullsized":"2024-05-10T09:58:04.652727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646498+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:58:04.646498+0000","last_peered":"2024-05-10T09:58:04.646498+0000","last_clean":"2024-05-10T09:58:04.646498+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:04.646498+0000","last_undegraded":"2024-05-10T09:58:04.646498+0000","last_fullsized":"2024-05-10T09:58:04.646498+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":30726,"num_write":21,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.202744+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:58:15.202744+0000","last_peered":"2024-05-10T09:58:15.202744+0000","last_clean":"2024-05-10T09:58:15.202744+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:15.202744+0000","last_undegraded":"2024-05-10T09:58:15.202744+0000","last_fullsized":"2024-05-10T09:58:15.202744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"89'21","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653505+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:58:04.653505+0000","last_peered":"2024-05-10T09:58:04.653505+0000","last_clean":"2024-05-10T09:58:04.653505+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:04.653505+0000","last_undegraded":"2024-05-10T09:58:04.653505+0000","last_fullsized":"2024-05-10T09:58:04.653505+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647328+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:58:04.647328+0000","last_peered":"2024-05-10T09:58:04.647328+0000","last_clean":"2024-05-10T09:58:04.647328+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:04.647328+0000","last_undegraded":"2024-05-10T09:58:04.647328+0000","last_fullsized":"2024-05-10T09:58:04.647328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652826+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:58:04.652826+0000","last_peered":"2024-05-10T09:58:04.652826+0000","last_clean":"2024-05-10T09:58:04.652826+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:04.652826+0000","last_undegraded":"2024-05-10T09:58:04.652826+0000","last_fullsized":"2024-05-10T09:58:04.652826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528292+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:58:04.528292+0000","last_peered":"2024-05-10T09:58:04.528292+0000","last_clean":"2024-05-10T09:58:04.528292+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:04.528292+0000","last_undegraded":"2024-05-10T09:58:04.528292+0000","last_fullsized":"2024-05-10T09:58:04.528292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528195+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:58:04.528195+0000","last_peered":"2024-05-10T09:58:04.528195+0000","last_clean":"2024-05-10T09:58:04.528195+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:04.528195+0000","last_undegraded":"2024-05-10T09:58:04.528195+0000","last_fullsized":"2024-05-10T09:58:04.528195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529014+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:58:04.529014+0000","last_peered":"2024-05-10T09:58:04.529014+0000","last_clean":"2024-05-10T09:58:04.529014+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:04.529014+0000","last_undegraded":"2024-05-10T09:58:04.529014+0000","last_fullsized":"2024-05-10T09:58:04.529014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"89'16","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531919+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:58:04.531919+0000","last_peered":"2024-05-10T09:58:04.531919+0000","last_clean":"2024-05-10T09:58:04.531919+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:04.531919+0000","last_undegraded":"2024-05-10T09:58:04.531919+0000","last_fullsized":"2024-05-10T09:58:04.531919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647189+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:58:04.647189+0000","last_peered":"2024-05-10T09:58:04.647189+0000","last_clean":"2024-05-10T09:58:04.647189+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:04.647189+0000","last_undegraded":"2024-05-10T09:58:04.647189+0000","last_fullsized":"2024-05-10T09:58:04.647189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650463+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:58:04.650463+0000","last_peered":"2024-05-10T09:58:04.650463+0000","last_clean":"2024-05-10T09:58:04.650463+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:04.650463+0000","last_undegraded":"2024-05-10T09:58:04.650463+0000","last_fullsized":"2024-05-10T09:58:04.650463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526549+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:58:04.526549+0000","last_peered":"2024-05-10T09:58:04.526549+0000","last_clean":"2024-05-10T09:58:04.526549+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:04.526549+0000","last_undegraded":"2024-05-10T09:58:04.526549+0000","last_fullsized":"2024-05-10T09:58:04.526549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:35.706075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"79'11","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649007+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:58:04.649007+0000","last_peered":"2024-05-10T09:58:04.649007+0000","last_clean":"2024-05-10T09:58:04.649007+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:04.649007+0000","last_undegraded":"2024-05-10T09:58:04.649007+0000","last_fullsized":"2024-05-10T09:58:04.649007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:36.921016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38918,"num_write":21,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647618+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:58:04.647618+0000","last_peered":"2024-05-10T09:58:04.647618+0000","last_clean":"2024-05-10T09:58:04.647618+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:04.647618+0000","last_undegraded":"2024-05-10T09:58:04.647618+0000","last_fullsized":"2024-05-10T09:58:04.647618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":103,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530384+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:58:04.530384+0000","last_peered":"2024-05-10T09:58:04.530384+0000","last_clean":"2024-05-10T09:58:04.530384+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:04.530384+0000","last_undegraded":"2024-05-10T09:58:04.530384+0000","last_fullsized":"2024-05-10T09:58:04.530384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'17","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:08.910719+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:58:08.910719+0000","last_peered":"2024-05-10T09:58:08.910719+0000","last_clean":"2024-05-10T09:58:08.910719+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:08.910719+0000","last_undegraded":"2024-05-10T09:58:08.910719+0000","last_fullsized":"2024-05-10T09:58:08.910719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649718+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:58:04.649718+0000","last_peered":"2024-05-10T09:58:04.649718+0000","last_clean":"2024-05-10T09:58:04.649718+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:04.649718+0000","last_undegraded":"2024-05-10T09:58:04.649718+0000","last_fullsized":"2024-05-10T09:58:04.649718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":131,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646678+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:58:04.646678+0000","last_peered":"2024-05-10T09:58:04.646678+0000","last_clean":"2024-05-10T09:58:04.646678+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:04.646678+0000","last_undegraded":"2024-05-10T09:58:04.646678+0000","last_fullsized":"2024-05-10T09:58:04.646678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654431+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:58:04.654431+0000","last_peered":"2024-05-10T09:58:04.654431+0000","last_clean":"2024-05-10T09:58:04.654431+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:04.654431+0000","last_undegraded":"2024-05-10T09:58:04.654431+0000","last_fullsized":"2024-05-10T09:58:04.654431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":18450,"num_write":39,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653243+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:58:04.653243+0000","last_peered":"2024-05-10T09:58:04.653243+0000","last_clean":"2024-05-10T09:58:04.653243+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:04.653243+0000","last_undegraded":"2024-05-10T09:58:04.653243+0000","last_fullsized":"2024-05-10T09:58:04.653243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"89'19","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653251+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:58:04.653251+0000","last_peered":"2024-05-10T09:58:04.653251+0000","last_clean":"2024-05-10T09:58:04.653251+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:04.653251+0000","last_undegraded":"2024-05-10T09:58:04.653251+0000","last_fullsized":"2024-05-10T09:58:04.653251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646293+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:58:04.646293+0000","last_peered":"2024-05-10T09:58:04.646293+0000","last_clean":"2024-05-10T09:58:04.646293+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:04.646293+0000","last_undegraded":"2024-05-10T09:58:04.646293+0000","last_fullsized":"2024-05-10T09:58:04.646293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658184+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:58:04.658184+0000","last_peered":"2024-05-10T09:58:04.658184+0000","last_clean":"2024-05-10T09:58:04.658184+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:04.658184+0000","last_undegraded":"2024-05-10T09:58:04.658184+0000","last_fullsized":"2024-05-10T09:58:04.658184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529018+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:58:04.529018+0000","last_peered":"2024-05-10T09:58:04.529018+0000","last_clean":"2024-05-10T09:58:04.529018+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:04.529018+0000","last_undegraded":"2024-05-10T09:58:04.529018+0000","last_fullsized":"2024-05-10T09:58:04.529018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"89'9","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657322+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:58:04.657322+0000","last_peered":"2024-05-10T09:58:04.657322+0000","last_clean":"2024-05-10T09:58:04.657322+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:04.657322+0000","last_undegraded":"2024-05-10T09:58:04.657322+0000","last_fullsized":"2024-05-10T09:58:04.657322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650809+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:58:04.650809+0000","last_peered":"2024-05-10T09:58:04.650809+0000","last_clean":"2024-05-10T09:58:04.650809+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:04.650809+0000","last_undegraded":"2024-05-10T09:58:04.650809+0000","last_fullsized":"2024-05-10T09:58:04.650809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"89'14","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646411+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:58:04.646411+0000","last_peered":"2024-05-10T09:58:04.646411+0000","last_clean":"2024-05-10T09:58:04.646411+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:04.646411+0000","last_undegraded":"2024-05-10T09:58:04.646411+0000","last_fullsized":"2024-05-10T09:58:04.646411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652426+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:58:04.652426+0000","last_peered":"2024-05-10T09:58:04.652426+0000","last_clean":"2024-05-10T09:58:04.652426+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:04.652426+0000","last_undegraded":"2024-05-10T09:58:04.652426+0000","last_fullsized":"2024-05-10T09:58:04.652426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527768+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:58:04.527768+0000","last_peered":"2024-05-10T09:58:04.527768+0000","last_clean":"2024-05-10T09:58:04.527768+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:04.527768+0000","last_undegraded":"2024-05-10T09:58:04.527768+0000","last_fullsized":"2024-05-10T09:58:04.527768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531028+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:58:04.531028+0000","last_peered":"2024-05-10T09:58:04.531028+0000","last_clean":"2024-05-10T09:58:04.531028+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:04.531028+0000","last_undegraded":"2024-05-10T09:58:04.531028+0000","last_fullsized":"2024-05-10T09:58:04.531028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"89'7","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528950+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:58:04.528950+0000","last_peered":"2024-05-10T09:58:04.528950+0000","last_clean":"2024-05-10T09:58:04.528950+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:04.528950+0000","last_undegraded":"2024-05-10T09:58:04.528950+0000","last_fullsized":"2024-05-10T09:58:04.528950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20486,"num_write":17,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527959+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:58:04.527959+0000","last_peered":"2024-05-10T09:58:04.527959+0000","last_clean":"2024-05-10T09:58:04.527959+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:04.527959+0000","last_undegraded":"2024-05-10T09:58:04.527959+0000","last_fullsized":"2024-05-10T09:58:04.527959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"89'8","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531553+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:58:04.531553+0000","last_peered":"2024-05-10T09:58:04.531553+0000","last_clean":"2024-05-10T09:58:04.531553+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:04.531553+0000","last_undegraded":"2024-05-10T09:58:04.531553+0000","last_fullsized":"2024-05-10T09:58:04.531553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529836+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:58:04.529836+0000","last_peered":"2024-05-10T09:58:04.529836+0000","last_clean":"2024-05-10T09:58:04.529836+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:04.529836+0000","last_undegraded":"2024-05-10T09:58:04.529836+0000","last_fullsized":"2024-05-10T09:58:04.529836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655255+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:58:04.655255+0000","last_peered":"2024-05-10T09:58:04.655255+0000","last_clean":"2024-05-10T09:58:04.655255+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:04.655255+0000","last_undegraded":"2024-05-10T09:58:04.655255+0000","last_fullsized":"2024-05-10T09:58:04.655255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527607+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:58:04.527607+0000","last_peered":"2024-05-10T09:58:04.527607+0000","last_clean":"2024-05-10T09:58:04.527607+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:04.527607+0000","last_undegraded":"2024-05-10T09:58:04.527607+0000","last_fullsized":"2024-05-10T09:58:04.527607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"89'14","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653419+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:58:04.653419+0000","last_peered":"2024-05-10T09:58:04.653419+0000","last_clean":"2024-05-10T09:58:04.653419+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:04.653419+0000","last_undegraded":"2024-05-10T09:58:04.653419+0000","last_fullsized":"2024-05-10T09:58:04.653419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645798+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:58:04.645798+0000","last_peered":"2024-05-10T09:58:04.645798+0000","last_clean":"2024-05-10T09:58:04.645798+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:04.645798+0000","last_undegraded":"2024-05-10T09:58:04.645798+0000","last_fullsized":"2024-05-10T09:58:04.645798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"89'14","reported_seq":107,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528957+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:58:04.528957+0000","last_peered":"2024-05-10T09:58:04.528957+0000","last_clean":"2024-05-10T09:58:04.528957+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:04.528957+0000","last_undegraded":"2024-05-10T09:58:04.528957+0000","last_fullsized":"2024-05-10T09:58:04.528957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10810,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648510+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:58:04.648510+0000","last_peered":"2024-05-10T09:58:04.648510+0000","last_clean":"2024-05-10T09:58:04.648510+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:04.648510+0000","last_undegraded":"2024-05-10T09:58:04.648510+0000","last_fullsized":"2024-05-10T09:58:04.648510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529237+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:58:04.529237+0000","last_peered":"2024-05-10T09:58:04.529237+0000","last_clean":"2024-05-10T09:58:04.529237+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:04.529237+0000","last_undegraded":"2024-05-10T09:58:04.529237+0000","last_fullsized":"2024-05-10T09:58:04.529237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647961+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:58:04.647961+0000","last_peered":"2024-05-10T09:58:04.647961+0000","last_clean":"2024-05-10T09:58:04.647961+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:04.647961+0000","last_undegraded":"2024-05-10T09:58:04.647961+0000","last_fullsized":"2024-05-10T09:58:04.647961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"89'10","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654410+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:58:04.654410+0000","last_peered":"2024-05-10T09:58:04.654410+0000","last_clean":"2024-05-10T09:58:04.654410+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:04.654410+0000","last_undegraded":"2024-05-10T09:58:04.654410+0000","last_fullsized":"2024-05-10T09:58:04.654410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":24588,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647419+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:58:04.647419+0000","last_peered":"2024-05-10T09:58:04.647419+0000","last_clean":"2024-05-10T09:58:04.647419+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:04.647419+0000","last_undegraded":"2024-05-10T09:58:04.647419+0000","last_fullsized":"2024-05-10T09:58:04.647419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"89'14","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529372+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:58:04.529372+0000","last_peered":"2024-05-10T09:58:04.529372+0000","last_clean":"2024-05-10T09:58:04.529372+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:04.529372+0000","last_undegraded":"2024-05-10T09:58:04.529372+0000","last_fullsized":"2024-05-10T09:58:04.529372+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:12.624811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656340+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:58:04.656340+0000","last_peered":"2024-05-10T09:58:04.656340+0000","last_clean":"2024-05-10T09:58:04.656340+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:04.656340+0000","last_undegraded":"2024-05-10T09:58:04.656340+0000","last_fullsized":"2024-05-10T09:58:04.656340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"79'6","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652452+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:58:04.652452+0000","last_peered":"2024-05-10T09:58:04.652452+0000","last_clean":"2024-05-10T09:58:04.652452+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:04.652452+0000","last_undegraded":"2024-05-10T09:58:04.652452+0000","last_fullsized":"2024-05-10T09:58:04.652452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648308+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:58:04.648308+0000","last_peered":"2024-05-10T09:58:04.648308+0000","last_clean":"2024-05-10T09:58:04.648308+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:04.648308+0000","last_undegraded":"2024-05-10T09:58:04.648308+0000","last_fullsized":"2024-05-10T09:58:04.648308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"89'21","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649477+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:58:04.649477+0000","last_peered":"2024-05-10T09:58:04.649477+0000","last_clean":"2024-05-10T09:58:04.649477+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:04.649477+0000","last_undegraded":"2024-05-10T09:58:04.649477+0000","last_fullsized":"2024-05-10T09:58:04.649477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:45.893979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":29,"num_read_kb":71692,"num_write":41,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530949+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:58:04.530949+0000","last_peered":"2024-05-10T09:58:04.530949+0000","last_clean":"2024-05-10T09:58:04.530949+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:04.530949+0000","last_undegraded":"2024-05-10T09:58:04.530949+0000","last_fullsized":"2024-05-10T09:58:04.530949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"89'5","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531779+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:58:04.531779+0000","last_peered":"2024-05-10T09:58:04.531779+0000","last_clean":"2024-05-10T09:58:04.531779+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:58:04.531779+0000","last_undegraded":"2024-05-10T09:58:04.531779+0000","last_fullsized":"2024-05-10T09:58:04.531779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14342,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528181+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:58:04.528181+0000","last_peered":"2024-05-10T09:58:04.528181+0000","last_clean":"2024-05-10T09:58:04.528181+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:04.528181+0000","last_undegraded":"2024-05-10T09:58:04.528181+0000","last_fullsized":"2024-05-10T09:58:04.528181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"79'8","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648027+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:58:04.648027+0000","last_peered":"2024-05-10T09:58:04.648027+0000","last_clean":"2024-05-10T09:58:04.648027+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:04.648027+0000","last_undegraded":"2024-05-10T09:58:04.648027+0000","last_fullsized":"2024-05-10T09:58:04.648027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":145,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528710+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:58:04.528710+0000","last_peered":"2024-05-10T09:58:04.528710+0000","last_clean":"2024-05-10T09:58:04.528710+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:04.528710+0000","last_undegraded":"2024-05-10T09:58:04.528710+0000","last_fullsized":"2024-05-10T09:58:04.528710+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"89'6","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660880+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:58:04.660880+0000","last_peered":"2024-05-10T09:58:04.660880+0000","last_clean":"2024-05-10T09:58:04.660880+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:04.660880+0000","last_undegraded":"2024-05-10T09:58:04.660880+0000","last_fullsized":"2024-05-10T09:58:04.660880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651663+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:58:04.651663+0000","last_peered":"2024-05-10T09:58:04.651663+0000","last_clean":"2024-05-10T09:58:04.651663+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:04.651663+0000","last_undegraded":"2024-05-10T09:58:04.651663+0000","last_fullsized":"2024-05-10T09:58:04.651663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"89'11","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531405+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:58:04.531405+0000","last_peered":"2024-05-10T09:58:04.531405+0000","last_clean":"2024-05-10T09:58:04.531405+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:04.531405+0000","last_undegraded":"2024-05-10T09:58:04.531405+0000","last_fullsized":"2024-05-10T09:58:04.531405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36870,"num_write":21,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653362+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:58:04.653362+0000","last_peered":"2024-05-10T09:58:04.653362+0000","last_clean":"2024-05-10T09:58:04.653362+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:04.653362+0000","last_undegraded":"2024-05-10T09:58:04.653362+0000","last_fullsized":"2024-05-10T09:58:04.653362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651637+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:58:04.651637+0000","last_peered":"2024-05-10T09:58:04.651637+0000","last_clean":"2024-05-10T09:58:04.651637+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:04.651637+0000","last_undegraded":"2024-05-10T09:58:04.651637+0000","last_fullsized":"2024-05-10T09:58:04.651637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":36870,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529866+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:58:04.529866+0000","last_peered":"2024-05-10T09:58:04.529866+0000","last_clean":"2024-05-10T09:58:04.529866+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:04.529866+0000","last_undegraded":"2024-05-10T09:58:04.529866+0000","last_fullsized":"2024-05-10T09:58:04.529866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"89'16","reported_seq":243,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531176+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:58:04.531176+0000","last_peered":"2024-05-10T09:58:04.531176+0000","last_clean":"2024-05-10T09:58:04.531176+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:58:04.531176+0000","last_undegraded":"2024-05-10T09:58:04.531176+0000","last_fullsized":"2024-05-10T09:58:04.531176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527324+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:58:04.527324+0000","last_peered":"2024-05-10T09:58:04.527324+0000","last_clean":"2024-05-10T09:58:04.527324+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:04.527324+0000","last_undegraded":"2024-05-10T09:58:04.527324+0000","last_fullsized":"2024-05-10T09:58:04.527324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:43.044679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652210+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:58:04.652210+0000","last_peered":"2024-05-10T09:58:04.652210+0000","last_clean":"2024-05-10T09:58:04.652210+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:04.652210+0000","last_undegraded":"2024-05-10T09:58:04.652210+0000","last_fullsized":"2024-05-10T09:58:04.652210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32780,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530261+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:58:04.530261+0000","last_peered":"2024-05-10T09:58:04.530261+0000","last_clean":"2024-05-10T09:58:04.530261+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:04.530261+0000","last_undegraded":"2024-05-10T09:58:04.530261+0000","last_fullsized":"2024-05-10T09:58:04.530261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"89'9","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650076+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:58:04.650076+0000","last_peered":"2024-05-10T09:58:04.650076+0000","last_clean":"2024-05-10T09:58:04.650076+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:04.650076+0000","last_undegraded":"2024-05-10T09:58:04.650076+0000","last_fullsized":"2024-05-10T09:58:04.650076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654023+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:58:04.654023+0000","last_peered":"2024-05-10T09:58:04.654023+0000","last_clean":"2024-05-10T09:58:04.654023+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:04.654023+0000","last_undegraded":"2024-05-10T09:58:04.654023+0000","last_fullsized":"2024-05-10T09:58:04.654023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"89'14","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655299+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:58:04.655299+0000","last_peered":"2024-05-10T09:58:04.655299+0000","last_clean":"2024-05-10T09:58:04.655299+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:04.655299+0000","last_undegraded":"2024-05-10T09:58:04.655299+0000","last_fullsized":"2024-05-10T09:58:04.655299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":23,"num_read_kb":36880,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649741+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:58:04.649741+0000","last_peered":"2024-05-10T09:58:04.649741+0000","last_clean":"2024-05-10T09:58:04.649741+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:04.649741+0000","last_undegraded":"2024-05-10T09:58:04.649741+0000","last_fullsized":"2024-05-10T09:58:04.649741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"89'13","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656883+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:58:04.656883+0000","last_peered":"2024-05-10T09:58:04.656883+0000","last_clean":"2024-05-10T09:58:04.656883+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:04.656883+0000","last_undegraded":"2024-05-10T09:58:04.656883+0000","last_fullsized":"2024-05-10T09:58:04.656883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":34834,"num_write":43,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530476+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:58:04.530476+0000","last_peered":"2024-05-10T09:58:04.530476+0000","last_clean":"2024-05-10T09:58:04.530476+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:04.530476+0000","last_undegraded":"2024-05-10T09:58:04.530476+0000","last_fullsized":"2024-05-10T09:58:04.530476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"72'9","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530270+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:58:04.530270+0000","last_peered":"2024-05-10T09:58:04.530270+0000","last_clean":"2024-05-10T09:58:04.530270+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:04.530270+0000","last_undegraded":"2024-05-10T09:58:04.530270+0000","last_fullsized":"2024-05-10T09:58:04.530270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:51.176391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650180+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:58:04.650180+0000","last_peered":"2024-05-10T09:58:04.650180+0000","last_clean":"2024-05-10T09:58:04.650180+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:04.650180+0000","last_undegraded":"2024-05-10T09:58:04.650180+0000","last_fullsized":"2024-05-10T09:58:04.650180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"89'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658360+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:58:04.658360+0000","last_peered":"2024-05-10T09:58:04.658360+0000","last_clean":"2024-05-10T09:58:04.658360+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:04.658360+0000","last_undegraded":"2024-05-10T09:58:04.658360+0000","last_fullsized":"2024-05-10T09:58:04.658360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":36882,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"79'8","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651346+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:58:04.651346+0000","last_peered":"2024-05-10T09:58:04.651346+0000","last_clean":"2024-05-10T09:58:04.651346+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:04.651346+0000","last_undegraded":"2024-05-10T09:58:04.651346+0000","last_fullsized":"2024-05-10T09:58:04.651346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653196+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:58:04.653196+0000","last_peered":"2024-05-10T09:58:04.653196+0000","last_clean":"2024-05-10T09:58:04.653196+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:04.653196+0000","last_undegraded":"2024-05-10T09:58:04.653196+0000","last_fullsized":"2024-05-10T09:58:04.653196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"89'9","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646387+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:58:04.646387+0000","last_peered":"2024-05-10T09:58:04.646387+0000","last_clean":"2024-05-10T09:58:04.646387+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:04.646387+0000","last_undegraded":"2024-05-10T09:58:04.646387+0000","last_fullsized":"2024-05-10T09:58:04.646387+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657058+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:58:04.657058+0000","last_peered":"2024-05-10T09:58:04.657058+0000","last_clean":"2024-05-10T09:58:04.657058+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:04.657058+0000","last_undegraded":"2024-05-10T09:58:04.657058+0000","last_fullsized":"2024-05-10T09:58:04.657058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242916,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":922,"num_read_kb":915,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":622592,"data_stored":230728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1082,"num_read_kb":2003600,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":452980,"kb_used_data":421804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93918860,"statfs":{"total":96636764160,"available":96172912640,"internally_reserved":0,"allocated":431927296,"data_stored":431305753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323332,"kb_used_data":292156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048508,"statfs":{"total":96636764160,"available":96305672192,"internally_reserved":0,"allocated":299167744,"data_stored":298578850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509492,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505668,"kb_used_data":474492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93866172,"statfs":{"total":96636764160,"available":96118960128,"internally_reserved":0,"allocated":485879808,"data_stored":485241465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285583,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508200,"kb_used_data":476444,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":93863640,"statfs":{"total":96636764160,"available":96116367360,"internally_reserved":0,"allocated":487878656,"data_stored":487316023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":538476,"kb_used_data":503140,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93833364,"statfs":{"total":96636764160,"available":96085364736,"internally_reserved":0,"allocated":515215360,"data_stored":514612407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263972,"kb_used_data":228636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94107868,"statfs":{"total":96636764160,"available":96366456832,"internally_reserved":0,"allocated":234123264,"data_stored":233561927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509491,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555420,"kb_used_data":520076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93816420,"statfs":{"total":96636764160,"available":96068014080,"internally_reserved":0,"allocated":532557824,"data_stored":531963325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329620,"kb_used_data":290124,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94042220,"statfs":{"total":96636764160,"available":96299233280,"internally_reserved":0,"allocated":297086976,"data_stored":296483812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":530579456,"data_stored":530579456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":295698432,"data_stored":295698432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":232783872,"data_stored":232783872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":513802240,"data_stored":513802240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":486539264,"data_stored":486539264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":484442112,"data_stored":484442112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":429916160,"data_stored":429916160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":31596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":23865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":16540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":48698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":14205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":37700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":37756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:58:17.231 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T09:58:17.574 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:17.574 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":110,"fsid":"7e1d9b5a-9708-485a-8c63-703e41c4a829","created":"2024-05-10T09:54:13.508887+0000","modified":"2024-05-10T09:58:04.517834+0000","last_up_change":"2024-05-10T09:57:08.584897+0000","last_in_change":"2024-05-10T09:54:15.752492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T09:54:26.214148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-10T09:54:31.575111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-10T09:54:38.369592+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-10T09:54:39.953615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-10T09:54:41.893433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-10T09:54:43.804869+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-10T09:54:45.696998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-10T09:54:47.845498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"897c58ab-70e9-4a8d-b51f-cf9dc6cedd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6801","nonce":3913515164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6803","nonce":3913515164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6807","nonce":3913515164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":3913515164},{"type":"v1","addr":"172.21.15.42:6805","nonce":3913515164}]},"public_addr":"172.21.15.42:6801/3913515164","cluster_addr":"172.21.15.42:6803/3913515164","heartbeat_back_addr":"172.21.15.42:6807/3913515164","heartbeat_front_addr":"172.21.15.42:6805/3913515164","state":["exists","up"]},{"osd":1,"uuid":"fc75a63e-e69c-4efb-89cb-b599f6ded234","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6809","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6811","nonce":2743871003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6813","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6815","nonce":2743871003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6823","nonce":2743871003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6817","nonce":2743871003},{"type":"v1","addr":"172.21.15.42:6819","nonce":2743871003}]},"public_addr":"172.21.15.42:6811/2743871003","cluster_addr":"172.21.15.42:6815/2743871003","heartbeat_back_addr":"172.21.15.42:6823/2743871003","heartbeat_front_addr":"172.21.15.42:6819/2743871003","state":["exists","up"]},{"osd":2,"uuid":"18889f8e-3a4e-4ea7-b9b6-af9547e84e85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6810","nonce":3683869396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6814","nonce":3683869396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6822","nonce":3683869396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":3683869396},{"type":"v1","addr":"172.21.15.42:6818","nonce":3683869396}]},"public_addr":"172.21.15.42:6810/3683869396","cluster_addr":"172.21.15.42:6814/3683869396","heartbeat_back_addr":"172.21.15.42:6822/3683869396","heartbeat_front_addr":"172.21.15.42:6818/3683869396","state":["exists","up"]},{"osd":3,"uuid":"a2720077-7595-48e4-9f86-60cd449b0d90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6825","nonce":125865404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6827","nonce":125865404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6831","nonce":125865404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":125865404},{"type":"v1","addr":"172.21.15.42:6829","nonce":125865404}]},"public_addr":"172.21.15.42:6825/125865404","cluster_addr":"172.21.15.42:6827/125865404","heartbeat_back_addr":"172.21.15.42:6831/125865404","heartbeat_front_addr":"172.21.15.42:6829/125865404","state":["exists","up"]},{"osd":4,"uuid":"c271ae7d-8d4d-46a6-9273-8a52de33dd30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":69,"up_from":83,"up_thru":83,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6825","nonce":3297710412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6827","nonce":3297710412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6831","nonce":3297710412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6828","nonce":3297710412},{"type":"v1","addr":"172.21.15.181:6829","nonce":3297710412}]},"public_addr":"172.21.15.181:6825/3297710412","cluster_addr":"172.21.15.181:6827/3297710412","heartbeat_back_addr":"172.21.15.181:6831/3297710412","heartbeat_front_addr":"172.21.15.181:6829/3297710412","state":["exists","up"]},{"osd":5,"uuid":"8ecc5e1a-33d9-4b73-b70f-aa1035d9e88b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6809","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6812","nonce":893112190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6816","nonce":893112190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6824","nonce":893112190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6819","nonce":893112190},{"type":"v1","addr":"172.21.15.181:6821","nonce":893112190}]},"public_addr":"172.21.15.181:6812/893112190","cluster_addr":"172.21.15.181:6816/893112190","heartbeat_back_addr":"172.21.15.181:6824/893112190","heartbeat_front_addr":"172.21.15.181:6821/893112190","state":["exists","up"]},{"osd":6,"uuid":"6fa08610-ff9d-41d0-af8a-06d46f3388d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6802","nonce":1622048387}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6804","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6807","nonce":1622048387}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6820","nonce":1622048387}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":1622048387},{"type":"v1","addr":"172.21.15.181:6813","nonce":1622048387}]},"public_addr":"172.21.15.181:6802/1622048387","cluster_addr":"172.21.15.181:6807/1622048387","heartbeat_back_addr":"172.21.15.181:6820/1622048387","heartbeat_front_addr":"172.21.15.181:6813/1622048387","state":["exists","up"]},{"osd":7,"uuid":"86869483-0d84-4d13-b78e-3bac8ac2ff03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6801","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6803","nonce":3508953868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6805","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6806","nonce":3508953868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6815","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6818","nonce":3508953868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6808","nonce":3508953868},{"type":"v1","addr":"172.21.15.181:6811","nonce":3508953868}]},"public_addr":"172.21.15.181:6803/3508953868","cluster_addr":"172.21.15.181:6806/3508953868","heartbeat_back_addr":"172.21.15.181:6818/3508953868","heartbeat_front_addr":"172.21.15.181:6811/3508953868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.309797+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:20.776872+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.163014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.344100+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.292805+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.412990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.456741+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T09:54:21.437150+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1b","osds":[1,5]},{"pgid":"7.1","osds":[3,7]}],"pg_upmap_items":[{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.3e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T09:58:18.595 INFO:tasks.ceph:Scrubbing osd.0 2024-05-10T09:58:18.596 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-10T09:58:18.762 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:58:18.763 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T09:58:18.763 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:58:18.780 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-10T09:58:19.077 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2024-05-10T09:58:19.098 INFO:tasks.ceph:Scrubbing osd.1 2024-05-10T09:58:19.098 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-10T09:58:19.241 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:58:19.241 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T09:58:19.241 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:58:19.257 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-10T09:58:19.542 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2024-05-10T09:58:19.560 INFO:tasks.ceph:Scrubbing osd.2 2024-05-10T09:58:19.561 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-10T09:58:19.696 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:58:19.697 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T09:58:19.697 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:58:19.713 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-10T09:58:19.988 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2024-05-10T09:58:20.006 INFO:tasks.ceph:Scrubbing osd.3 2024-05-10T09:58:20.006 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-10T09:58:20.157 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:58:20.157 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T09:58:20.157 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:58:20.172 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-10T09:58:20.449 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2024-05-10T09:58:20.459 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-10T09:58:20.468 INFO:tasks.ceph:Scrubbing osd.4 2024-05-10T09:58:20.468 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-10T09:58:20.611 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:58:20.612 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T09:58:20.612 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:58:20.627 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-10T09:58:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 4 to deep-scrub 2024-05-10T09:58:20.938 INFO:tasks.ceph:Scrubbing osd.5 2024-05-10T09:58:20.939 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-10T09:58:21.094 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:58:21.094 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T09:58:21.094 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:58:21.106 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-10T09:58:21.399 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 5 to deep-scrub 2024-05-10T09:58:21.419 INFO:tasks.ceph:Scrubbing osd.6 2024-05-10T09:58:21.419 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-10T09:58:21.572 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:58:21.572 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T09:58:21.572 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:58:21.589 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-10T09:58:21.885 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 6 to deep-scrub 2024-05-10T09:58:21.904 INFO:tasks.ceph:Scrubbing osd.7 2024-05-10T09:58:21.904 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-10T09:58:22.063 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-10T09:58:22.063 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T09:58:22.063 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-10T09:58:22.080 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-10T09:58:22.379 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 7 to deep-scrub 2024-05-10T09:58:22.398 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:58:22.751 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:22.757 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:58:22.773 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-05-10T09:58:22.273232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723235,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4543,"num_read_kb":2006570,"num_write":3838,"num_write_kb":2050326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2539,"ondisk_log_size":2539,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282732,"kb_used_data":11656,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":754691988,"statfs":{"total":773094113280,"available":772804595712,"internally_reserved":0,"allocated":11935744,"data_stored":7283118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1635890222,"num_objects":-440,"num_object_clones":0,"num_object_copies":-880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-440,"num_whiteouts":0,"num_read":741,"num_read_kb":689,"num_write":568,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006913"},"pg_stats":[{"pgid":"3.3f","version":"110'20","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.927038+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:58:15.927038+0000","last_peered":"2024-05-10T09:58:15.927038+0000","last_clean":"2024-05-10T09:58:15.927038+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:15.927038+0000","last_undegraded":"2024-05-10T09:58:15.927038+0000","last_fullsized":"2024-05-10T09:58:15.927038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:26.704157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":40,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650396+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:58:04.650396+0000","last_peered":"2024-05-10T09:58:04.650396+0000","last_clean":"2024-05-10T09:58:04.650396+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:04.650396+0000","last_undegraded":"2024-05-10T09:58:04.650396+0000","last_fullsized":"2024-05-10T09:58:04.650396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:43:51.013562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'16","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.855134+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:58:15.855134+0000","last_peered":"2024-05-10T09:58:15.855134+0000","last_clean":"2024-05-10T09:58:15.855134+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:15.855134+0000","last_undegraded":"2024-05-10T09:58:15.855134+0000","last_fullsized":"2024-05-10T09:58:15.855134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:11:29.504112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651881+0000","last_change":"2024-05-10T09:54:41.680206+0000","last_active":"2024-05-10T09:58:04.651881+0000","last_peered":"2024-05-10T09:58:04.651881+0000","last_clean":"2024-05-10T09:58:04.651881+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:04.651881+0000","last_undegraded":"2024-05-10T09:58:04.651881+0000","last_fullsized":"2024-05-10T09:58:04.651881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'14","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.872041+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:58:15.872041+0000","last_peered":"2024-05-10T09:58:15.872041+0000","last_clean":"2024-05-10T09:58:15.872041+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:15.872041+0000","last_undegraded":"2024-05-10T09:58:15.872041+0000","last_fullsized":"2024-05-10T09:58:15.872041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28690,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528646+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:58:04.528646+0000","last_peered":"2024-05-10T09:58:04.528646+0000","last_clean":"2024-05-10T09:58:04.528646+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:04.528646+0000","last_undegraded":"2024-05-10T09:58:04.528646+0000","last_fullsized":"2024-05-10T09:58:04.528646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:53:17.848964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'16","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.574806+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:58:15.574806+0000","last_peered":"2024-05-10T09:58:15.574806+0000","last_clean":"2024-05-10T09:58:15.574806+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:15.574806+0000","last_undegraded":"2024-05-10T09:58:15.574806+0000","last_fullsized":"2024-05-10T09:58:15.574806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32792,"num_write":56,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649352+0000","last_change":"2024-05-10T09:54:41.657631+0000","last_active":"2024-05-10T09:58:04.649352+0000","last_peered":"2024-05-10T09:58:04.649352+0000","last_clean":"2024-05-10T09:58:04.649352+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:04.649352+0000","last_undegraded":"2024-05-10T09:58:04.649352+0000","last_fullsized":"2024-05-10T09:58:04.649352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"110'24","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.827475+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:58:15.827475+0000","last_peered":"2024-05-10T09:58:15.827475+0000","last_clean":"2024-05-10T09:58:15.827475+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:15.827475+0000","last_undegraded":"2024-05-10T09:58:15.827475+0000","last_fullsized":"2024-05-10T09:58:15.827475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:03.125317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":43032,"num_write":64,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655633+0000","last_change":"2024-05-10T09:54:41.655705+0000","last_active":"2024-05-10T09:58:04.655633+0000","last_peered":"2024-05-10T09:58:04.655633+0000","last_clean":"2024-05-10T09:58:04.655633+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:04.655633+0000","last_undegraded":"2024-05-10T09:58:04.655633+0000","last_fullsized":"2024-05-10T09:58:04.655633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:48.864401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'18","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.812833+0000","last_change":"2024-05-10T09:54:39.667904+0000","last_active":"2024-05-10T09:58:15.812833+0000","last_peered":"2024-05-10T09:58:15.812833+0000","last_clean":"2024-05-10T09:58:15.812833+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:15.812833+0000","last_undegraded":"2024-05-10T09:58:15.812833+0000","last_fullsized":"2024-05-10T09:58:15.812833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":36876,"num_write":38,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529657+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:58:04.529657+0000","last_peered":"2024-05-10T09:58:04.529657+0000","last_clean":"2024-05-10T09:58:04.529657+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:04.529657+0000","last_undegraded":"2024-05-10T09:58:04.529657+0000","last_fullsized":"2024-05-10T09:58:04.529657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:29:13.813436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'8","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.741580+0000","last_change":"2024-05-10T09:55:19.416478+0000","last_active":"2024-05-10T09:58:15.741580+0000","last_peered":"2024-05-10T09:58:15.741580+0000","last_clean":"2024-05-10T09:58:15.741580+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:15.741580+0000","last_undegraded":"2024-05-10T09:58:15.741580+0000","last_fullsized":"2024-05-10T09:58:15.741580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656752+0000","last_change":"2024-05-10T09:56:20.303771+0000","last_active":"2024-05-10T09:58:04.656752+0000","last_peered":"2024-05-10T09:58:04.656752+0000","last_clean":"2024-05-10T09:58:04.656752+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:04.656752+0000","last_undegraded":"2024-05-10T09:58:04.656752+0000","last_fullsized":"2024-05-10T09:58:04.656752+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:24:18.547498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'12","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.816056+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:58:15.816056+0000","last_peered":"2024-05-10T09:58:15.816056+0000","last_clean":"2024-05-10T09:58:15.816056+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:15.816056+0000","last_undegraded":"2024-05-10T09:58:15.816056+0000","last_fullsized":"2024-05-10T09:58:15.816056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528671+0000","last_change":"2024-05-10T09:54:41.642511+0000","last_active":"2024-05-10T09:58:04.528671+0000","last_peered":"2024-05-10T09:58:04.528671+0000","last_clean":"2024-05-10T09:58:04.528671+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:04.528671+0000","last_undegraded":"2024-05-10T09:58:04.528671+0000","last_fullsized":"2024-05-10T09:58:04.528671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527703+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:58:04.527703+0000","last_peered":"2024-05-10T09:58:04.527703+0000","last_clean":"2024-05-10T09:58:04.527703+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:04.527703+0000","last_undegraded":"2024-05-10T09:58:04.527703+0000","last_fullsized":"2024-05-10T09:58:04.527703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:02:50.699985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"110'12","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.805964+0000","last_change":"2024-05-10T09:54:39.666533+0000","last_active":"2024-05-10T09:58:15.805964+0000","last_peered":"2024-05-10T09:58:15.805964+0000","last_clean":"2024-05-10T09:58:15.805964+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:15.805964+0000","last_undegraded":"2024-05-10T09:58:15.805964+0000","last_fullsized":"2024-05-10T09:58:15.805964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:24:39.914646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652120+0000","last_change":"2024-05-10T09:54:41.680716+0000","last_active":"2024-05-10T09:58:04.652120+0000","last_peered":"2024-05-10T09:58:04.652120+0000","last_clean":"2024-05-10T09:58:04.652120+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:04.652120+0000","last_undegraded":"2024-05-10T09:58:04.652120+0000","last_fullsized":"2024-05-10T09:58:04.652120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'12","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.812219+0000","last_change":"2024-05-10T09:55:19.368504+0000","last_active":"2024-05-10T09:58:15.812219+0000","last_peered":"2024-05-10T09:58:15.812219+0000","last_clean":"2024-05-10T09:58:15.812219+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:15.812219+0000","last_undegraded":"2024-05-10T09:58:15.812219+0000","last_fullsized":"2024-05-10T09:58:15.812219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:19.451154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651965+0000","last_change":"2024-05-10T09:54:41.658936+0000","last_active":"2024-05-10T09:58:04.651965+0000","last_peered":"2024-05-10T09:58:04.651965+0000","last_clean":"2024-05-10T09:58:04.651965+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:04.651965+0000","last_undegraded":"2024-05-10T09:58:04.651965+0000","last_fullsized":"2024-05-10T09:58:04.651965+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'10","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.707048+0000","last_change":"2024-05-10T09:54:39.666757+0000","last_active":"2024-05-10T09:58:15.707048+0000","last_peered":"2024-05-10T09:58:15.707048+0000","last_clean":"2024-05-10T09:58:15.707048+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:15.707048+0000","last_undegraded":"2024-05-10T09:58:15.707048+0000","last_fullsized":"2024-05-10T09:58:15.707048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530570+0000","last_change":"2024-05-10T09:54:41.644312+0000","last_active":"2024-05-10T09:58:04.530570+0000","last_peered":"2024-05-10T09:58:04.530570+0000","last_clean":"2024-05-10T09:58:04.530570+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:04.530570+0000","last_undegraded":"2024-05-10T09:58:04.530570+0000","last_fullsized":"2024-05-10T09:58:04.530570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"110'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.736170+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:58:15.736170+0000","last_peered":"2024-05-10T09:58:15.736170+0000","last_clean":"2024-05-10T09:58:15.736170+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:15.736170+0000","last_undegraded":"2024-05-10T09:58:15.736170+0000","last_fullsized":"2024-05-10T09:58:15.736170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:23:51.907175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":61452,"num_write":54,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526398+0000","last_change":"2024-05-10T09:57:10.021508+0000","last_active":"2024-05-10T09:58:04.526398+0000","last_peered":"2024-05-10T09:58:04.526398+0000","last_clean":"2024-05-10T09:58:04.526398+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:04.526398+0000","last_undegraded":"2024-05-10T09:58:04.526398+0000","last_fullsized":"2024-05-10T09:58:04.526398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'8","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.688949+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:58:15.688949+0000","last_peered":"2024-05-10T09:58:15.688949+0000","last_clean":"2024-05-10T09:58:15.688949+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:15.688949+0000","last_undegraded":"2024-05-10T09:58:15.688949+0000","last_fullsized":"2024-05-10T09:58:15.688949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:34:33.680714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529511+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:58:04.529511+0000","last_peered":"2024-05-10T09:58:04.529511+0000","last_clean":"2024-05-10T09:58:04.529511+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:04.529511+0000","last_undegraded":"2024-05-10T09:58:04.529511+0000","last_fullsized":"2024-05-10T09:58:04.529511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:53:41.541872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"110'18","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.962248+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:58:15.962248+0000","last_peered":"2024-05-10T09:58:15.962248+0000","last_clean":"2024-05-10T09:58:15.962248+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:15.962248+0000","last_undegraded":"2024-05-10T09:58:15.962248+0000","last_fullsized":"2024-05-10T09:58:15.962248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30720,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528133+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:58:04.528133+0000","last_peered":"2024-05-10T09:58:04.528133+0000","last_clean":"2024-05-10T09:58:04.528133+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:04.528133+0000","last_undegraded":"2024-05-10T09:58:04.528133+0000","last_fullsized":"2024-05-10T09:58:04.528133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:23.097430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530920+0000","last_change":"2024-05-10T09:54:41.676545+0000","last_active":"2024-05-10T09:58:04.530920+0000","last_peered":"2024-05-10T09:58:04.530920+0000","last_clean":"2024-05-10T09:58:04.530920+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:04.530920+0000","last_undegraded":"2024-05-10T09:58:04.530920+0000","last_fullsized":"2024-05-10T09:58:04.530920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:12.221602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"110'16","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.834317+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:58:15.834317+0000","last_peered":"2024-05-10T09:58:15.834317+0000","last_clean":"2024-05-10T09:58:15.834317+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:15.834317+0000","last_undegraded":"2024-05-10T09:58:15.834317+0000","last_fullsized":"2024-05-10T09:58:15.834317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:40:26.289740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":18442,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655953+0000","last_change":"2024-05-10T09:54:43.669732+0000","last_active":"2024-05-10T09:58:04.655953+0000","last_peered":"2024-05-10T09:58:04.655953+0000","last_clean":"2024-05-10T09:58:04.655953+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:04.655953+0000","last_undegraded":"2024-05-10T09:58:04.655953+0000","last_fullsized":"2024-05-10T09:58:04.655953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:25:58.552324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'18","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.665104+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:58:15.665104+0000","last_peered":"2024-05-10T09:58:15.665104+0000","last_clean":"2024-05-10T09:58:15.665104+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:15.665104+0000","last_undegraded":"2024-05-10T09:58:15.665104+0000","last_fullsized":"2024-05-10T09:58:15.665104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655116+0000","last_change":"2024-05-10T09:54:47.703218+0000","last_active":"2024-05-10T09:58:04.655116+0000","last_peered":"2024-05-10T09:58:04.655116+0000","last_clean":"2024-05-10T09:58:04.655116+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:04.655116+0000","last_undegraded":"2024-05-10T09:58:04.655116+0000","last_fullsized":"2024-05-10T09:58:04.655116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:45.925364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650200+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:58:04.650200+0000","last_peered":"2024-05-10T09:58:04.650200+0000","last_clean":"2024-05-10T09:58:04.650200+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:04.650200+0000","last_undegraded":"2024-05-10T09:58:04.650200+0000","last_fullsized":"2024-05-10T09:58:04.650200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:58:47.004118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657074+0000","last_change":"2024-05-10T09:54:41.673678+0000","last_active":"2024-05-10T09:58:04.657074+0000","last_peered":"2024-05-10T09:58:04.657074+0000","last_clean":"2024-05-10T09:58:04.657074+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:04.657074+0000","last_undegraded":"2024-05-10T09:58:04.657074+0000","last_fullsized":"2024-05-10T09:58:04.657074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:43.080846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'18","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.857188+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:58:15.857188+0000","last_peered":"2024-05-10T09:58:15.857188+0000","last_clean":"2024-05-10T09:58:15.857188+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:15.857188+0000","last_undegraded":"2024-05-10T09:58:15.857188+0000","last_fullsized":"2024-05-10T09:58:15.857188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530366+0000","last_change":"2024-05-10T09:54:43.654597+0000","last_active":"2024-05-10T09:58:04.530366+0000","last_peered":"2024-05-10T09:58:04.530366+0000","last_clean":"2024-05-10T09:58:04.530366+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:04.530366+0000","last_undegraded":"2024-05-10T09:58:04.530366+0000","last_fullsized":"2024-05-10T09:58:04.530366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:33.126355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":93,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530616+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:58:04.530616+0000","last_peered":"2024-05-10T09:58:04.530616+0000","last_clean":"2024-05-10T09:58:04.530616+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:04.530616+0000","last_undegraded":"2024-05-10T09:58:04.530616+0000","last_fullsized":"2024-05-10T09:58:04.530616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:24.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530644+0000","last_change":"2024-05-10T09:57:09.655404+0000","last_active":"2024-05-10T09:58:04.530644+0000","last_peered":"2024-05-10T09:58:04.530644+0000","last_clean":"2024-05-10T09:58:04.530644+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:04.530644+0000","last_undegraded":"2024-05-10T09:58:04.530644+0000","last_fullsized":"2024-05-10T09:58:04.530644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:47.571812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650111+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:58:04.650111+0000","last_peered":"2024-05-10T09:58:04.650111+0000","last_clean":"2024-05-10T09:58:04.650111+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:04.650111+0000","last_undegraded":"2024-05-10T09:58:04.650111+0000","last_fullsized":"2024-05-10T09:58:04.650111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652930+0000","last_change":"2024-05-10T09:54:41.656760+0000","last_active":"2024-05-10T09:58:04.652930+0000","last_peered":"2024-05-10T09:58:04.652930+0000","last_clean":"2024-05-10T09:58:04.652930+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:04.652930+0000","last_undegraded":"2024-05-10T09:58:04.652930+0000","last_fullsized":"2024-05-10T09:58:04.652930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'20","reported_seq":244,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.708459+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:58:15.708459+0000","last_peered":"2024-05-10T09:58:15.708459+0000","last_clean":"2024-05-10T09:58:15.708459+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:15.708459+0000","last_undegraded":"2024-05-10T09:58:15.708459+0000","last_fullsized":"2024-05-10T09:58:15.708459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:55.859697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":34834,"num_write":50,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.532396+0000","last_change":"2024-05-10T09:54:43.664699+0000","last_active":"2024-05-10T09:58:04.532396+0000","last_peered":"2024-05-10T09:58:04.532396+0000","last_clean":"2024-05-10T09:58:04.532396+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:04.532396+0000","last_undegraded":"2024-05-10T09:58:04.532396+0000","last_fullsized":"2024-05-10T09:58:04.532396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:01.845432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525771+0000","last_change":"2024-05-10T09:57:09.635203+0000","last_active":"2024-05-10T09:58:04.525771+0000","last_peered":"2024-05-10T09:58:04.525771+0000","last_clean":"2024-05-10T09:58:04.525771+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:04.525771+0000","last_undegraded":"2024-05-10T09:58:04.525771+0000","last_fullsized":"2024-05-10T09:58:04.525771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'18","reported_seq":238,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.253642+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:58:15.253642+0000","last_peered":"2024-05-10T09:58:15.253642+0000","last_clean":"2024-05-10T09:58:15.253642+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:15.253642+0000","last_undegraded":"2024-05-10T09:58:15.253642+0000","last_fullsized":"2024-05-10T09:58:15.253642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:07.279124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529188+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:58:04.529188+0000","last_peered":"2024-05-10T09:58:04.529188+0000","last_clean":"2024-05-10T09:58:04.529188+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:04.529188+0000","last_undegraded":"2024-05-10T09:58:04.529188+0000","last_fullsized":"2024-05-10T09:58:04.529188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:52:41.668471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531253+0000","last_change":"2024-05-10T09:54:41.664282+0000","last_active":"2024-05-10T09:58:04.531253+0000","last_peered":"2024-05-10T09:58:04.531253+0000","last_clean":"2024-05-10T09:58:04.531253+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:04.531253+0000","last_undegraded":"2024-05-10T09:58:04.531253+0000","last_fullsized":"2024-05-10T09:58:04.531253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:47.990901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'18","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.847607+0000","last_change":"2024-05-10T09:54:39.633471+0000","last_active":"2024-05-10T09:58:15.847607+0000","last_peered":"2024-05-10T09:58:15.847607+0000","last_clean":"2024-05-10T09:58:15.847607+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:15.847607+0000","last_undegraded":"2024-05-10T09:58:15.847607+0000","last_fullsized":"2024-05-10T09:58:15.847607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656656+0000","last_change":"2024-05-10T09:54:43.665717+0000","last_active":"2024-05-10T09:58:04.656656+0000","last_peered":"2024-05-10T09:58:04.656656+0000","last_clean":"2024-05-10T09:58:04.656656+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:04.656656+0000","last_undegraded":"2024-05-10T09:58:04.656656+0000","last_fullsized":"2024-05-10T09:58:04.656656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:13.514554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'17","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.597965+0000","last_change":"2024-05-10T09:54:46.140790+0000","last_active":"2024-05-10T09:58:15.597965+0000","last_peered":"2024-05-10T09:58:15.597965+0000","last_clean":"2024-05-10T09:58:15.597965+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:15.597965+0000","last_undegraded":"2024-05-10T09:58:15.597965+0000","last_fullsized":"2024-05-10T09:58:15.597965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:36.256415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"110'18","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.258273+0000","last_change":"2024-05-10T09:54:47.717753+0000","last_active":"2024-05-10T09:58:15.258273+0000","last_peered":"2024-05-10T09:58:15.258273+0000","last_clean":"2024-05-10T09:58:15.258273+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:15.258273+0000","last_undegraded":"2024-05-10T09:58:15.258273+0000","last_fullsized":"2024-05-10T09:58:15.258273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:23.803642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651101+0000","last_change":"2024-05-10T09:54:41.676990+0000","last_active":"2024-05-10T09:58:04.651101+0000","last_peered":"2024-05-10T09:58:04.651101+0000","last_clean":"2024-05-10T09:58:04.651101+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:04.651101+0000","last_undegraded":"2024-05-10T09:58:04.651101+0000","last_fullsized":"2024-05-10T09:58:04.651101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'12","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.634563+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:58:15.634563+0000","last_peered":"2024-05-10T09:58:15.634563+0000","last_clean":"2024-05-10T09:58:15.634563+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:15.634563+0000","last_undegraded":"2024-05-10T09:58:15.634563+0000","last_fullsized":"2024-05-10T09:58:15.634563+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:18.619316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":18444,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651083+0000","last_change":"2024-05-10T09:54:43.661225+0000","last_active":"2024-05-10T09:58:04.651083+0000","last_peered":"2024-05-10T09:58:04.651083+0000","last_clean":"2024-05-10T09:58:04.651083+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:04.651083+0000","last_undegraded":"2024-05-10T09:58:04.651083+0000","last_fullsized":"2024-05-10T09:58:04.651083+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:16.663303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'27","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.723843+0000","last_change":"2024-05-10T09:54:46.137020+0000","last_active":"2024-05-10T09:58:15.723843+0000","last_peered":"2024-05-10T09:58:15.723843+0000","last_clean":"2024-05-10T09:58:15.723843+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:15.723843+0000","last_undegraded":"2024-05-10T09:58:15.723843+0000","last_fullsized":"2024-05-10T09:58:15.723843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647210+0000","last_change":"2024-05-10T09:54:47.706365+0000","last_active":"2024-05-10T09:58:04.647210+0000","last_peered":"2024-05-10T09:58:04.647210+0000","last_clean":"2024-05-10T09:58:04.647210+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:04.647210+0000","last_undegraded":"2024-05-10T09:58:04.647210+0000","last_fullsized":"2024-05-10T09:58:04.647210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:51:08.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653582+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:58:04.653582+0000","last_peered":"2024-05-10T09:58:04.653582+0000","last_clean":"2024-05-10T09:58:04.653582+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:04.653582+0000","last_undegraded":"2024-05-10T09:58:04.653582+0000","last_fullsized":"2024-05-10T09:58:04.653582+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:46.098539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527921+0000","last_change":"2024-05-10T09:57:09.671141+0000","last_active":"2024-05-10T09:58:04.527921+0000","last_peered":"2024-05-10T09:58:04.527921+0000","last_clean":"2024-05-10T09:58:04.527921+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:04.527921+0000","last_undegraded":"2024-05-10T09:58:04.527921+0000","last_fullsized":"2024-05-10T09:58:04.527921+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:57:17.218878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'20","reported_seq":242,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.860865+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:58:15.860865+0000","last_peered":"2024-05-10T09:58:15.860865+0000","last_clean":"2024-05-10T09:58:15.860865+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:15.860865+0000","last_undegraded":"2024-05-10T09:58:15.860865+0000","last_fullsized":"2024-05-10T09:58:15.860865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:53.241239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38930,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525152+0000","last_change":"2024-05-10T09:54:43.660243+0000","last_active":"2024-05-10T09:58:04.525152+0000","last_peered":"2024-05-10T09:58:04.525152+0000","last_clean":"2024-05-10T09:58:04.525152+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:04.525152+0000","last_undegraded":"2024-05-10T09:58:04.525152+0000","last_fullsized":"2024-05-10T09:58:04.525152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'19","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.965891+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:58:15.965891+0000","last_peered":"2024-05-10T09:58:15.965891+0000","last_clean":"2024-05-10T09:58:15.965891+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:15.965891+0000","last_undegraded":"2024-05-10T09:58:15.965891+0000","last_fullsized":"2024-05-10T09:58:15.965891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:10.508906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527842+0000","last_change":"2024-05-10T09:54:47.718755+0000","last_active":"2024-05-10T09:58:04.527842+0000","last_peered":"2024-05-10T09:58:04.527842+0000","last_clean":"2024-05-10T09:58:04.527842+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:04.527842+0000","last_undegraded":"2024-05-10T09:58:04.527842+0000","last_fullsized":"2024-05-10T09:58:04.527842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:52.897838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660834+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:58:04.660834+0000","last_peered":"2024-05-10T09:58:04.660834+0000","last_clean":"2024-05-10T09:58:04.660834+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:04.660834+0000","last_undegraded":"2024-05-10T09:58:04.660834+0000","last_fullsized":"2024-05-10T09:58:04.660834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:23.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655192+0000","last_change":"2024-05-10T09:54:41.682071+0000","last_active":"2024-05-10T09:58:04.655192+0000","last_peered":"2024-05-10T09:58:04.655192+0000","last_clean":"2024-05-10T09:58:04.655192+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:04.655192+0000","last_undegraded":"2024-05-10T09:58:04.655192+0000","last_fullsized":"2024-05-10T09:58:04.655192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:16.313637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'16","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.859971+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:58:15.859971+0000","last_peered":"2024-05-10T09:58:15.859971+0000","last_clean":"2024-05-10T09:58:15.859971+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:15.859971+0000","last_undegraded":"2024-05-10T09:58:15.859971+0000","last_fullsized":"2024-05-10T09:58:15.859971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528087+0000","last_change":"2024-05-10T09:54:43.660763+0000","last_active":"2024-05-10T09:58:04.528087+0000","last_peered":"2024-05-10T09:58:04.528087+0000","last_clean":"2024-05-10T09:58:04.528087+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:04.528087+0000","last_undegraded":"2024-05-10T09:58:04.528087+0000","last_fullsized":"2024-05-10T09:58:04.528087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'23","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.768459+0000","last_change":"2024-05-10T09:54:45.682815+0000","last_active":"2024-05-10T09:58:15.768459+0000","last_peered":"2024-05-10T09:58:15.768459+0000","last_clean":"2024-05-10T09:58:15.768459+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:15.768459+0000","last_undegraded":"2024-05-10T09:58:15.768459+0000","last_fullsized":"2024-05-10T09:58:15.768459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:00.558887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'18","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.985389+0000","last_change":"2024-05-10T09:54:47.693613+0000","last_active":"2024-05-10T09:58:15.985389+0000","last_peered":"2024-05-10T09:58:15.985389+0000","last_clean":"2024-05-10T09:58:15.985389+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:15.985389+0000","last_undegraded":"2024-05-10T09:58:15.985389+0000","last_fullsized":"2024-05-10T09:58:15.985389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652597+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:58:04.652597+0000","last_peered":"2024-05-10T09:58:04.652597+0000","last_clean":"2024-05-10T09:58:04.652597+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:04.652597+0000","last_undegraded":"2024-05-10T09:58:04.652597+0000","last_fullsized":"2024-05-10T09:58:04.652597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651324+0000","last_change":"2024-05-10T09:54:41.668144+0000","last_active":"2024-05-10T09:58:04.651324+0000","last_peered":"2024-05-10T09:58:04.651324+0000","last_clean":"2024-05-10T09:58:04.651324+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:04.651324+0000","last_undegraded":"2024-05-10T09:58:04.651324+0000","last_fullsized":"2024-05-10T09:58:04.651324+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'24","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.910123+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:58:15.910123+0000","last_peered":"2024-05-10T09:58:15.910123+0000","last_clean":"2024-05-10T09:58:15.910123+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:15.910123+0000","last_undegraded":"2024-05-10T09:58:15.910123+0000","last_fullsized":"2024-05-10T09:58:15.910123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":49170,"num_write":54,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526286+0000","last_change":"2024-05-10T09:57:09.626268+0000","last_active":"2024-05-10T09:58:04.526286+0000","last_peered":"2024-05-10T09:58:04.526286+0000","last_clean":"2024-05-10T09:58:04.526286+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:04.526286+0000","last_undegraded":"2024-05-10T09:58:04.526286+0000","last_fullsized":"2024-05-10T09:58:04.526286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'32","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.792476+0000","last_change":"2024-05-10T09:54:45.686894+0000","last_active":"2024-05-10T09:58:15.792476+0000","last_peered":"2024-05-10T09:58:15.792476+0000","last_clean":"2024-05-10T09:58:15.792476+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:15.792476+0000","last_undegraded":"2024-05-10T09:58:15.792476+0000","last_fullsized":"2024-05-10T09:58:15.792476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":59,"num_read_kb":98,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.524955+0000","last_change":"2024-05-10T09:54:47.702581+0000","last_active":"2024-05-10T09:58:04.524955+0000","last_peered":"2024-05-10T09:58:04.524955+0000","last_clean":"2024-05-10T09:58:04.524955+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:04.524955+0000","last_undegraded":"2024-05-10T09:58:04.524955+0000","last_fullsized":"2024-05-10T09:58:04.524955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646874+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:58:04.646874+0000","last_peered":"2024-05-10T09:58:04.646874+0000","last_clean":"2024-05-10T09:58:04.646874+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:04.646874+0000","last_undegraded":"2024-05-10T09:58:04.646874+0000","last_fullsized":"2024-05-10T09:58:04.646874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:13:36.130523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529824+0000","last_change":"2024-05-10T09:57:09.658983+0000","last_active":"2024-05-10T09:58:04.529824+0000","last_peered":"2024-05-10T09:58:04.529824+0000","last_clean":"2024-05-10T09:58:04.529824+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:04.529824+0000","last_undegraded":"2024-05-10T09:58:04.529824+0000","last_fullsized":"2024-05-10T09:58:04.529824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:02:38.327064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'14","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.746948+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:58:15.746948+0000","last_peered":"2024-05-10T09:58:15.746948+0000","last_clean":"2024-05-10T09:58:15.746948+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:15.746948+0000","last_undegraded":"2024-05-10T09:58:15.746948+0000","last_fullsized":"2024-05-10T09:58:15.746948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28696,"num_write":54,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526733+0000","last_change":"2024-05-10T09:54:43.660535+0000","last_active":"2024-05-10T09:58:04.526733+0000","last_peered":"2024-05-10T09:58:04.526733+0000","last_clean":"2024-05-10T09:58:04.526733+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:04.526733+0000","last_undegraded":"2024-05-10T09:58:04.526733+0000","last_fullsized":"2024-05-10T09:58:04.526733+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'23","reported_seq":122,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.467426+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:58:15.467426+0000","last_peered":"2024-05-10T09:58:15.467426+0000","last_clean":"2024-05-10T09:58:15.467426+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:15.467426+0000","last_undegraded":"2024-05-10T09:58:15.467426+0000","last_fullsized":"2024-05-10T09:58:15.467426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:18:46.957809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":62,"num_write":32,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:19.097639+0000","last_change":"2024-05-10T09:58:19.097693+0000","last_active":"2024-05-10T09:58:19.097639+0000","last_peered":"2024-05-10T09:58:19.097639+0000","last_clean":"2024-05-10T09:58:19.097639+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:19.097639+0000","last_undegraded":"2024-05-10T09:58:19.097639+0000","last_fullsized":"2024-05-10T09:58:19.097639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:19.097509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:19.097509+0000","last_clean_scrub_stamp":"2024-05-10T09:58:19.097509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.252931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.525936+0000","last_change":"2024-05-10T09:54:49.731554+0000","last_active":"2024-05-10T09:58:04.525936+0000","last_peered":"2024-05-10T09:58:04.525936+0000","last_clean":"2024-05-10T09:58:04.525936+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:04.525936+0000","last_undegraded":"2024-05-10T09:58:04.525936+0000","last_fullsized":"2024-05-10T09:58:04.525936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:58:34.371723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529936+0000","last_change":"2024-05-10T09:57:09.651608+0000","last_active":"2024-05-10T09:58:04.529936+0000","last_peered":"2024-05-10T09:58:04.529936+0000","last_clean":"2024-05-10T09:58:04.529936+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:04.529936+0000","last_undegraded":"2024-05-10T09:58:04.529936+0000","last_fullsized":"2024-05-10T09:58:04.529936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:08:01.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'12","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.822580+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:58:15.822580+0000","last_peered":"2024-05-10T09:58:15.822580+0000","last_clean":"2024-05-10T09:58:15.822580+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:15.822580+0000","last_undegraded":"2024-05-10T09:58:15.822580+0000","last_fullsized":"2024-05-10T09:58:15.822580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:36.370898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646639+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:58:04.646639+0000","last_peered":"2024-05-10T09:58:04.646639+0000","last_clean":"2024-05-10T09:58:04.646639+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:04.646639+0000","last_undegraded":"2024-05-10T09:58:04.646639+0000","last_fullsized":"2024-05-10T09:58:04.646639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:57.937602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'26","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.928542+0000","last_change":"2024-05-10T09:54:45.672906+0000","last_active":"2024-05-10T09:58:15.928542+0000","last_peered":"2024-05-10T09:58:15.928542+0000","last_clean":"2024-05-10T09:58:15.928542+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:15.928542+0000","last_undegraded":"2024-05-10T09:58:15.928542+0000","last_fullsized":"2024-05-10T09:58:15.928542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":68,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'18","reported_seq":255,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.978856+0000","last_change":"2024-05-10T09:54:47.697099+0000","last_active":"2024-05-10T09:58:15.978856+0000","last_peered":"2024-05-10T09:58:15.978856+0000","last_clean":"2024-05-10T09:58:15.978856+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:15.978856+0000","last_undegraded":"2024-05-10T09:58:15.978856+0000","last_fullsized":"2024-05-10T09:58:15.978856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648186+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:58:04.648186+0000","last_peered":"2024-05-10T09:58:04.648186+0000","last_clean":"2024-05-10T09:58:04.648186+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:04.648186+0000","last_undegraded":"2024-05-10T09:58:04.648186+0000","last_fullsized":"2024-05-10T09:58:04.648186+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:45.394002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530492+0000","last_change":"2024-05-10T09:57:09.656479+0000","last_active":"2024-05-10T09:58:04.530492+0000","last_peered":"2024-05-10T09:58:04.530492+0000","last_clean":"2024-05-10T09:58:04.530492+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:04.530492+0000","last_undegraded":"2024-05-10T09:58:04.530492+0000","last_fullsized":"2024-05-10T09:58:04.530492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:27:37.565901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'6","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.691288+0000","last_change":"2024-05-10T09:57:09.879301+0000","last_active":"2024-05-10T09:58:15.691288+0000","last_peered":"2024-05-10T09:58:15.691288+0000","last_clean":"2024-05-10T09:58:15.691288+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:15.691288+0000","last_undegraded":"2024-05-10T09:58:15.691288+0000","last_fullsized":"2024-05-10T09:58:15.691288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:03.679899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.217710+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:58:15.217710+0000","last_peered":"2024-05-10T09:58:15.217710+0000","last_clean":"2024-05-10T09:58:15.217710+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:15.217710+0000","last_undegraded":"2024-05-10T09:58:15.217710+0000","last_fullsized":"2024-05-10T09:58:15.217710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:02.122541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528642+0000","last_change":"2024-05-10T09:54:46.137009+0000","last_active":"2024-05-10T09:58:04.528642+0000","last_peered":"2024-05-10T09:58:04.528642+0000","last_clean":"2024-05-10T09:58:04.528642+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:04.528642+0000","last_undegraded":"2024-05-10T09:58:04.528642+0000","last_fullsized":"2024-05-10T09:58:04.528642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'18","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.257815+0000","last_change":"2024-05-10T09:54:47.702833+0000","last_active":"2024-05-10T09:58:15.257815+0000","last_peered":"2024-05-10T09:58:15.257815+0000","last_clean":"2024-05-10T09:58:15.257815+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:15.257815+0000","last_undegraded":"2024-05-10T09:58:15.257815+0000","last_fullsized":"2024-05-10T09:58:15.257815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:49.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528502+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:58:04.528502+0000","last_peered":"2024-05-10T09:58:04.528502+0000","last_clean":"2024-05-10T09:58:04.528502+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:04.528502+0000","last_undegraded":"2024-05-10T09:58:04.528502+0000","last_fullsized":"2024-05-10T09:58:04.528502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:09:33.784963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647951+0000","last_change":"2024-05-10T09:54:41.673442+0000","last_active":"2024-05-10T09:58:04.647951+0000","last_peered":"2024-05-10T09:58:04.647951+0000","last_clean":"2024-05-10T09:58:04.647951+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:04.647951+0000","last_undegraded":"2024-05-10T09:58:04.647951+0000","last_fullsized":"2024-05-10T09:58:04.647951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:59:29.920252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.909687+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:58:15.909687+0000","last_peered":"2024-05-10T09:58:15.909687+0000","last_clean":"2024-05-10T09:58:15.909687+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:15.909687+0000","last_undegraded":"2024-05-10T09:58:15.909687+0000","last_fullsized":"2024-05-10T09:58:15.909687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530226+0000","last_change":"2024-05-10T09:57:09.648184+0000","last_active":"2024-05-10T09:58:04.530226+0000","last_peered":"2024-05-10T09:58:04.530226+0000","last_clean":"2024-05-10T09:58:04.530226+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:04.530226+0000","last_undegraded":"2024-05-10T09:58:04.530226+0000","last_fullsized":"2024-05-10T09:58:04.530226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:06.111468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'28","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.680109+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:58:15.680109+0000","last_peered":"2024-05-10T09:58:15.680109+0000","last_clean":"2024-05-10T09:58:15.680109+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:15.680109+0000","last_undegraded":"2024-05-10T09:58:15.680109+0000","last_fullsized":"2024-05-10T09:58:15.680109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":60,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652778+0000","last_change":"2024-05-10T09:54:47.718276+0000","last_active":"2024-05-10T09:58:04.652778+0000","last_peered":"2024-05-10T09:58:04.652778+0000","last_clean":"2024-05-10T09:58:04.652778+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:04.652778+0000","last_undegraded":"2024-05-10T09:58:04.652778+0000","last_fullsized":"2024-05-10T09:58:04.652778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:20.689885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646928+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:58:04.646928+0000","last_peered":"2024-05-10T09:58:04.646928+0000","last_clean":"2024-05-10T09:58:04.646928+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:04.646928+0000","last_undegraded":"2024-05-10T09:58:04.646928+0000","last_fullsized":"2024-05-10T09:58:04.646928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:47.567809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":238,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656709+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:58:04.656709+0000","last_peered":"2024-05-10T09:58:04.656709+0000","last_clean":"2024-05-10T09:58:04.656709+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:04.656709+0000","last_undegraded":"2024-05-10T09:58:04.656709+0000","last_fullsized":"2024-05-10T09:58:04.656709+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:25:40.526481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":285,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651075+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:58:04.651075+0000","last_peered":"2024-05-10T09:58:04.651075+0000","last_clean":"2024-05-10T09:58:04.651075+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:04.651075+0000","last_undegraded":"2024-05-10T09:58:04.651075+0000","last_fullsized":"2024-05-10T09:58:04.651075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:38.065091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651354+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:58:04.651354+0000","last_peered":"2024-05-10T09:58:04.651354+0000","last_clean":"2024-05-10T09:58:04.651354+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:04.651354+0000","last_undegraded":"2024-05-10T09:58:04.651354+0000","last_fullsized":"2024-05-10T09:58:04.651354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.895695+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:58:15.895695+0000","last_peered":"2024-05-10T09:58:15.895695+0000","last_clean":"2024-05-10T09:58:15.895695+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:15.895695+0000","last_undegraded":"2024-05-10T09:58:15.895695+0000","last_fullsized":"2024-05-10T09:58:15.895695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:40.740161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657379+0000","last_change":"2024-05-10T09:54:43.672980+0000","last_active":"2024-05-10T09:58:04.657379+0000","last_peered":"2024-05-10T09:58:04.657379+0000","last_clean":"2024-05-10T09:58:04.657379+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:04.657379+0000","last_undegraded":"2024-05-10T09:58:04.657379+0000","last_fullsized":"2024-05-10T09:58:04.657379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:48:45.093977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'43","reported_seq":237,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.888289+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:58:15.888289+0000","last_peered":"2024-05-10T09:58:15.888289+0000","last_clean":"2024-05-10T09:58:15.888289+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:15.888289+0000","last_undegraded":"2024-05-10T09:58:15.888289+0000","last_fullsized":"2024-05-10T09:58:15.888289+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":125,"num_write":52,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652571+0000","last_change":"2024-05-10T09:54:47.702687+0000","last_active":"2024-05-10T09:58:04.652571+0000","last_peered":"2024-05-10T09:58:04.652571+0000","last_clean":"2024-05-10T09:58:04.652571+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:04.652571+0000","last_undegraded":"2024-05-10T09:58:04.652571+0000","last_fullsized":"2024-05-10T09:58:04.652571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651894+0000","last_change":"2024-05-10T09:54:49.716915+0000","last_active":"2024-05-10T09:58:04.651894+0000","last_peered":"2024-05-10T09:58:04.651894+0000","last_clean":"2024-05-10T09:58:04.651894+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:04.651894+0000","last_undegraded":"2024-05-10T09:58:04.651894+0000","last_fullsized":"2024-05-10T09:58:04.651894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:10.492578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652825+0000","last_change":"2024-05-10T09:54:41.668716+0000","last_active":"2024-05-10T09:58:04.652825+0000","last_peered":"2024-05-10T09:58:04.652825+0000","last_clean":"2024-05-10T09:58:04.652825+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:04.652825+0000","last_undegraded":"2024-05-10T09:58:04.652825+0000","last_fullsized":"2024-05-10T09:58:04.652825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650560+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:58:04.650560+0000","last_peered":"2024-05-10T09:58:04.650560+0000","last_clean":"2024-05-10T09:58:04.650560+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:04.650560+0000","last_undegraded":"2024-05-10T09:58:04.650560+0000","last_fullsized":"2024-05-10T09:58:04.650560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:06:05.474626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'24","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.861116+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:58:15.861116+0000","last_peered":"2024-05-10T09:58:15.861116+0000","last_clean":"2024-05-10T09:58:15.861116+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:15.861116+0000","last_undegraded":"2024-05-10T09:58:15.861116+0000","last_fullsized":"2024-05-10T09:58:15.861116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":45056,"num_write":24,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658097+0000","last_change":"2024-05-10T09:54:43.667727+0000","last_active":"2024-05-10T09:58:04.658097+0000","last_peered":"2024-05-10T09:58:04.658097+0000","last_clean":"2024-05-10T09:58:04.658097+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:04.658097+0000","last_undegraded":"2024-05-10T09:58:04.658097+0000","last_fullsized":"2024-05-10T09:58:04.658097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:34.249852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'66","reported_seq":311,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.693490+0000","last_change":"2024-05-10T09:54:45.684346+0000","last_active":"2024-05-10T09:58:15.693490+0000","last_peered":"2024-05-10T09:58:15.693490+0000","last_clean":"2024-05-10T09:58:15.693490+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:15.693490+0000","last_undegraded":"2024-05-10T09:58:15.693490+0000","last_fullsized":"2024-05-10T09:58:15.693490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:08:04.000862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":112,"num_read_kb":160,"num_write":66,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654776+0000","last_change":"2024-05-10T09:54:47.705292+0000","last_active":"2024-05-10T09:58:04.654776+0000","last_peered":"2024-05-10T09:58:04.654776+0000","last_clean":"2024-05-10T09:58:04.654776+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:04.654776+0000","last_undegraded":"2024-05-10T09:58:04.654776+0000","last_fullsized":"2024-05-10T09:58:04.654776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:06.543529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647636+0000","last_change":"2024-05-10T09:54:49.721106+0000","last_active":"2024-05-10T09:58:04.647636+0000","last_peered":"2024-05-10T09:58:04.647636+0000","last_clean":"2024-05-10T09:58:04.647636+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:04.647636+0000","last_undegraded":"2024-05-10T09:58:04.647636+0000","last_fullsized":"2024-05-10T09:58:04.647636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:46.826381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648061+0000","last_change":"2024-05-10T09:54:41.673117+0000","last_active":"2024-05-10T09:58:04.648061+0000","last_peered":"2024-05-10T09:58:04.648061+0000","last_clean":"2024-05-10T09:58:04.648061+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:04.648061+0000","last_undegraded":"2024-05-10T09:58:04.648061+0000","last_fullsized":"2024-05-10T09:58:04.648061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:07:50.271147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529894+0000","last_change":"2024-05-10T09:54:34.044438+0000","last_active":"2024-05-10T09:58:04.529894+0000","last_peered":"2024-05-10T09:58:04.529894+0000","last_clean":"2024-05-10T09:58:04.529894+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:04.529894+0000","last_undegraded":"2024-05-10T09:58:04.529894+0000","last_fullsized":"2024-05-10T09:58:04.529894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'16","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.830468+0000","last_change":"2024-05-10T09:54:39.627520+0000","last_active":"2024-05-10T09:58:15.830468+0000","last_peered":"2024-05-10T09:58:15.830468+0000","last_clean":"2024-05-10T09:58:15.830468+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:15.830468+0000","last_undegraded":"2024-05-10T09:58:15.830468+0000","last_fullsized":"2024-05-10T09:58:15.830468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:42.424779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":26636,"num_write":36,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529701+0000","last_change":"2024-05-10T09:54:43.670656+0000","last_active":"2024-05-10T09:58:04.529701+0000","last_peered":"2024-05-10T09:58:04.529701+0000","last_clean":"2024-05-10T09:58:04.529701+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:04.529701+0000","last_undegraded":"2024-05-10T09:58:04.529701+0000","last_fullsized":"2024-05-10T09:58:04.529701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"110'16","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655641+0000","last_change":"2024-05-10T09:54:46.137006+0000","last_active":"2024-05-10T09:58:04.655641+0000","last_peered":"2024-05-10T09:58:04.655641+0000","last_clean":"2024-05-10T09:58:04.655641+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:04.655641+0000","last_undegraded":"2024-05-10T09:58:04.655641+0000","last_fullsized":"2024-05-10T09:58:04.655641+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:28:15.521117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651781+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:58:04.651781+0000","last_peered":"2024-05-10T09:58:04.651781+0000","last_clean":"2024-05-10T09:58:04.651781+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:04.651781+0000","last_undegraded":"2024-05-10T09:58:04.651781+0000","last_fullsized":"2024-05-10T09:58:04.651781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530498+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:58:04.530498+0000","last_peered":"2024-05-10T09:58:04.530498+0000","last_clean":"2024-05-10T09:58:04.530498+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:04.530498+0000","last_undegraded":"2024-05-10T09:58:04.530498+0000","last_fullsized":"2024-05-10T09:58:04.530498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:14.815807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647231+0000","last_change":"2024-05-10T09:54:41.675373+0000","last_active":"2024-05-10T09:58:04.647231+0000","last_peered":"2024-05-10T09:58:04.647231+0000","last_clean":"2024-05-10T09:58:04.647231+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:04.647231+0000","last_undegraded":"2024-05-10T09:58:04.647231+0000","last_fullsized":"2024-05-10T09:58:04.647231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:13:21.017409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653676+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:58:04.653676+0000","last_peered":"2024-05-10T09:58:04.653676+0000","last_clean":"2024-05-10T09:58:04.653676+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:04.653676+0000","last_undegraded":"2024-05-10T09:58:04.653676+0000","last_fullsized":"2024-05-10T09:58:04.653676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'16","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.751676+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:58:15.751676+0000","last_peered":"2024-05-10T09:58:15.751676+0000","last_clean":"2024-05-10T09:58:15.751676+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:15.751676+0000","last_undegraded":"2024-05-10T09:58:15.751676+0000","last_fullsized":"2024-05-10T09:58:15.751676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:33:34.302598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24588,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652015+0000","last_change":"2024-05-10T09:54:43.667817+0000","last_active":"2024-05-10T09:58:04.652015+0000","last_peered":"2024-05-10T09:58:04.652015+0000","last_clean":"2024-05-10T09:58:04.652015+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:04.652015+0000","last_undegraded":"2024-05-10T09:58:04.652015+0000","last_fullsized":"2024-05-10T09:58:04.652015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528089+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:58:04.528089+0000","last_peered":"2024-05-10T09:58:04.528089+0000","last_clean":"2024-05-10T09:58:04.528089+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:04.528089+0000","last_undegraded":"2024-05-10T09:58:04.528089+0000","last_fullsized":"2024-05-10T09:58:04.528089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:34:33.738981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655245+0000","last_change":"2024-05-10T09:54:47.713949+0000","last_active":"2024-05-10T09:58:04.655245+0000","last_peered":"2024-05-10T09:58:04.655245+0000","last_clean":"2024-05-10T09:58:04.655245+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:04.655245+0000","last_undegraded":"2024-05-10T09:58:04.655245+0000","last_fullsized":"2024-05-10T09:58:04.655245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:41:12.618369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649808+0000","last_change":"2024-05-10T09:54:49.721945+0000","last_active":"2024-05-10T09:58:04.649808+0000","last_peered":"2024-05-10T09:58:04.649808+0000","last_clean":"2024-05-10T09:58:04.649808+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:04.649808+0000","last_undegraded":"2024-05-10T09:58:04.649808+0000","last_fullsized":"2024-05-10T09:58:04.649808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:49:29.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646914+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:58:04.646914+0000","last_peered":"2024-05-10T09:58:04.646914+0000","last_clean":"2024-05-10T09:58:04.646914+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:04.646914+0000","last_undegraded":"2024-05-10T09:58:04.646914+0000","last_fullsized":"2024-05-10T09:58:04.646914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:29:38.940419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'24","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.896472+0000","last_change":"2024-05-10T09:54:39.663935+0000","last_active":"2024-05-10T09:58:15.896472+0000","last_peered":"2024-05-10T09:58:15.896472+0000","last_clean":"2024-05-10T09:58:15.896472+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:15.896472+0000","last_undegraded":"2024-05-10T09:58:15.896472+0000","last_fullsized":"2024-05-10T09:58:15.896472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:25.845089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45068,"num_write":44,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648281+0000","last_change":"2024-05-10T09:54:34.044449+0000","last_active":"2024-05-10T09:58:04.648281+0000","last_peered":"2024-05-10T09:58:04.648281+0000","last_clean":"2024-05-10T09:58:04.648281+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:04.648281+0000","last_undegraded":"2024-05-10T09:58:04.648281+0000","last_fullsized":"2024-05-10T09:58:04.648281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:11.373465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649817+0000","last_change":"2024-05-10T09:54:43.658449+0000","last_active":"2024-05-10T09:58:04.649817+0000","last_peered":"2024-05-10T09:58:04.649817+0000","last_clean":"2024-05-10T09:58:04.649817+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:04.649817+0000","last_undegraded":"2024-05-10T09:58:04.649817+0000","last_fullsized":"2024-05-10T09:58:04.649817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'36","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.899042+0000","last_change":"2024-05-10T09:54:45.681595+0000","last_active":"2024-05-10T09:58:15.899042+0000","last_peered":"2024-05-10T09:58:15.899042+0000","last_clean":"2024-05-10T09:58:15.899042+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:15.899042+0000","last_undegraded":"2024-05-10T09:58:15.899042+0000","last_fullsized":"2024-05-10T09:58:15.899042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529488+0000","last_change":"2024-05-10T09:57:19.676469+0000","last_active":"2024-05-10T09:58:04.529488+0000","last_peered":"2024-05-10T09:58:04.529488+0000","last_clean":"2024-05-10T09:58:04.529488+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:58:04.529488+0000","last_undegraded":"2024-05-10T09:58:04.529488+0000","last_fullsized":"2024-05-10T09:58:04.529488+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:17:07.877322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652331+0000","last_change":"2024-05-10T09:54:49.704874+0000","last_active":"2024-05-10T09:58:04.652331+0000","last_peered":"2024-05-10T09:58:04.652331+0000","last_clean":"2024-05-10T09:58:04.652331+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:04.652331+0000","last_undegraded":"2024-05-10T09:58:04.652331+0000","last_fullsized":"2024-05-10T09:58:04.652331+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651183+0000","last_change":"2024-05-10T09:54:41.661188+0000","last_active":"2024-05-10T09:58:04.651183+0000","last_peered":"2024-05-10T09:58:04.651183+0000","last_clean":"2024-05-10T09:58:04.651183+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:04.651183+0000","last_undegraded":"2024-05-10T09:58:04.651183+0000","last_fullsized":"2024-05-10T09:58:04.651183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"110'6","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.802508+0000","last_change":"2024-05-10T09:54:39.633626+0000","last_active":"2024-05-10T09:58:15.802508+0000","last_peered":"2024-05-10T09:58:15.802508+0000","last_clean":"2024-05-10T09:58:15.802508+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:15.802508+0000","last_undegraded":"2024-05-10T09:58:15.802508+0000","last_fullsized":"2024-05-10T09:58:15.802508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:38.833026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657133+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:58:04.657133+0000","last_peered":"2024-05-10T09:58:04.657133+0000","last_clean":"2024-05-10T09:58:04.657133+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:04.657133+0000","last_undegraded":"2024-05-10T09:58:04.657133+0000","last_fullsized":"2024-05-10T09:58:04.657133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:45.138522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"28'1","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.204382+0000","last_change":"2024-05-10T09:54:43.657696+0000","last_active":"2024-05-10T09:58:15.204382+0000","last_peered":"2024-05-10T09:58:15.204382+0000","last_clean":"2024-05-10T09:58:15.204382+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:15.204382+0000","last_undegraded":"2024-05-10T09:58:15.204382+0000","last_fullsized":"2024-05-10T09:58:15.204382+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:04.457692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"75'15","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645778+0000","last_change":"2024-05-10T09:54:46.137243+0000","last_active":"2024-05-10T09:58:04.645778+0000","last_peered":"2024-05-10T09:58:04.645778+0000","last_clean":"2024-05-10T09:58:04.645778+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:04.645778+0000","last_undegraded":"2024-05-10T09:58:04.645778+0000","last_fullsized":"2024-05-10T09:58:04.645778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:53:26.743334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'18","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.250759+0000","last_change":"2024-05-10T09:54:47.710949+0000","last_active":"2024-05-10T09:58:15.250759+0000","last_peered":"2024-05-10T09:58:15.250759+0000","last_clean":"2024-05-10T09:58:15.250759+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:15.250759+0000","last_undegraded":"2024-05-10T09:58:15.250759+0000","last_fullsized":"2024-05-10T09:58:15.250759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:41.768491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531521+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:58:04.531521+0000","last_peered":"2024-05-10T09:58:04.531521+0000","last_clean":"2024-05-10T09:58:04.531521+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:04.531521+0000","last_undegraded":"2024-05-10T09:58:04.531521+0000","last_fullsized":"2024-05-10T09:58:04.531521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:10.345044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527816+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:58:04.527816+0000","last_peered":"2024-05-10T09:58:04.527816+0000","last_clean":"2024-05-10T09:58:04.527816+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:04.527816+0000","last_undegraded":"2024-05-10T09:58:04.527816+0000","last_fullsized":"2024-05-10T09:58:04.527816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.816975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"110'20","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.745528+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:58:15.745528+0000","last_peered":"2024-05-10T09:58:15.745528+0000","last_clean":"2024-05-10T09:58:15.745528+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:15.745528+0000","last_undegraded":"2024-05-10T09:58:15.745528+0000","last_fullsized":"2024-05-10T09:58:15.745528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647640+0000","last_change":"2024-05-10T09:54:33.577262+0000","last_active":"2024-05-10T09:58:04.647640+0000","last_peered":"2024-05-10T09:58:04.647640+0000","last_clean":"2024-05-10T09:58:04.647640+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:04.647640+0000","last_undegraded":"2024-05-10T09:58:04.647640+0000","last_fullsized":"2024-05-10T09:58:04.647640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:52.780912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528907+0000","last_change":"2024-05-10T09:57:09.656448+0000","last_active":"2024-05-10T09:58:04.528907+0000","last_peered":"2024-05-10T09:58:04.528907+0000","last_clean":"2024-05-10T09:58:04.528907+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:04.528907+0000","last_undegraded":"2024-05-10T09:58:04.528907+0000","last_fullsized":"2024-05-10T09:58:04.528907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:05:19.386152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":99,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529276+0000","last_change":"2024-05-10T09:57:09.659618+0000","last_active":"2024-05-10T09:58:04.529276+0000","last_peered":"2024-05-10T09:58:04.529276+0000","last_clean":"2024-05-10T09:58:04.529276+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:04.529276+0000","last_undegraded":"2024-05-10T09:58:04.529276+0000","last_fullsized":"2024-05-10T09:58:04.529276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:53:15.099601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"110'18","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.256815+0000","last_change":"2024-05-10T09:54:47.714423+0000","last_active":"2024-05-10T09:58:15.256815+0000","last_peered":"2024-05-10T09:58:15.256815+0000","last_clean":"2024-05-10T09:58:15.256815+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:15.256815+0000","last_undegraded":"2024-05-10T09:58:15.256815+0000","last_fullsized":"2024-05-10T09:58:15.256815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:40:55.362595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651844+0000","last_change":"2024-05-10T09:54:49.717598+0000","last_active":"2024-05-10T09:58:04.651844+0000","last_peered":"2024-05-10T09:58:04.651844+0000","last_clean":"2024-05-10T09:58:04.651844+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:04.651844+0000","last_undegraded":"2024-05-10T09:58:04.651844+0000","last_fullsized":"2024-05-10T09:58:04.651844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529167+0000","last_change":"2024-05-10T09:57:09.833360+0000","last_active":"2024-05-10T09:58:04.529167+0000","last_peered":"2024-05-10T09:58:04.529167+0000","last_clean":"2024-05-10T09:58:04.529167+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:04.529167+0000","last_undegraded":"2024-05-10T09:58:04.529167+0000","last_fullsized":"2024-05-10T09:58:04.529167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:33:38.117513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'32","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.915870+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:58:15.915870+0000","last_peered":"2024-05-10T09:58:15.915870+0000","last_clean":"2024-05-10T09:58:15.915870+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:15.915870+0000","last_undegraded":"2024-05-10T09:58:15.915870+0000","last_fullsized":"2024-05-10T09:58:15.915870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":59422,"num_write":82,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656494+0000","last_change":"2024-05-10T09:54:33.583830+0000","last_active":"2024-05-10T09:58:04.656494+0000","last_peered":"2024-05-10T09:58:04.656494+0000","last_clean":"2024-05-10T09:58:04.656494+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:04.656494+0000","last_undegraded":"2024-05-10T09:58:04.656494+0000","last_fullsized":"2024-05-10T09:58:04.656494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:06.267923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527204+0000","last_change":"2024-05-10T09:54:43.665034+0000","last_active":"2024-05-10T09:58:04.527204+0000","last_peered":"2024-05-10T09:58:04.527204+0000","last_clean":"2024-05-10T09:58:04.527204+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:04.527204+0000","last_undegraded":"2024-05-10T09:58:04.527204+0000","last_fullsized":"2024-05-10T09:58:04.527204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:14:22.927476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'47","reported_seq":247,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.650073+0000","last_change":"2024-05-10T09:54:46.138242+0000","last_active":"2024-05-10T09:58:15.650073+0000","last_peered":"2024-05-10T09:58:15.650073+0000","last_clean":"2024-05-10T09:58:15.650073+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:15.650073+0000","last_undegraded":"2024-05-10T09:58:15.650073+0000","last_fullsized":"2024-05-10T09:58:15.650073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:14.702802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":86,"num_read_kb":121,"num_write":54,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528099+0000","last_change":"2024-05-10T09:54:47.713861+0000","last_active":"2024-05-10T09:58:04.528099+0000","last_peered":"2024-05-10T09:58:04.528099+0000","last_clean":"2024-05-10T09:58:04.528099+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:04.528099+0000","last_undegraded":"2024-05-10T09:58:04.528099+0000","last_fullsized":"2024-05-10T09:58:04.528099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:03:01.286690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650656+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:58:04.650656+0000","last_peered":"2024-05-10T09:58:04.650656+0000","last_clean":"2024-05-10T09:58:04.650656+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:04.650656+0000","last_undegraded":"2024-05-10T09:58:04.650656+0000","last_fullsized":"2024-05-10T09:58:04.650656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:09.392752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653085+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:58:04.653085+0000","last_peered":"2024-05-10T09:58:04.653085+0000","last_clean":"2024-05-10T09:58:04.653085+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:04.653085+0000","last_undegraded":"2024-05-10T09:58:04.653085+0000","last_fullsized":"2024-05-10T09:58:04.653085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529250+0000","last_change":"2024-05-10T09:57:09.838031+0000","last_active":"2024-05-10T09:58:04.529250+0000","last_peered":"2024-05-10T09:58:04.529250+0000","last_clean":"2024-05-10T09:58:04.529250+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:04.529250+0000","last_undegraded":"2024-05-10T09:58:04.529250+0000","last_fullsized":"2024-05-10T09:58:04.529250+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:26:09.861536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'14","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.677810+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:58:15.677810+0000","last_peered":"2024-05-10T09:58:15.677810+0000","last_clean":"2024-05-10T09:58:15.677810+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:15.677810+0000","last_undegraded":"2024-05-10T09:58:15.677810+0000","last_fullsized":"2024-05-10T09:58:15.677810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:37:05.069962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647012+0000","last_change":"2024-05-10T09:54:43.670272+0000","last_active":"2024-05-10T09:58:04.647012+0000","last_peered":"2024-05-10T09:58:04.647012+0000","last_clean":"2024-05-10T09:58:04.647012+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:04.647012+0000","last_undegraded":"2024-05-10T09:58:04.647012+0000","last_fullsized":"2024-05-10T09:58:04.647012+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:46:45.143902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'21","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.752999+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:58:15.752999+0000","last_peered":"2024-05-10T09:58:15.752999+0000","last_clean":"2024-05-10T09:58:15.752999+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:15.752999+0000","last_undegraded":"2024-05-10T09:58:15.752999+0000","last_fullsized":"2024-05-10T09:58:15.752999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:23.510735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":59,"num_write":24,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526191+0000","last_change":"2024-05-10T09:54:47.714024+0000","last_active":"2024-05-10T09:58:04.526191+0000","last_peered":"2024-05-10T09:58:04.526191+0000","last_clean":"2024-05-10T09:58:04.526191+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:04.526191+0000","last_undegraded":"2024-05-10T09:58:04.526191+0000","last_fullsized":"2024-05-10T09:58:04.526191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:50.452874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527534+0000","last_change":"2024-05-10T09:54:49.735234+0000","last_active":"2024-05-10T09:58:04.527534+0000","last_peered":"2024-05-10T09:58:04.527534+0000","last_clean":"2024-05-10T09:58:04.527534+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:04.527534+0000","last_undegraded":"2024-05-10T09:58:04.527534+0000","last_fullsized":"2024-05-10T09:58:04.527534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:00:50.302946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646813+0000","last_change":"2024-05-10T09:54:41.684252+0000","last_active":"2024-05-10T09:58:04.646813+0000","last_peered":"2024-05-10T09:58:04.646813+0000","last_clean":"2024-05-10T09:58:04.646813+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:04.646813+0000","last_undegraded":"2024-05-10T09:58:04.646813+0000","last_fullsized":"2024-05-10T09:58:04.646813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:10.866628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'18","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.662535+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:58:15.662535+0000","last_peered":"2024-05-10T09:58:15.662535+0000","last_clean":"2024-05-10T09:58:15.662535+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:15.662535+0000","last_undegraded":"2024-05-10T09:58:15.662535+0000","last_fullsized":"2024-05-10T09:58:15.662535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30738,"num_write":48,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530067+0000","last_change":"2024-05-10T09:54:43.660894+0000","last_active":"2024-05-10T09:58:04.530067+0000","last_peered":"2024-05-10T09:58:04.530067+0000","last_clean":"2024-05-10T09:58:04.530067+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:04.530067+0000","last_undegraded":"2024-05-10T09:58:04.530067+0000","last_fullsized":"2024-05-10T09:58:04.530067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:04:27.157053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646650+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:58:04.646650+0000","last_peered":"2024-05-10T09:58:04.646650+0000","last_clean":"2024-05-10T09:58:04.646650+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:04.646650+0000","last_undegraded":"2024-05-10T09:58:04.646650+0000","last_fullsized":"2024-05-10T09:58:04.646650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651652+0000","last_change":"2024-05-10T09:54:47.707855+0000","last_active":"2024-05-10T09:58:04.651652+0000","last_peered":"2024-05-10T09:58:04.651652+0000","last_clean":"2024-05-10T09:58:04.651652+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:04.651652+0000","last_undegraded":"2024-05-10T09:58:04.651652+0000","last_fullsized":"2024-05-10T09:58:04.651652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:27.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651898+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:58:04.651898+0000","last_peered":"2024-05-10T09:58:04.651898+0000","last_clean":"2024-05-10T09:58:04.651898+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:04.651898+0000","last_undegraded":"2024-05-10T09:58:04.651898+0000","last_fullsized":"2024-05-10T09:58:04.651898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530746+0000","last_change":"2024-05-10T09:54:41.672307+0000","last_active":"2024-05-10T09:58:04.530746+0000","last_peered":"2024-05-10T09:58:04.530746+0000","last_clean":"2024-05-10T09:58:04.530746+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:04.530746+0000","last_undegraded":"2024-05-10T09:58:04.530746+0000","last_fullsized":"2024-05-10T09:58:04.530746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:16:51.501093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'14","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.896994+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:58:15.896994+0000","last_peered":"2024-05-10T09:58:15.896994+0000","last_clean":"2024-05-10T09:58:15.896994+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:15.896994+0000","last_undegraded":"2024-05-10T09:58:15.896994+0000","last_fullsized":"2024-05-10T09:58:15.896994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:30.364995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649736+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:58:04.649736+0000","last_peered":"2024-05-10T09:58:04.649736+0000","last_clean":"2024-05-10T09:58:04.649736+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:04.649736+0000","last_undegraded":"2024-05-10T09:58:04.649736+0000","last_fullsized":"2024-05-10T09:58:04.649736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:55.865695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'22","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.583797+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:58:15.583797+0000","last_peered":"2024-05-10T09:58:15.583797+0000","last_clean":"2024-05-10T09:58:15.583797+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:15.583797+0000","last_undegraded":"2024-05-10T09:58:15.583797+0000","last_fullsized":"2024-05-10T09:58:15.583797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:00:05.259105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":64,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654262+0000","last_change":"2024-05-10T09:54:47.713149+0000","last_active":"2024-05-10T09:58:04.654262+0000","last_peered":"2024-05-10T09:58:04.654262+0000","last_clean":"2024-05-10T09:58:04.654262+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:04.654262+0000","last_undegraded":"2024-05-10T09:58:04.654262+0000","last_fullsized":"2024-05-10T09:58:04.654262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:20:57.489619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653292+0000","last_change":"2024-05-10T09:54:49.726198+0000","last_active":"2024-05-10T09:58:04.653292+0000","last_peered":"2024-05-10T09:58:04.653292+0000","last_clean":"2024-05-10T09:58:04.653292+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:04.653292+0000","last_undegraded":"2024-05-10T09:58:04.653292+0000","last_fullsized":"2024-05-10T09:58:04.653292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:19.764357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528375+0000","last_change":"2024-05-10T09:54:41.665987+0000","last_active":"2024-05-10T09:58:04.528375+0000","last_peered":"2024-05-10T09:58:04.528375+0000","last_clean":"2024-05-10T09:58:04.528375+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:04.528375+0000","last_undegraded":"2024-05-10T09:58:04.528375+0000","last_fullsized":"2024-05-10T09:58:04.528375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"110'22","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.962822+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:58:15.962822+0000","last_peered":"2024-05-10T09:58:15.962822+0000","last_clean":"2024-05-10T09:58:15.962822+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:15.962822+0000","last_undegraded":"2024-05-10T09:58:15.962822+0000","last_fullsized":"2024-05-10T09:58:15.962822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40978,"num_write":52,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654529+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:58:04.654529+0000","last_peered":"2024-05-10T09:58:04.654529+0000","last_clean":"2024-05-10T09:58:04.654529+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:04.654529+0000","last_undegraded":"2024-05-10T09:58:04.654529+0000","last_fullsized":"2024-05-10T09:58:04.654529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:31:52.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'19","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.514513+0000","last_change":"2024-05-10T09:54:45.684412+0000","last_active":"2024-05-10T09:58:15.514513+0000","last_peered":"2024-05-10T09:58:15.514513+0000","last_clean":"2024-05-10T09:58:15.514513+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:15.514513+0000","last_undegraded":"2024-05-10T09:58:15.514513+0000","last_fullsized":"2024-05-10T09:58:15.514513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:59.243169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.105498+0000","last_change":"2024-05-10T09:58:20.105557+0000","last_active":"2024-05-10T09:58:20.105498+0000","last_peered":"2024-05-10T09:58:20.105498+0000","last_clean":"2024-05-10T09:58:20.105498+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:20.105498+0000","last_undegraded":"2024-05-10T09:58:20.105498+0000","last_fullsized":"2024-05-10T09:58:20.105498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:20.105310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:20.105310+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.105310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:59.229211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656182+0000","last_change":"2024-05-10T09:54:41.674745+0000","last_active":"2024-05-10T09:58:04.656182+0000","last_peered":"2024-05-10T09:58:04.656182+0000","last_clean":"2024-05-10T09:58:04.656182+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:04.656182+0000","last_undegraded":"2024-05-10T09:58:04.656182+0000","last_fullsized":"2024-05-10T09:58:04.656182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:41.434424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'10","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.594207+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:58:15.594207+0000","last_peered":"2024-05-10T09:58:15.594207+0000","last_clean":"2024-05-10T09:58:15.594207+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:15.594207+0000","last_undegraded":"2024-05-10T09:58:15.594207+0000","last_fullsized":"2024-05-10T09:58:15.594207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:53.719498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18444,"num_write":30,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652674+0000","last_change":"2024-05-10T09:54:43.661422+0000","last_active":"2024-05-10T09:58:04.652674+0000","last_peered":"2024-05-10T09:58:04.652674+0000","last_clean":"2024-05-10T09:58:04.652674+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:04.652674+0000","last_undegraded":"2024-05-10T09:58:04.652674+0000","last_fullsized":"2024-05-10T09:58:04.652674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'29","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.874172+0000","last_change":"2024-05-10T09:54:45.687189+0000","last_active":"2024-05-10T09:58:15.874172+0000","last_peered":"2024-05-10T09:58:15.874172+0000","last_clean":"2024-05-10T09:58:15.874172+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:15.874172+0000","last_undegraded":"2024-05-10T09:58:15.874172+0000","last_fullsized":"2024-05-10T09:58:15.874172+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:15:06.566459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":69,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653816+0000","last_change":"2024-05-10T09:54:47.720075+0000","last_active":"2024-05-10T09:58:04.653816+0000","last_peered":"2024-05-10T09:58:04.653816+0000","last_clean":"2024-05-10T09:58:04.653816+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:04.653816+0000","last_undegraded":"2024-05-10T09:58:04.653816+0000","last_fullsized":"2024-05-10T09:58:04.653816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:45.523067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528651+0000","last_change":"2024-05-10T09:54:49.730587+0000","last_active":"2024-05-10T09:58:04.528651+0000","last_peered":"2024-05-10T09:58:04.528651+0000","last_clean":"2024-05-10T09:58:04.528651+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:04.528651+0000","last_undegraded":"2024-05-10T09:58:04.528651+0000","last_fullsized":"2024-05-10T09:58:04.528651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:00:12.818133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652772+0000","last_change":"2024-05-10T09:54:41.664760+0000","last_active":"2024-05-10T09:58:04.652772+0000","last_peered":"2024-05-10T09:58:04.652772+0000","last_clean":"2024-05-10T09:58:04.652772+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:04.652772+0000","last_undegraded":"2024-05-10T09:58:04.652772+0000","last_fullsized":"2024-05-10T09:58:04.652772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'20","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.811123+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:58:15.811123+0000","last_peered":"2024-05-10T09:58:15.811123+0000","last_clean":"2024-05-10T09:58:15.811123+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:15.811123+0000","last_undegraded":"2024-05-10T09:58:15.811123+0000","last_fullsized":"2024-05-10T09:58:15.811123+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:59.728683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30726,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":193,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.202744+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:58:15.202744+0000","last_peered":"2024-05-10T09:58:15.202744+0000","last_clean":"2024-05-10T09:58:15.202744+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:15.202744+0000","last_undegraded":"2024-05-10T09:58:15.202744+0000","last_fullsized":"2024-05-10T09:58:15.202744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:32:08.470398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'25","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.544654+0000","last_change":"2024-05-10T09:54:45.682886+0000","last_active":"2024-05-10T09:58:15.544654+0000","last_peered":"2024-05-10T09:58:15.544654+0000","last_clean":"2024-05-10T09:58:15.544654+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:15.544654+0000","last_undegraded":"2024-05-10T09:58:15.544654+0000","last_fullsized":"2024-05-10T09:58:15.544654+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:57:00.567046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":63,"num_write":28,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647328+0000","last_change":"2024-05-10T09:54:47.709224+0000","last_active":"2024-05-10T09:58:04.647328+0000","last_peered":"2024-05-10T09:58:04.647328+0000","last_clean":"2024-05-10T09:58:04.647328+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:04.647328+0000","last_undegraded":"2024-05-10T09:58:04.647328+0000","last_fullsized":"2024-05-10T09:58:04.647328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:04.353986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652826+0000","last_change":"2024-05-10T09:54:49.726499+0000","last_active":"2024-05-10T09:58:04.652826+0000","last_peered":"2024-05-10T09:58:04.652826+0000","last_clean":"2024-05-10T09:58:04.652826+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:04.652826+0000","last_undegraded":"2024-05-10T09:58:04.652826+0000","last_fullsized":"2024-05-10T09:58:04.652826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:23:07.890042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528292+0000","last_change":"2024-05-10T09:54:41.677768+0000","last_active":"2024-05-10T09:58:04.528292+0000","last_peered":"2024-05-10T09:58:04.528292+0000","last_clean":"2024-05-10T09:58:04.528292+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:04.528292+0000","last_undegraded":"2024-05-10T09:58:04.528292+0000","last_fullsized":"2024-05-10T09:58:04.528292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:49.300513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"110'12","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.827574+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:58:15.827574+0000","last_peered":"2024-05-10T09:58:15.827574+0000","last_clean":"2024-05-10T09:58:15.827574+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:15.827574+0000","last_undegraded":"2024-05-10T09:58:15.827574+0000","last_fullsized":"2024-05-10T09:58:15.827574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:41.838517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18438,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529014+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:58:04.529014+0000","last_peered":"2024-05-10T09:58:04.529014+0000","last_clean":"2024-05-10T09:58:04.529014+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:04.529014+0000","last_undegraded":"2024-05-10T09:58:04.529014+0000","last_fullsized":"2024-05-10T09:58:04.529014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:54:59.428501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'20","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.834323+0000","last_change":"2024-05-10T09:54:46.137026+0000","last_active":"2024-05-10T09:58:15.834323+0000","last_peered":"2024-05-10T09:58:15.834323+0000","last_clean":"2024-05-10T09:58:15.834323+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:15.834323+0000","last_undegraded":"2024-05-10T09:58:15.834323+0000","last_fullsized":"2024-05-10T09:58:15.834323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:04.523509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":62,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647189+0000","last_change":"2024-05-10T09:54:47.715314+0000","last_active":"2024-05-10T09:58:04.647189+0000","last_peered":"2024-05-10T09:58:04.647189+0000","last_clean":"2024-05-10T09:58:04.647189+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:04.647189+0000","last_undegraded":"2024-05-10T09:58:04.647189+0000","last_fullsized":"2024-05-10T09:58:04.647189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:01:11.633890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":160,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650463+0000","last_change":"2024-05-10T09:54:49.726249+0000","last_active":"2024-05-10T09:58:04.650463+0000","last_peered":"2024-05-10T09:58:04.650463+0000","last_clean":"2024-05-10T09:58:04.650463+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:04.650463+0000","last_undegraded":"2024-05-10T09:58:04.650463+0000","last_fullsized":"2024-05-10T09:58:04.650463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:26:47.574025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":221,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.526679+0000","last_change":"2024-05-10T09:54:41.681141+0000","last_active":"2024-05-10T09:58:04.526679+0000","last_peered":"2024-05-10T09:58:04.526679+0000","last_clean":"2024-05-10T09:58:04.526679+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:04.526679+0000","last_undegraded":"2024-05-10T09:58:04.526679+0000","last_fullsized":"2024-05-10T09:58:04.526679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'20","reported_seq":242,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.825032+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:58:15.825032+0000","last_peered":"2024-05-10T09:58:15.825032+0000","last_clean":"2024-05-10T09:58:15.825032+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:15.825032+0000","last_undegraded":"2024-05-10T09:58:15.825032+0000","last_fullsized":"2024-05-10T09:58:15.825032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647618+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:58:04.647618+0000","last_peered":"2024-05-10T09:58:04.647618+0000","last_clean":"2024-05-10T09:58:04.647618+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:04.647618+0000","last_undegraded":"2024-05-10T09:58:04.647618+0000","last_fullsized":"2024-05-10T09:58:04.647618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:12:49.344340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":103,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530384+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:58:04.530384+0000","last_peered":"2024-05-10T09:58:04.530384+0000","last_clean":"2024-05-10T09:58:04.530384+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:04.530384+0000","last_undegraded":"2024-05-10T09:58:04.530384+0000","last_fullsized":"2024-05-10T09:58:04.530384+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:28:31.870904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'20","reported_seq":239,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.251654+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:58:15.251654+0000","last_peered":"2024-05-10T09:58:15.251654+0000","last_clean":"2024-05-10T09:58:15.251654+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:15.251654+0000","last_undegraded":"2024-05-10T09:58:15.251654+0000","last_fullsized":"2024-05-10T09:58:15.251654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:52.051971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649718+0000","last_change":"2024-05-10T09:54:49.723600+0000","last_active":"2024-05-10T09:58:04.649718+0000","last_peered":"2024-05-10T09:58:04.649718+0000","last_clean":"2024-05-10T09:58:04.649718+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:04.649718+0000","last_undegraded":"2024-05-10T09:58:04.649718+0000","last_fullsized":"2024-05-10T09:58:04.649718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:52.470902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":131,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646678+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:58:04.646678+0000","last_peered":"2024-05-10T09:58:04.646678+0000","last_clean":"2024-05-10T09:58:04.646678+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:04.646678+0000","last_undegraded":"2024-05-10T09:58:04.646678+0000","last_fullsized":"2024-05-10T09:58:04.646678+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:17:47.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"110'12","reported_seq":221,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.852963+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:58:15.852963+0000","last_peered":"2024-05-10T09:58:15.852963+0000","last_clean":"2024-05-10T09:58:15.852963+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:15.852963+0000","last_undegraded":"2024-05-10T09:58:15.852963+0000","last_fullsized":"2024-05-10T09:58:15.852963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:50:04.732705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":18450,"num_write":42,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653243+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:58:04.653243+0000","last_peered":"2024-05-10T09:58:04.653243+0000","last_clean":"2024-05-10T09:58:04.653243+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:04.653243+0000","last_undegraded":"2024-05-10T09:58:04.653243+0000","last_fullsized":"2024-05-10T09:58:04.653243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:01:50.754034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'23","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.940331+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:58:15.940331+0000","last_peered":"2024-05-10T09:58:15.940331+0000","last_clean":"2024-05-10T09:58:15.940331+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:15.940331+0000","last_undegraded":"2024-05-10T09:58:15.940331+0000","last_fullsized":"2024-05-10T09:58:15.940331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:13:25.496208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646344+0000","last_change":"2024-05-10T09:54:47.704203+0000","last_active":"2024-05-10T09:58:04.646344+0000","last_peered":"2024-05-10T09:58:04.646344+0000","last_clean":"2024-05-10T09:58:04.646344+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:04.646344+0000","last_undegraded":"2024-05-10T09:58:04.646344+0000","last_fullsized":"2024-05-10T09:58:04.646344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658184+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:58:04.658184+0000","last_peered":"2024-05-10T09:58:04.658184+0000","last_clean":"2024-05-10T09:58:04.658184+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:04.658184+0000","last_undegraded":"2024-05-10T09:58:04.658184+0000","last_fullsized":"2024-05-10T09:58:04.658184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:26:25.821670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529018+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:58:04.529018+0000","last_peered":"2024-05-10T09:58:04.529018+0000","last_clean":"2024-05-10T09:58:04.529018+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:04.529018+0000","last_undegraded":"2024-05-10T09:58:04.529018+0000","last_fullsized":"2024-05-10T09:58:04.529018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:43:12.962322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'16","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.852970+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:58:15.852970+0000","last_peered":"2024-05-10T09:58:15.852970+0000","last_clean":"2024-05-10T09:58:15.852970+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:15.852970+0000","last_undegraded":"2024-05-10T09:58:15.852970+0000","last_fullsized":"2024-05-10T09:58:15.852970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:18:36.568172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22534,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650809+0000","last_change":"2024-05-10T09:54:43.674160+0000","last_active":"2024-05-10T09:58:04.650809+0000","last_peered":"2024-05-10T09:58:04.650809+0000","last_clean":"2024-05-10T09:58:04.650809+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:04.650809+0000","last_undegraded":"2024-05-10T09:58:04.650809+0000","last_fullsized":"2024-05-10T09:58:04.650809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:12.696239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'18","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.954242+0000","last_change":"2024-05-10T09:54:45.682545+0000","last_active":"2024-05-10T09:58:15.954242+0000","last_peered":"2024-05-10T09:58:15.954242+0000","last_clean":"2024-05-10T09:58:15.954242+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:15.954242+0000","last_undegraded":"2024-05-10T09:58:15.954242+0000","last_fullsized":"2024-05-10T09:58:15.954242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652426+0000","last_change":"2024-05-10T09:54:47.705094+0000","last_active":"2024-05-10T09:58:04.652426+0000","last_peered":"2024-05-10T09:58:04.652426+0000","last_clean":"2024-05-10T09:58:04.652426+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:04.652426+0000","last_undegraded":"2024-05-10T09:58:04.652426+0000","last_fullsized":"2024-05-10T09:58:04.652426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:54.030614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527768+0000","last_change":"2024-05-10T09:54:49.721389+0000","last_active":"2024-05-10T09:58:04.527768+0000","last_peered":"2024-05-10T09:58:04.527768+0000","last_clean":"2024-05-10T09:58:04.527768+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:04.527768+0000","last_undegraded":"2024-05-10T09:58:04.527768+0000","last_fullsized":"2024-05-10T09:58:04.527768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:04.438725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531028+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:58:04.531028+0000","last_peered":"2024-05-10T09:58:04.531028+0000","last_clean":"2024-05-10T09:58:04.531028+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:04.531028+0000","last_undegraded":"2024-05-10T09:58:04.531028+0000","last_fullsized":"2024-05-10T09:58:04.531028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:15.841091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'12","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.917326+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:58:15.917326+0000","last_peered":"2024-05-10T09:58:15.917326+0000","last_clean":"2024-05-10T09:58:15.917326+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:15.917326+0000","last_undegraded":"2024-05-10T09:58:15.917326+0000","last_fullsized":"2024-05-10T09:58:15.917326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:03:17.508725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":156,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527959+0000","last_change":"2024-05-10T09:57:09.648832+0000","last_active":"2024-05-10T09:58:04.527959+0000","last_peered":"2024-05-10T09:58:04.527959+0000","last_clean":"2024-05-10T09:58:04.527959+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:04.527959+0000","last_undegraded":"2024-05-10T09:58:04.527959+0000","last_fullsized":"2024-05-10T09:58:04.527959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:29:45.711695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'12","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.777329+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:58:15.777329+0000","last_peered":"2024-05-10T09:58:15.777329+0000","last_clean":"2024-05-10T09:58:15.777329+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:15.777329+0000","last_undegraded":"2024-05-10T09:58:15.777329+0000","last_fullsized":"2024-05-10T09:58:15.777329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:37.724291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529836+0000","last_change":"2024-05-10T09:57:09.659952+0000","last_active":"2024-05-10T09:58:04.529836+0000","last_peered":"2024-05-10T09:58:04.529836+0000","last_clean":"2024-05-10T09:58:04.529836+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:04.529836+0000","last_undegraded":"2024-05-10T09:58:04.529836+0000","last_fullsized":"2024-05-10T09:58:04.529836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:01.171769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.655255+0000","last_change":"2024-05-10T09:54:49.725354+0000","last_active":"2024-05-10T09:58:04.655255+0000","last_peered":"2024-05-10T09:58:04.655255+0000","last_clean":"2024-05-10T09:58:04.655255+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:04.655255+0000","last_undegraded":"2024-05-10T09:58:04.655255+0000","last_fullsized":"2024-05-10T09:58:04.655255+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:46:54.915866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527607+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:58:04.527607+0000","last_peered":"2024-05-10T09:58:04.527607+0000","last_clean":"2024-05-10T09:58:04.527607+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:04.527607+0000","last_undegraded":"2024-05-10T09:58:04.527607+0000","last_fullsized":"2024-05-10T09:58:04.527607+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:41:27.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'22","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.936392+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:58:15.936392+0000","last_peered":"2024-05-10T09:58:15.936392+0000","last_clean":"2024-05-10T09:58:15.936392+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:15.936392+0000","last_undegraded":"2024-05-10T09:58:15.936392+0000","last_fullsized":"2024-05-10T09:58:15.936392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.645798+0000","last_change":"2024-05-10T09:54:43.668575+0000","last_active":"2024-05-10T09:58:04.645798+0000","last_peered":"2024-05-10T09:58:04.645798+0000","last_clean":"2024-05-10T09:58:04.645798+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:04.645798+0000","last_undegraded":"2024-05-10T09:58:04.645798+0000","last_fullsized":"2024-05-10T09:58:04.645798+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:45:37.369888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'18","reported_seq":115,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.865344+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:58:15.865344+0000","last_peered":"2024-05-10T09:58:15.865344+0000","last_clean":"2024-05-10T09:58:15.865344+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:15.865344+0000","last_undegraded":"2024-05-10T09:58:15.865344+0000","last_fullsized":"2024-05-10T09:58:15.865344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:09:56.369476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":49,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648632+0000","last_change":"2024-05-10T09:54:47.692740+0000","last_active":"2024-05-10T09:58:04.648632+0000","last_peered":"2024-05-10T09:58:04.648632+0000","last_clean":"2024-05-10T09:58:04.648632+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:04.648632+0000","last_undegraded":"2024-05-10T09:58:04.648632+0000","last_fullsized":"2024-05-10T09:58:04.648632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":72,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529237+0000","last_change":"2024-05-10T09:57:09.654204+0000","last_active":"2024-05-10T09:58:04.529237+0000","last_peered":"2024-05-10T09:58:04.529237+0000","last_clean":"2024-05-10T09:58:04.529237+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:04.529237+0000","last_undegraded":"2024-05-10T09:58:04.529237+0000","last_fullsized":"2024-05-10T09:58:04.529237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:57:01.208970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647961+0000","last_change":"2024-05-10T09:54:41.677371+0000","last_active":"2024-05-10T09:58:04.647961+0000","last_peered":"2024-05-10T09:58:04.647961+0000","last_clean":"2024-05-10T09:58:04.647961+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:04.647961+0000","last_undegraded":"2024-05-10T09:58:04.647961+0000","last_fullsized":"2024-05-10T09:58:04.647961+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.450562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'16","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.885341+0000","last_change":"2024-05-10T09:54:39.634447+0000","last_active":"2024-05-10T09:58:15.885341+0000","last_peered":"2024-05-10T09:58:15.885341+0000","last_clean":"2024-05-10T09:58:15.885341+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:15.885341+0000","last_undegraded":"2024-05-10T09:58:15.885341+0000","last_fullsized":"2024-05-10T09:58:15.885341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:41.019318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24588,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647419+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:58:04.647419+0000","last_peered":"2024-05-10T09:58:04.647419+0000","last_clean":"2024-05-10T09:58:04.647419+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:04.647419+0000","last_undegraded":"2024-05-10T09:58:04.647419+0000","last_fullsized":"2024-05-10T09:58:04.647419+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:27:50.819958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.920146+0000","last_change":"2024-05-10T09:55:19.371316+0000","last_active":"2024-05-10T09:58:15.920146+0000","last_peered":"2024-05-10T09:58:15.920146+0000","last_clean":"2024-05-10T09:58:15.920146+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:15.920146+0000","last_undegraded":"2024-05-10T09:58:15.920146+0000","last_fullsized":"2024-05-10T09:58:15.920146+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656340+0000","last_change":"2024-05-10T09:54:41.673881+0000","last_active":"2024-05-10T09:58:04.656340+0000","last_peered":"2024-05-10T09:58:04.656340+0000","last_clean":"2024-05-10T09:58:04.656340+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:04.656340+0000","last_undegraded":"2024-05-10T09:58:04.656340+0000","last_fullsized":"2024-05-10T09:58:04.656340+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:14.650172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'12","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.830458+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:58:15.830458+0000","last_peered":"2024-05-10T09:58:15.830458+0000","last_clean":"2024-05-10T09:58:15.830458+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:15.830458+0000","last_undegraded":"2024-05-10T09:58:15.830458+0000","last_fullsized":"2024-05-10T09:58:15.830458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:35.297641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648308+0000","last_change":"2024-05-10T09:54:41.675765+0000","last_active":"2024-05-10T09:58:04.648308+0000","last_peered":"2024-05-10T09:58:04.648308+0000","last_clean":"2024-05-10T09:58:04.648308+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:04.648308+0000","last_undegraded":"2024-05-10T09:58:04.648308+0000","last_fullsized":"2024-05-10T09:58:04.648308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:35:22.537079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'38","reported_seq":242,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.961079+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:58:15.961079+0000","last_peered":"2024-05-10T09:58:15.961079+0000","last_clean":"2024-05-10T09:58:15.961079+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:15.961079+0000","last_undegraded":"2024-05-10T09:58:15.961079+0000","last_fullsized":"2024-05-10T09:58:15.961079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":71692,"num_write":58,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530949+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:58:04.530949+0000","last_peered":"2024-05-10T09:58:04.530949+0000","last_clean":"2024-05-10T09:58:04.530949+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:04.530949+0000","last_undegraded":"2024-05-10T09:58:04.530949+0000","last_fullsized":"2024-05-10T09:58:04.530949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:50:40.213832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'8","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.916611+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:58:15.916611+0000","last_peered":"2024-05-10T09:58:15.916611+0000","last_clean":"2024-05-10T09:58:15.916611+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:58:15.916611+0000","last_undegraded":"2024-05-10T09:58:15.916611+0000","last_fullsized":"2024-05-10T09:58:15.916611+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:53.535084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14342,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528181+0000","last_change":"2024-05-10T09:57:09.658166+0000","last_active":"2024-05-10T09:58:04.528181+0000","last_peered":"2024-05-10T09:58:04.528181+0000","last_clean":"2024-05-10T09:58:04.528181+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:04.528181+0000","last_undegraded":"2024-05-10T09:58:04.528181+0000","last_fullsized":"2024-05-10T09:58:04.528181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:16:19.449223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'16","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.819265+0000","last_change":"2024-05-10T09:54:39.632856+0000","last_active":"2024-05-10T09:58:15.819265+0000","last_peered":"2024-05-10T09:58:15.819265+0000","last_clean":"2024-05-10T09:58:15.819265+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:15.819265+0000","last_undegraded":"2024-05-10T09:58:15.819265+0000","last_fullsized":"2024-05-10T09:58:15.819265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:59:32.225053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":30720,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":146,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528818+0000","last_change":"2024-05-10T09:55:19.369416+0000","last_active":"2024-05-10T09:58:04.528818+0000","last_peered":"2024-05-10T09:58:04.528818+0000","last_clean":"2024-05-10T09:58:04.528818+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:04.528818+0000","last_undegraded":"2024-05-10T09:58:04.528818+0000","last_fullsized":"2024-05-10T09:58:04.528818+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"110'10","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.583778+0000","last_change":"2024-05-10T09:54:39.633438+0000","last_active":"2024-05-10T09:58:15.583778+0000","last_peered":"2024-05-10T09:58:15.583778+0000","last_clean":"2024-05-10T09:58:15.583778+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:15.583778+0000","last_undegraded":"2024-05-10T09:58:15.583778+0000","last_fullsized":"2024-05-10T09:58:15.583778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:20:16.424227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651663+0000","last_change":"2024-05-10T09:54:41.657115+0000","last_active":"2024-05-10T09:58:04.651663+0000","last_peered":"2024-05-10T09:58:04.651663+0000","last_clean":"2024-05-10T09:58:04.651663+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:04.651663+0000","last_undegraded":"2024-05-10T09:58:04.651663+0000","last_fullsized":"2024-05-10T09:58:04.651663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:57:37.323001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'20","reported_seq":239,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.850994+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:58:15.850994+0000","last_peered":"2024-05-10T09:58:15.850994+0000","last_clean":"2024-05-10T09:58:15.850994+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:15.850994+0000","last_undegraded":"2024-05-10T09:58:15.850994+0000","last_fullsized":"2024-05-10T09:58:15.850994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.980223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36870,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653466+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:58:04.653466+0000","last_peered":"2024-05-10T09:58:04.653466+0000","last_clean":"2024-05-10T09:58:04.653466+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:04.653466+0000","last_undegraded":"2024-05-10T09:58:04.653466+0000","last_fullsized":"2024-05-10T09:58:04.653466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'18","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.918066+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:58:15.918066+0000","last_peered":"2024-05-10T09:58:15.918066+0000","last_clean":"2024-05-10T09:58:15.918066+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:15.918066+0000","last_undegraded":"2024-05-10T09:58:15.918066+0000","last_fullsized":"2024-05-10T09:58:15.918066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:14:15.881683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":36870,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529866+0000","last_change":"2024-05-10T09:57:09.658806+0000","last_active":"2024-05-10T09:58:04.529866+0000","last_peered":"2024-05-10T09:58:04.529866+0000","last_clean":"2024-05-10T09:58:04.529866+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:04.529866+0000","last_undegraded":"2024-05-10T09:58:04.529866+0000","last_fullsized":"2024-05-10T09:58:04.529866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:59.938105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'24","reported_seq":251,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.803117+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:58:15.803117+0000","last_peered":"2024-05-10T09:58:15.803117+0000","last_clean":"2024-05-10T09:58:15.803117+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:58:15.803117+0000","last_undegraded":"2024-05-10T09:58:15.803117+0000","last_fullsized":"2024-05-10T09:58:15.803117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:55.121207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":45080,"num_write":64,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527460+0000","last_change":"2024-05-10T09:54:41.668566+0000","last_active":"2024-05-10T09:58:04.527460+0000","last_peered":"2024-05-10T09:58:04.527460+0000","last_clean":"2024-05-10T09:58:04.527460+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:04.527460+0000","last_undegraded":"2024-05-10T09:58:04.527460+0000","last_fullsized":"2024-05-10T09:58:04.527460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'16","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.570824+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:58:15.570824+0000","last_peered":"2024-05-10T09:58:15.570824+0000","last_clean":"2024-05-10T09:58:15.570824+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:15.570824+0000","last_undegraded":"2024-05-10T09:58:15.570824+0000","last_fullsized":"2024-05-10T09:58:15.570824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:50:02.701001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530261+0000","last_change":"2024-05-10T09:57:09.659960+0000","last_active":"2024-05-10T09:58:04.530261+0000","last_peered":"2024-05-10T09:58:04.530261+0000","last_clean":"2024-05-10T09:58:04.530261+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:04.530261+0000","last_undegraded":"2024-05-10T09:58:04.530261+0000","last_fullsized":"2024-05-10T09:58:04.530261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:08:37.973906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'16","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.922499+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:58:15.922499+0000","last_peered":"2024-05-10T09:58:15.922499+0000","last_clean":"2024-05-10T09:58:15.922499+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:15.922499+0000","last_undegraded":"2024-05-10T09:58:15.922499+0000","last_fullsized":"2024-05-10T09:58:15.922499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654023+0000","last_change":"2024-05-10T09:54:41.664854+0000","last_active":"2024-05-10T09:58:04.654023+0000","last_peered":"2024-05-10T09:58:04.654023+0000","last_clean":"2024-05-10T09:58:04.654023+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:04.654023+0000","last_undegraded":"2024-05-10T09:58:04.654023+0000","last_fullsized":"2024-05-10T09:58:04.654023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:17:59.025265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'22","reported_seq":244,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.859917+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:58:15.859917+0000","last_peered":"2024-05-10T09:58:15.859917+0000","last_clean":"2024-05-10T09:58:15.859917+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:15.859917+0000","last_undegraded":"2024-05-10T09:58:15.859917+0000","last_fullsized":"2024-05-10T09:58:15.859917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:52:28.148847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":36880,"num_write":52,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649869+0000","last_change":"2024-05-10T09:54:41.681115+0000","last_active":"2024-05-10T09:58:04.649869+0000","last_peered":"2024-05-10T09:58:04.649869+0000","last_clean":"2024-05-10T09:58:04.649869+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:04.649869+0000","last_undegraded":"2024-05-10T09:58:04.649869+0000","last_fullsized":"2024-05-10T09:58:04.649869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"110'20","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.806774+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:58:15.806774+0000","last_peered":"2024-05-10T09:58:15.806774+0000","last_clean":"2024-05-10T09:58:15.806774+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:15.806774+0000","last_undegraded":"2024-05-10T09:58:15.806774+0000","last_fullsized":"2024-05-10T09:58:15.806774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:39.409064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":34834,"num_write":50,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530476+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:58:04.530476+0000","last_peered":"2024-05-10T09:58:04.530476+0000","last_clean":"2024-05-10T09:58:04.530476+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:04.530476+0000","last_undegraded":"2024-05-10T09:58:04.530476+0000","last_fullsized":"2024-05-10T09:58:04.530476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:07.415307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'18","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.908535+0000","last_change":"2024-05-10T09:54:39.643317+0000","last_active":"2024-05-10T09:58:15.908535+0000","last_peered":"2024-05-10T09:58:15.908535+0000","last_clean":"2024-05-10T09:58:15.908535+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:15.908535+0000","last_undegraded":"2024-05-10T09:58:15.908535+0000","last_fullsized":"2024-05-10T09:58:15.908535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36864,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650180+0000","last_change":"2024-05-10T09:54:41.664899+0000","last_active":"2024-05-10T09:58:04.650180+0000","last_peered":"2024-05-10T09:58:04.650180+0000","last_clean":"2024-05-10T09:58:04.650180+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:04.650180+0000","last_undegraded":"2024-05-10T09:58:04.650180+0000","last_fullsized":"2024-05-10T09:58:04.650180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:01:35.366327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'22","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.708766+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:58:15.708766+0000","last_peered":"2024-05-10T09:58:15.708766+0000","last_clean":"2024-05-10T09:58:15.708766+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:15.708766+0000","last_undegraded":"2024-05-10T09:58:15.708766+0000","last_fullsized":"2024-05-10T09:58:15.708766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:50:00.419200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":36882,"num_write":52,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"110'16","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.860445+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:58:15.860445+0000","last_peered":"2024-05-10T09:58:15.860445+0000","last_clean":"2024-05-10T09:58:15.860445+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:15.860445+0000","last_undegraded":"2024-05-10T09:58:15.860445+0000","last_fullsized":"2024-05-10T09:58:15.860445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:40:46.839040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653251+0000","last_change":"2024-05-10T09:54:41.656479+0000","last_active":"2024-05-10T09:58:04.653251+0000","last_peered":"2024-05-10T09:58:04.653251+0000","last_clean":"2024-05-10T09:58:04.653251+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:04.653251+0000","last_undegraded":"2024-05-10T09:58:04.653251+0000","last_fullsized":"2024-05-10T09:58:04.653251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'16","reported_seq":231,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.633537+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:58:15.633537+0000","last_peered":"2024-05-10T09:58:15.633537+0000","last_clean":"2024-05-10T09:58:15.633537+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:15.633537+0000","last_undegraded":"2024-05-10T09:58:15.633537+0000","last_fullsized":"2024-05-10T09:58:15.633537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:05.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24582,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657058+0000","last_change":"2024-05-10T09:54:41.666365+0000","last_active":"2024-05-10T09:58:04.657058+0000","last_peered":"2024-05-10T09:58:04.657058+0000","last_clean":"2024-05-10T09:58:04.657058+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:04.657058+0000","last_undegraded":"2024-05-10T09:58:04.657058+0000","last_fullsized":"2024-05-10T09:58:04.657058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:45:17.840691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1213,"num_read_kb":1594,"num_write":779,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":707,"ondisk_log_size":707,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1522,"num_read_kb":2003600,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1949696,"data_stored":1353311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1339392,"data_stored":763712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509493,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1376256,"data_stored":763111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285584,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1292,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1323008,"data_stored":762774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1347584,"data_stored":762679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36644,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335196,"statfs":{"total":96636764160,"available":96599240704,"internally_reserved":0,"allocated":1318912,"data_stored":761845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37224,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1933312,"data_stored":1353153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40852,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330988,"statfs":{"total":96636764160,"available":96594931712,"internally_reserved":0,"allocated":1347584,"data_stored":762533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:58:22.786 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.786 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.786 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.786 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.786 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.786 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.786 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.786 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.787 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.788 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.789 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.790 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.791 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.792 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.793 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.794 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.795 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.796 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T09:54:26.508259+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=26, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.797 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.798 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.799 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.800 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.801 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.802 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.803 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.804 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.805 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.806 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.807 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.808 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.808 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.808 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.808 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.808 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.808 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.808 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.808 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.809 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.810 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.810 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.810 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.810 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.810 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.810 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.810 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.810 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.811 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.812 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.813 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.814 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.814 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.814 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:22.814 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T09:58:42.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:58:43.171 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:58:43.181 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:58:43.196 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2024-05-10T09:58:42.284488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723235,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4543,"num_read_kb":2006570,"num_write":3838,"num_write_kb":2050326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2633,"ondisk_log_size":2633,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282440,"kb_used_data":11656,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":754692280,"statfs":{"total":773094113280,"available":772804894720,"internally_reserved":0,"allocated":11935744,"data_stored":7283118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007192"},"pg_stats":[{"pgid":"3.3f","version":"110'20","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.937553+0000","last_change":"2024-05-10T09:54:39.654277+0000","last_active":"2024-05-10T09:58:15.937553+0000","last_peered":"2024-05-10T09:58:15.937553+0000","last_clean":"2024-05-10T09:58:15.937553+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:15.937553+0000","last_undegraded":"2024-05-10T09:58:15.937553+0000","last_fullsized":"2024-05-10T09:58:15.937553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":40,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650503+0000","last_change":"2024-05-10T09:57:09.650822+0000","last_active":"2024-05-10T09:58:04.650503+0000","last_peered":"2024-05-10T09:58:04.650503+0000","last_clean":"2024-05-10T09:58:04.650503+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:04.650503+0000","last_undegraded":"2024-05-10T09:58:04.650503+0000","last_fullsized":"2024-05-10T09:58:04.650503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'16","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.910087+0000","last_change":"2024-05-10T09:54:39.638377+0000","last_active":"2024-05-10T09:58:15.910087+0000","last_peered":"2024-05-10T09:58:15.910087+0000","last_clean":"2024-05-10T09:58:15.910087+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:15.910087+0000","last_undegraded":"2024-05-10T09:58:15.910087+0000","last_fullsized":"2024-05-10T09:58:15.910087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.737000+0000","last_change":"2024-05-10T09:58:33.737064+0000","last_active":"2024-05-10T09:58:33.737000+0000","last_peered":"2024-05-10T09:58:33.737000+0000","last_clean":"2024-05-10T09:58:33.737000+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:33.737000+0000","last_undegraded":"2024-05-10T09:58:33.737000+0000","last_fullsized":"2024-05-10T09:58:33.737000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'32","last_scrub_stamp":"2024-05-10T09:58:33.736797+0000","last_deep_scrub":"89'32","last_deep_scrub_stamp":"2024-05-10T09:58:33.736797+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.736797+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:05.981545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'14","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.872041+0000","last_change":"2024-05-10T09:54:39.629734+0000","last_active":"2024-05-10T09:58:15.872041+0000","last_peered":"2024-05-10T09:58:15.872041+0000","last_clean":"2024-05-10T09:58:15.872041+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:15.872041+0000","last_undegraded":"2024-05-10T09:58:15.872041+0000","last_fullsized":"2024-05-10T09:58:15.872041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28690,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":158,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528761+0000","last_change":"2024-05-10T09:57:09.633352+0000","last_active":"2024-05-10T09:58:04.528761+0000","last_peered":"2024-05-10T09:58:04.528761+0000","last_clean":"2024-05-10T09:58:04.528761+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:04.528761+0000","last_undegraded":"2024-05-10T09:58:04.528761+0000","last_fullsized":"2024-05-10T09:58:04.528761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'16","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.402468+0000","last_change":"2024-05-10T09:54:39.667704+0000","last_active":"2024-05-10T09:58:21.402468+0000","last_peered":"2024-05-10T09:58:21.402468+0000","last_clean":"2024-05-10T09:58:21.402468+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:21.402468+0000","last_undegraded":"2024-05-10T09:58:21.402468+0000","last_fullsized":"2024-05-10T09:58:21.402468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32792,"num_write":56,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.106220+0000","last_change":"2024-05-10T09:58:36.106341+0000","last_active":"2024-05-10T09:58:36.106220+0000","last_peered":"2024-05-10T09:58:36.106220+0000","last_clean":"2024-05-10T09:58:36.106220+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:36.106220+0000","last_undegraded":"2024-05-10T09:58:36.106220+0000","last_fullsized":"2024-05-10T09:58:36.106220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.105962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.105962+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.105962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:28.047939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"110'24","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.857320+0000","last_change":"2024-05-10T09:54:39.636675+0000","last_active":"2024-05-10T09:58:15.857320+0000","last_peered":"2024-05-10T09:58:15.857320+0000","last_clean":"2024-05-10T09:58:15.857320+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:15.857320+0000","last_undegraded":"2024-05-10T09:58:15.857320+0000","last_fullsized":"2024-05-10T09:58:15.857320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":43032,"num_write":64,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.544593+0000","last_change":"2024-05-10T09:58:36.544696+0000","last_active":"2024-05-10T09:58:36.544593+0000","last_peered":"2024-05-10T09:58:36.544593+0000","last_clean":"2024-05-10T09:58:36.544593+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:36.544593+0000","last_undegraded":"2024-05-10T09:58:36.544593+0000","last_fullsized":"2024-05-10T09:58:36.544593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.544306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.544306+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.544306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:08.789054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'18","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.397600+0000","last_change":"2024-05-10T09:58:39.397763+0000","last_active":"2024-05-10T09:58:39.397600+0000","last_peered":"2024-05-10T09:58:39.397600+0000","last_clean":"2024-05-10T09:58:39.397600+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:39.397600+0000","last_undegraded":"2024-05-10T09:58:39.397600+0000","last_fullsized":"2024-05-10T09:58:39.397600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:39.397381+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:39.397381+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.397381+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:23:14.181483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":36876,"num_write":38,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529788+0000","last_change":"2024-05-10T09:57:09.827510+0000","last_active":"2024-05-10T09:58:04.529788+0000","last_peered":"2024-05-10T09:58:04.529788+0000","last_clean":"2024-05-10T09:58:04.529788+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:04.529788+0000","last_undegraded":"2024-05-10T09:58:04.529788+0000","last_fullsized":"2024-05-10T09:58:04.529788+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'8","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.488851+0000","last_change":"2024-05-10T09:58:35.488913+0000","last_active":"2024-05-10T09:58:35.488851+0000","last_peered":"2024-05-10T09:58:35.488851+0000","last_clean":"2024-05-10T09:58:35.488851+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:35.488851+0000","last_undegraded":"2024-05-10T09:58:35.488851+0000","last_fullsized":"2024-05-10T09:58:35.488851+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'8","last_scrub_stamp":"2024-05-10T09:58:35.488651+0000","last_deep_scrub":"110'8","last_deep_scrub_stamp":"2024-05-10T09:58:35.488651+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.488651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:50.432986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.418640+0000","last_change":"2024-05-10T09:58:31.418697+0000","last_active":"2024-05-10T09:58:31.418640+0000","last_peered":"2024-05-10T09:58:31.418640+0000","last_clean":"2024-05-10T09:58:31.418640+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:31.418640+0000","last_undegraded":"2024-05-10T09:58:31.418640+0000","last_fullsized":"2024-05-10T09:58:31.418640+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.418452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.418452+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.418452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:54.823224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'12","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.920446+0000","last_change":"2024-05-10T09:54:39.663951+0000","last_active":"2024-05-10T09:58:15.920446+0000","last_peered":"2024-05-10T09:58:15.920446+0000","last_clean":"2024-05-10T09:58:15.920446+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:15.920446+0000","last_undegraded":"2024-05-10T09:58:15.920446+0000","last_fullsized":"2024-05-10T09:58:15.920446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.454414+0000","last_change":"2024-05-10T09:58:25.454471+0000","last_active":"2024-05-10T09:58:25.454414+0000","last_peered":"2024-05-10T09:58:25.454414+0000","last_clean":"2024-05-10T09:58:25.454414+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:25.454414+0000","last_undegraded":"2024-05-10T09:58:25.454414+0000","last_fullsized":"2024-05-10T09:58:25.454414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.454208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.454208+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.454208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:38.690662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":158,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527812+0000","last_change":"2024-05-10T09:57:09.644357+0000","last_active":"2024-05-10T09:58:04.527812+0000","last_peered":"2024-05-10T09:58:04.527812+0000","last_clean":"2024-05-10T09:58:04.527812+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:04.527812+0000","last_undegraded":"2024-05-10T09:58:04.527812+0000","last_fullsized":"2024-05-10T09:58:04.527812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"110'12","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.731448+0000","last_change":"2024-05-10T09:58:39.731579+0000","last_active":"2024-05-10T09:58:39.731448+0000","last_peered":"2024-05-10T09:58:39.731448+0000","last_clean":"2024-05-10T09:58:39.731448+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:39.731448+0000","last_undegraded":"2024-05-10T09:58:39.731448+0000","last_fullsized":"2024-05-10T09:58:39.731448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:39.731164+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:39.731164+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.731164+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:29.497714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.746367+0000","last_change":"2024-05-10T09:58:31.746420+0000","last_active":"2024-05-10T09:58:31.746367+0000","last_peered":"2024-05-10T09:58:31.746367+0000","last_clean":"2024-05-10T09:58:31.746367+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:31.746367+0000","last_undegraded":"2024-05-10T09:58:31.746367+0000","last_fullsized":"2024-05-10T09:58:31.746367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.746174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.746174+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.746174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:02.939549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'12","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.524565+0000","last_change":"2024-05-10T09:58:39.524692+0000","last_active":"2024-05-10T09:58:39.524565+0000","last_peered":"2024-05-10T09:58:39.524565+0000","last_clean":"2024-05-10T09:58:39.524565+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:39.524565+0000","last_undegraded":"2024-05-10T09:58:39.524565+0000","last_fullsized":"2024-05-10T09:58:39.524565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:39.524324+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:39.524324+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.524324+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:18.460188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.370826+0000","last_change":"2024-05-10T09:58:35.370887+0000","last_active":"2024-05-10T09:58:35.370826+0000","last_peered":"2024-05-10T09:58:35.370826+0000","last_clean":"2024-05-10T09:58:35.370826+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:35.370826+0000","last_undegraded":"2024-05-10T09:58:35.370826+0000","last_fullsized":"2024-05-10T09:58:35.370826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'34","last_scrub_stamp":"2024-05-10T09:58:35.370626+0000","last_deep_scrub":"89'34","last_deep_scrub_stamp":"2024-05-10T09:58:35.370626+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.370626+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:38.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'10","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.548047+0000","last_change":"2024-05-10T09:58:35.548111+0000","last_active":"2024-05-10T09:58:35.548047+0000","last_peered":"2024-05-10T09:58:35.548047+0000","last_clean":"2024-05-10T09:58:35.548047+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:35.548047+0000","last_undegraded":"2024-05-10T09:58:35.548047+0000","last_fullsized":"2024-05-10T09:58:35.548047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-05-10T09:58:35.547851+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-05-10T09:58:35.547851+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.547851+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:21.685540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.500980+0000","last_change":"2024-05-10T09:58:26.501035+0000","last_active":"2024-05-10T09:58:26.500980+0000","last_peered":"2024-05-10T09:58:26.500980+0000","last_clean":"2024-05-10T09:58:26.500980+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:26.500980+0000","last_undegraded":"2024-05-10T09:58:26.500980+0000","last_fullsized":"2024-05-10T09:58:26.500980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.500752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.500752+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.500752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:14.199743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"110'34","reported_seq":214,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.908768+0000","last_change":"2024-05-10T09:57:10.337709+0000","last_active":"2024-05-10T09:58:15.908768+0000","last_peered":"2024-05-10T09:58:15.908768+0000","last_clean":"2024-05-10T09:58:15.908768+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:15.908768+0000","last_undegraded":"2024-05-10T09:58:15.908768+0000","last_fullsized":"2024-05-10T09:58:15.908768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":61452,"num_write":54,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":240,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.440776+0000","last_change":"2024-05-10T09:58:38.440840+0000","last_active":"2024-05-10T09:58:38.440776+0000","last_peered":"2024-05-10T09:58:38.440776+0000","last_clean":"2024-05-10T09:58:38.440776+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:38.440776+0000","last_undegraded":"2024-05-10T09:58:38.440776+0000","last_fullsized":"2024-05-10T09:58:38.440776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:38.440564+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:38.440564+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.440564+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:05.058211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'8","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.824175+0000","last_change":"2024-05-10T09:54:39.629925+0000","last_active":"2024-05-10T09:58:15.824175+0000","last_peered":"2024-05-10T09:58:15.824175+0000","last_clean":"2024-05-10T09:58:15.824175+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:15.824175+0000","last_undegraded":"2024-05-10T09:58:15.824175+0000","last_fullsized":"2024-05-10T09:58:15.824175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":158,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529796+0000","last_change":"2024-05-10T09:57:09.643976+0000","last_active":"2024-05-10T09:58:04.529796+0000","last_peered":"2024-05-10T09:58:04.529796+0000","last_clean":"2024-05-10T09:58:04.529796+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:04.529796+0000","last_undegraded":"2024-05-10T09:58:04.529796+0000","last_fullsized":"2024-05-10T09:58:04.529796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"110'18","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.962248+0000","last_change":"2024-05-10T09:54:39.636073+0000","last_active":"2024-05-10T09:58:15.962248+0000","last_peered":"2024-05-10T09:58:15.962248+0000","last_clean":"2024-05-10T09:58:15.962248+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:15.962248+0000","last_undegraded":"2024-05-10T09:58:15.962248+0000","last_fullsized":"2024-05-10T09:58:15.962248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30720,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":73,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528256+0000","last_change":"2024-05-10T09:57:09.645016+0000","last_active":"2024-05-10T09:58:04.528256+0000","last_peered":"2024-05-10T09:58:04.528256+0000","last_clean":"2024-05-10T09:58:04.528256+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:04.528256+0000","last_undegraded":"2024-05-10T09:58:04.528256+0000","last_fullsized":"2024-05-10T09:58:04.528256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.688936+0000","last_change":"2024-05-10T09:58:32.688993+0000","last_active":"2024-05-10T09:58:32.688936+0000","last_peered":"2024-05-10T09:58:32.688936+0000","last_clean":"2024-05-10T09:58:32.688936+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:32.688936+0000","last_undegraded":"2024-05-10T09:58:32.688936+0000","last_fullsized":"2024-05-10T09:58:32.688936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.688703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.688703+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.688703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:51.398393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"110'16","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.927060+0000","last_change":"2024-05-10T09:57:10.212256+0000","last_active":"2024-05-10T09:58:15.927060+0000","last_peered":"2024-05-10T09:58:15.927060+0000","last_clean":"2024-05-10T09:58:15.927060+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:15.927060+0000","last_undegraded":"2024-05-10T09:58:15.927060+0000","last_fullsized":"2024-05-10T09:58:15.927060+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":18442,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.421152+0000","last_change":"2024-05-10T09:58:36.421282+0000","last_active":"2024-05-10T09:58:36.421152+0000","last_peered":"2024-05-10T09:58:36.421152+0000","last_clean":"2024-05-10T09:58:36.421152+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:36.421152+0000","last_undegraded":"2024-05-10T09:58:36.421152+0000","last_fullsized":"2024-05-10T09:58:36.421152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.420867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.420867+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.420867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:25.605867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'18","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.665104+0000","last_change":"2024-05-10T09:54:45.687737+0000","last_active":"2024-05-10T09:58:15.665104+0000","last_peered":"2024-05-10T09:58:15.665104+0000","last_clean":"2024-05-10T09:58:15.665104+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:15.665104+0000","last_undegraded":"2024-05-10T09:58:15.665104+0000","last_fullsized":"2024-05-10T09:58:15.665104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.705012+0000","last_change":"2024-05-10T09:58:34.705073+0000","last_active":"2024-05-10T09:58:34.705012+0000","last_peered":"2024-05-10T09:58:34.705012+0000","last_clean":"2024-05-10T09:58:34.705012+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:34.705012+0000","last_undegraded":"2024-05-10T09:58:34.705012+0000","last_fullsized":"2024-05-10T09:58:34.705012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.704808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.704808+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.704808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:07.936885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650327+0000","last_change":"2024-05-10T09:57:09.651471+0000","last_active":"2024-05-10T09:58:04.650327+0000","last_peered":"2024-05-10T09:58:04.650327+0000","last_clean":"2024-05-10T09:58:04.650327+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:04.650327+0000","last_undegraded":"2024-05-10T09:58:04.650327+0000","last_fullsized":"2024-05-10T09:58:04.650327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.439959+0000","last_change":"2024-05-10T09:58:29.440013+0000","last_active":"2024-05-10T09:58:29.439959+0000","last_peered":"2024-05-10T09:58:29.439959+0000","last_clean":"2024-05-10T09:58:29.439959+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:29.439959+0000","last_undegraded":"2024-05-10T09:58:29.439959+0000","last_fullsized":"2024-05-10T09:58:29.439959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.439758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.439758+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.439758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:15.577447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'18","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.857188+0000","last_change":"2024-05-10T09:54:39.630179+0000","last_active":"2024-05-10T09:58:15.857188+0000","last_peered":"2024-05-10T09:58:15.857188+0000","last_clean":"2024-05-10T09:58:15.857188+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:15.857188+0000","last_undegraded":"2024-05-10T09:58:15.857188+0000","last_fullsized":"2024-05-10T09:58:15.857188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.689999+0000","last_change":"2024-05-10T09:58:33.690132+0000","last_active":"2024-05-10T09:58:33.689999+0000","last_peered":"2024-05-10T09:58:33.689999+0000","last_clean":"2024-05-10T09:58:33.689999+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:33.689999+0000","last_undegraded":"2024-05-10T09:58:33.689999+0000","last_fullsized":"2024-05-10T09:58:33.689999+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.689780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.689780+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.689780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:25.631757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":94,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530734+0000","last_change":"2024-05-10T09:57:09.644247+0000","last_active":"2024-05-10T09:58:04.530734+0000","last_peered":"2024-05-10T09:58:04.530734+0000","last_clean":"2024-05-10T09:58:04.530734+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:04.530734+0000","last_undegraded":"2024-05-10T09:58:04.530734+0000","last_fullsized":"2024-05-10T09:58:04.530734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.997826+0000","last_change":"2024-05-10T09:58:28.997883+0000","last_active":"2024-05-10T09:58:28.997826+0000","last_peered":"2024-05-10T09:58:28.997826+0000","last_clean":"2024-05-10T09:58:28.997826+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:28.997826+0000","last_undegraded":"2024-05-10T09:58:28.997826+0000","last_fullsized":"2024-05-10T09:58:28.997826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.997630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.997630+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.997630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:58.539156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650111+0000","last_change":"2024-05-10T09:54:49.726574+0000","last_active":"2024-05-10T09:58:04.650111+0000","last_peered":"2024-05-10T09:58:04.650111+0000","last_clean":"2024-05-10T09:58:04.650111+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:04.650111+0000","last_undegraded":"2024-05-10T09:58:04.650111+0000","last_fullsized":"2024-05-10T09:58:04.650111+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.119463+0000","last_change":"2024-05-10T09:58:38.119530+0000","last_active":"2024-05-10T09:58:38.119463+0000","last_peered":"2024-05-10T09:58:38.119463+0000","last_clean":"2024-05-10T09:58:38.119463+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:38.119463+0000","last_undegraded":"2024-05-10T09:58:38.119463+0000","last_fullsized":"2024-05-10T09:58:38.119463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:38.119215+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:38.119215+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.119215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:08.511135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'20","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.850414+0000","last_change":"2024-05-10T09:57:11.654312+0000","last_active":"2024-05-10T09:58:15.850414+0000","last_peered":"2024-05-10T09:58:15.850414+0000","last_clean":"2024-05-10T09:58:15.850414+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:15.850414+0000","last_undegraded":"2024-05-10T09:58:15.850414+0000","last_fullsized":"2024-05-10T09:58:15.850414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":34834,"num_write":50,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.654992+0000","last_change":"2024-05-10T09:58:37.655086+0000","last_active":"2024-05-10T09:58:37.654992+0000","last_peered":"2024-05-10T09:58:37.654992+0000","last_clean":"2024-05-10T09:58:37.654992+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:37.654992+0000","last_undegraded":"2024-05-10T09:58:37.654992+0000","last_fullsized":"2024-05-10T09:58:37.654992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.654760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.654760+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.654760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.034677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"110'15","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.488930+0000","last_change":"2024-05-10T09:58:37.489092+0000","last_active":"2024-05-10T09:58:37.488930+0000","last_peered":"2024-05-10T09:58:37.488930+0000","last_clean":"2024-05-10T09:58:37.488930+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:37.488930+0000","last_undegraded":"2024-05-10T09:58:37.488930+0000","last_fullsized":"2024-05-10T09:58:37.488930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:37.488682+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:37.488682+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.488682+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:28.648725+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'18","reported_seq":239,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.979054+0000","last_change":"2024-05-10T09:54:47.711996+0000","last_active":"2024-05-10T09:58:15.979054+0000","last_peered":"2024-05-10T09:58:15.979054+0000","last_clean":"2024-05-10T09:58:15.979054+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:15.979054+0000","last_undegraded":"2024-05-10T09:58:15.979054+0000","last_fullsized":"2024-05-10T09:58:15.979054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":73,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529326+0000","last_change":"2024-05-10T09:57:09.648298+0000","last_active":"2024-05-10T09:58:04.529326+0000","last_peered":"2024-05-10T09:58:04.529326+0000","last_clean":"2024-05-10T09:58:04.529326+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:04.529326+0000","last_undegraded":"2024-05-10T09:58:04.529326+0000","last_fullsized":"2024-05-10T09:58:04.529326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.613907+0000","last_change":"2024-05-10T09:58:38.613964+0000","last_active":"2024-05-10T09:58:38.613907+0000","last_peered":"2024-05-10T09:58:38.613907+0000","last_clean":"2024-05-10T09:58:38.613907+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:38.613907+0000","last_undegraded":"2024-05-10T09:58:38.613907+0000","last_fullsized":"2024-05-10T09:58:38.613907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.613707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.613707+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.613707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:43.131314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'18","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.586366+0000","last_change":"2024-05-10T09:58:33.586500+0000","last_active":"2024-05-10T09:58:33.586366+0000","last_peered":"2024-05-10T09:58:33.586366+0000","last_clean":"2024-05-10T09:58:33.586366+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:33.586366+0000","last_undegraded":"2024-05-10T09:58:33.586366+0000","last_fullsized":"2024-05-10T09:58:33.586366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:33.586099+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:33.586099+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.586099+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:08.765872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.393466+0000","last_change":"2024-05-10T09:58:32.393522+0000","last_active":"2024-05-10T09:58:32.393466+0000","last_peered":"2024-05-10T09:58:32.393466+0000","last_clean":"2024-05-10T09:58:32.393466+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:32.393466+0000","last_undegraded":"2024-05-10T09:58:32.393466+0000","last_fullsized":"2024-05-10T09:58:32.393466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.393279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.393279+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.393279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:25:32.242983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'20","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.728239+0000","last_change":"2024-05-10T09:58:32.728406+0000","last_active":"2024-05-10T09:58:32.728239+0000","last_peered":"2024-05-10T09:58:32.728239+0000","last_clean":"2024-05-10T09:58:32.728239+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:32.728239+0000","last_undegraded":"2024-05-10T09:58:32.728239+0000","last_fullsized":"2024-05-10T09:58:32.728239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:32.727966+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:32.727966+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.727966+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:18.865655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"110'18","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.618816+0000","last_change":"2024-05-10T09:58:23.618883+0000","last_active":"2024-05-10T09:58:23.618816+0000","last_peered":"2024-05-10T09:58:23.618816+0000","last_clean":"2024-05-10T09:58:23.618816+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:23.618816+0000","last_undegraded":"2024-05-10T09:58:23.618816+0000","last_fullsized":"2024-05-10T09:58:23.618816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:23.618614+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:23.618614+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.618614+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:54.811989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.418848+0000","last_change":"2024-05-10T09:58:30.418905+0000","last_active":"2024-05-10T09:58:30.418848+0000","last_peered":"2024-05-10T09:58:30.418848+0000","last_clean":"2024-05-10T09:58:30.418848+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:30.418848+0000","last_undegraded":"2024-05-10T09:58:30.418848+0000","last_fullsized":"2024-05-10T09:58:30.418848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.418650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.418650+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.418650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:38:28.888661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'12","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.708400+0000","last_change":"2024-05-10T09:57:11.042953+0000","last_active":"2024-05-10T09:58:15.708400+0000","last_peered":"2024-05-10T09:58:15.708400+0000","last_clean":"2024-05-10T09:58:15.708400+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:15.708400+0000","last_undegraded":"2024-05-10T09:58:15.708400+0000","last_fullsized":"2024-05-10T09:58:15.708400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":18444,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.731858+0000","last_change":"2024-05-10T09:58:29.731914+0000","last_active":"2024-05-10T09:58:29.731858+0000","last_peered":"2024-05-10T09:58:29.731858+0000","last_clean":"2024-05-10T09:58:29.731858+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:29.731858+0000","last_undegraded":"2024-05-10T09:58:29.731858+0000","last_fullsized":"2024-05-10T09:58:29.731858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.731667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.731667+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.731667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:28.054350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'35","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.520764+0000","last_change":"2024-05-10T09:58:27.520851+0000","last_active":"2024-05-10T09:58:27.520764+0000","last_peered":"2024-05-10T09:58:27.520764+0000","last_clean":"2024-05-10T09:58:27.520764+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:27.520764+0000","last_undegraded":"2024-05-10T09:58:27.520764+0000","last_fullsized":"2024-05-10T09:58:27.520764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'35","last_scrub_stamp":"2024-05-10T09:58:27.520581+0000","last_deep_scrub":"110'35","last_deep_scrub_stamp":"2024-05-10T09:58:27.520581+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.520581+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:51.985220+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.735893+0000","last_change":"2024-05-10T09:58:26.735956+0000","last_active":"2024-05-10T09:58:26.735893+0000","last_peered":"2024-05-10T09:58:26.735893+0000","last_clean":"2024-05-10T09:58:26.735893+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:26.735893+0000","last_undegraded":"2024-05-10T09:58:26.735893+0000","last_fullsized":"2024-05-10T09:58:26.735893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.735648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.735648+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.735648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:39.607212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653710+0000","last_change":"2024-05-10T09:57:09.663395+0000","last_active":"2024-05-10T09:58:04.653710+0000","last_peered":"2024-05-10T09:58:04.653710+0000","last_clean":"2024-05-10T09:58:04.653710+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:04.653710+0000","last_undegraded":"2024-05-10T09:58:04.653710+0000","last_fullsized":"2024-05-10T09:58:04.653710+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.113342+0000","last_change":"2024-05-10T09:58:36.113416+0000","last_active":"2024-05-10T09:58:36.113342+0000","last_peered":"2024-05-10T09:58:36.113342+0000","last_clean":"2024-05-10T09:58:36.113342+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:36.113342+0000","last_undegraded":"2024-05-10T09:58:36.113342+0000","last_fullsized":"2024-05-10T09:58:36.113342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:36.113103+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:36.113103+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.113103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:20.605682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'20","reported_seq":243,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.861148+0000","last_change":"2024-05-10T09:57:11.420336+0000","last_active":"2024-05-10T09:58:15.861148+0000","last_peered":"2024-05-10T09:58:15.861148+0000","last_clean":"2024-05-10T09:58:15.861148+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:15.861148+0000","last_undegraded":"2024-05-10T09:58:15.861148+0000","last_fullsized":"2024-05-10T09:58:15.861148+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38930,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.562833+0000","last_change":"2024-05-10T09:58:22.562854+0000","last_active":"2024-05-10T09:58:22.562833+0000","last_peered":"2024-05-10T09:58:22.562833+0000","last_clean":"2024-05-10T09:58:22.562833+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:22.562833+0000","last_undegraded":"2024-05-10T09:58:22.562833+0000","last_fullsized":"2024-05-10T09:58:22.562833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.562754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.562754+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.562754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:32.614610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'19","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.967579+0000","last_change":"2024-05-10T09:54:45.687537+0000","last_active":"2024-05-10T09:58:15.967579+0000","last_peered":"2024-05-10T09:58:15.967579+0000","last_clean":"2024-05-10T09:58:15.967579+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:15.967579+0000","last_undegraded":"2024-05-10T09:58:15.967579+0000","last_fullsized":"2024-05-10T09:58:15.967579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.580361+0000","last_change":"2024-05-10T09:58:22.580404+0000","last_active":"2024-05-10T09:58:22.580361+0000","last_peered":"2024-05-10T09:58:22.580361+0000","last_clean":"2024-05-10T09:58:22.580361+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:22.580361+0000","last_undegraded":"2024-05-10T09:58:22.580361+0000","last_fullsized":"2024-05-10T09:58:22.580361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.580217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.580217+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.580217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:31:57.759990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.660980+0000","last_change":"2024-05-10T09:57:10.285456+0000","last_active":"2024-05-10T09:58:04.660980+0000","last_peered":"2024-05-10T09:58:04.660980+0000","last_clean":"2024-05-10T09:58:04.660980+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:04.660980+0000","last_undegraded":"2024-05-10T09:58:04.660980+0000","last_fullsized":"2024-05-10T09:58:04.660980+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.558940+0000","last_change":"2024-05-10T09:58:30.559000+0000","last_active":"2024-05-10T09:58:30.558940+0000","last_peered":"2024-05-10T09:58:30.558940+0000","last_clean":"2024-05-10T09:58:30.558940+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:30.558940+0000","last_undegraded":"2024-05-10T09:58:30.558940+0000","last_fullsized":"2024-05-10T09:58:30.558940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.558746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.558746+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.558746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.963440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'16","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.916554+0000","last_change":"2024-05-10T09:54:39.665330+0000","last_active":"2024-05-10T09:58:15.916554+0000","last_peered":"2024-05-10T09:58:15.916554+0000","last_clean":"2024-05-10T09:58:15.916554+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:15.916554+0000","last_undegraded":"2024-05-10T09:58:15.916554+0000","last_fullsized":"2024-05-10T09:58:15.916554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.439441+0000","last_change":"2024-05-10T09:58:29.439613+0000","last_active":"2024-05-10T09:58:29.439441+0000","last_peered":"2024-05-10T09:58:29.439441+0000","last_clean":"2024-05-10T09:58:29.439441+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:29.439441+0000","last_undegraded":"2024-05-10T09:58:29.439441+0000","last_fullsized":"2024-05-10T09:58:29.439441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.439219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.439219+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.439219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:09:31.720031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'29","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.686141+0000","last_change":"2024-05-10T09:58:25.686292+0000","last_active":"2024-05-10T09:58:25.686141+0000","last_peered":"2024-05-10T09:58:25.686141+0000","last_clean":"2024-05-10T09:58:25.686141+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:25.686141+0000","last_undegraded":"2024-05-10T09:58:25.686141+0000","last_fullsized":"2024-05-10T09:58:25.686141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'29","last_scrub_stamp":"2024-05-10T09:58:25.685859+0000","last_deep_scrub":"110'29","last_deep_scrub_stamp":"2024-05-10T09:58:25.685859+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.685859+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:46.184892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'18","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.085482+0000","last_change":"2024-05-10T09:58:24.085550+0000","last_active":"2024-05-10T09:58:24.085482+0000","last_peered":"2024-05-10T09:58:24.085482+0000","last_clean":"2024-05-10T09:58:24.085482+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:24.085482+0000","last_undegraded":"2024-05-10T09:58:24.085482+0000","last_fullsized":"2024-05-10T09:58:24.085482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.085290+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.085290+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.085290+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:22.407972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652597+0000","last_change":"2024-05-10T09:54:49.725659+0000","last_active":"2024-05-10T09:58:04.652597+0000","last_peered":"2024-05-10T09:58:04.652597+0000","last_clean":"2024-05-10T09:58:04.652597+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:04.652597+0000","last_undegraded":"2024-05-10T09:58:04.652597+0000","last_fullsized":"2024-05-10T09:58:04.652597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.049200+0000","last_change":"2024-05-10T09:58:30.049267+0000","last_active":"2024-05-10T09:58:30.049200+0000","last_peered":"2024-05-10T09:58:30.049200+0000","last_clean":"2024-05-10T09:58:30.049200+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:30.049200+0000","last_undegraded":"2024-05-10T09:58:30.049200+0000","last_fullsized":"2024-05-10T09:58:30.049200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'42","last_scrub_stamp":"2024-05-10T09:58:30.049003+0000","last_deep_scrub":"89'42","last_deep_scrub_stamp":"2024-05-10T09:58:30.049003+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.049003+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:30.409395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'24","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.927018+0000","last_change":"2024-05-10T09:54:39.664200+0000","last_active":"2024-05-10T09:58:15.927018+0000","last_peered":"2024-05-10T09:58:15.927018+0000","last_clean":"2024-05-10T09:58:15.927018+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:15.927018+0000","last_undegraded":"2024-05-10T09:58:15.927018+0000","last_fullsized":"2024-05-10T09:58:15.927018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":49170,"num_write":54,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.473944+0000","last_change":"2024-05-10T09:58:36.473998+0000","last_active":"2024-05-10T09:58:36.473944+0000","last_peered":"2024-05-10T09:58:36.473944+0000","last_clean":"2024-05-10T09:58:36.473944+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:36.473944+0000","last_undegraded":"2024-05-10T09:58:36.473944+0000","last_fullsized":"2024-05-10T09:58:36.473944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.473749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.473749+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.473749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.723420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'35","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.142029+0000","last_change":"2024-05-10T09:58:39.142110+0000","last_active":"2024-05-10T09:58:39.142029+0000","last_peered":"2024-05-10T09:58:39.142029+0000","last_clean":"2024-05-10T09:58:39.142029+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:39.142029+0000","last_undegraded":"2024-05-10T09:58:39.142029+0000","last_fullsized":"2024-05-10T09:58:39.142029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'35","last_scrub_stamp":"2024-05-10T09:58:39.141835+0000","last_deep_scrub":"110'35","last_deep_scrub_stamp":"2024-05-10T09:58:39.141835+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.141835+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:49.105710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":59,"num_read_kb":98,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.489069+0000","last_change":"2024-05-10T09:58:32.489127+0000","last_active":"2024-05-10T09:58:32.489069+0000","last_peered":"2024-05-10T09:58:32.489069+0000","last_clean":"2024-05-10T09:58:32.489069+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:32.489069+0000","last_undegraded":"2024-05-10T09:58:32.489069+0000","last_fullsized":"2024-05-10T09:58:32.489069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.488872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.488872+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.488872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:29.913561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646935+0000","last_change":"2024-05-10T09:54:49.723278+0000","last_active":"2024-05-10T09:58:04.646935+0000","last_peered":"2024-05-10T09:58:04.646935+0000","last_clean":"2024-05-10T09:58:04.646935+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:04.646935+0000","last_undegraded":"2024-05-10T09:58:04.646935+0000","last_fullsized":"2024-05-10T09:58:04.646935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.034595+0000","last_change":"2024-05-10T09:58:28.034649+0000","last_active":"2024-05-10T09:58:28.034595+0000","last_peered":"2024-05-10T09:58:28.034595+0000","last_clean":"2024-05-10T09:58:28.034595+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:28.034595+0000","last_undegraded":"2024-05-10T09:58:28.034595+0000","last_fullsized":"2024-05-10T09:58:28.034595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.034404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.034404+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.034404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:09:35.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'14","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.894438+0000","last_change":"2024-05-10T09:54:39.621722+0000","last_active":"2024-05-10T09:58:15.894438+0000","last_peered":"2024-05-10T09:58:15.894438+0000","last_clean":"2024-05-10T09:58:15.894438+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:15.894438+0000","last_undegraded":"2024-05-10T09:58:15.894438+0000","last_fullsized":"2024-05-10T09:58:15.894438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28696,"num_write":54,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.404205+0000","last_change":"2024-05-10T09:58:30.404259+0000","last_active":"2024-05-10T09:58:30.404205+0000","last_peered":"2024-05-10T09:58:30.404205+0000","last_clean":"2024-05-10T09:58:30.404205+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:30.404205+0000","last_undegraded":"2024-05-10T09:58:30.404205+0000","last_fullsized":"2024-05-10T09:58:30.404205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.404013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.404013+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.404013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:53.231386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'23","reported_seq":123,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.469659+0000","last_change":"2024-05-10T09:57:10.017038+0000","last_active":"2024-05-10T09:58:15.469659+0000","last_peered":"2024-05-10T09:58:15.469659+0000","last_clean":"2024-05-10T09:58:15.469659+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:15.469659+0000","last_undegraded":"2024-05-10T09:58:15.469659+0000","last_fullsized":"2024-05-10T09:58:15.469659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":62,"num_write":32,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:19.097639+0000","last_change":"2024-05-10T09:58:19.097693+0000","last_active":"2024-05-10T09:58:19.097639+0000","last_peered":"2024-05-10T09:58:19.097639+0000","last_clean":"2024-05-10T09:58:19.097639+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:19.097639+0000","last_undegraded":"2024-05-10T09:58:19.097639+0000","last_fullsized":"2024-05-10T09:58:19.097639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:19.097509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:19.097509+0000","last_clean_scrub_stamp":"2024-05-10T09:58:19.097509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.252931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.686066+0000","last_change":"2024-05-10T09:58:25.686138+0000","last_active":"2024-05-10T09:58:25.686066+0000","last_peered":"2024-05-10T09:58:25.686066+0000","last_clean":"2024-05-10T09:58:25.686066+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:25.686066+0000","last_undegraded":"2024-05-10T09:58:25.686066+0000","last_fullsized":"2024-05-10T09:58:25.686066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.685801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.685801+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.685801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:57.930550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.103814+0000","last_change":"2024-05-10T09:58:33.103870+0000","last_active":"2024-05-10T09:58:33.103814+0000","last_peered":"2024-05-10T09:58:33.103814+0000","last_clean":"2024-05-10T09:58:33.103814+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:33.103814+0000","last_undegraded":"2024-05-10T09:58:33.103814+0000","last_fullsized":"2024-05-10T09:58:33.103814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.103627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.103627+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.103627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:21.064029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'12","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.852186+0000","last_change":"2024-05-10T09:57:11.211802+0000","last_active":"2024-05-10T09:58:15.852186+0000","last_peered":"2024-05-10T09:58:15.852186+0000","last_clean":"2024-05-10T09:58:15.852186+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:15.852186+0000","last_undegraded":"2024-05-10T09:58:15.852186+0000","last_fullsized":"2024-05-10T09:58:15.852186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646754+0000","last_change":"2024-05-10T09:57:09.662993+0000","last_active":"2024-05-10T09:58:04.646754+0000","last_peered":"2024-05-10T09:58:04.646754+0000","last_clean":"2024-05-10T09:58:04.646754+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:04.646754+0000","last_undegraded":"2024-05-10T09:58:04.646754+0000","last_fullsized":"2024-05-10T09:58:04.646754+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'32","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.560442+0000","last_change":"2024-05-10T09:58:21.560479+0000","last_active":"2024-05-10T09:58:21.560442+0000","last_peered":"2024-05-10T09:58:21.560442+0000","last_clean":"2024-05-10T09:58:21.560442+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:21.560442+0000","last_undegraded":"2024-05-10T09:58:21.560442+0000","last_fullsized":"2024-05-10T09:58:21.560442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'32","last_scrub_stamp":"2024-05-10T09:58:21.560361+0000","last_deep_scrub":"110'32","last_deep_scrub_stamp":"2024-05-10T09:58:21.560361+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.560361+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:36.972412+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":68,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'18","reported_seq":263,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.440450+0000","last_change":"2024-05-10T09:58:31.440554+0000","last_active":"2024-05-10T09:58:31.440450+0000","last_peered":"2024-05-10T09:58:31.440450+0000","last_clean":"2024-05-10T09:58:31.440450+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:31.440450+0000","last_undegraded":"2024-05-10T09:58:31.440450+0000","last_fullsized":"2024-05-10T09:58:31.440450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:31.440173+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:31.440173+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.440173+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:41.837626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.648321+0000","last_change":"2024-05-10T09:54:49.721802+0000","last_active":"2024-05-10T09:58:04.648321+0000","last_peered":"2024-05-10T09:58:04.648321+0000","last_clean":"2024-05-10T09:58:04.648321+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:04.648321+0000","last_undegraded":"2024-05-10T09:58:04.648321+0000","last_fullsized":"2024-05-10T09:58:04.648321+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.983470+0000","last_change":"2024-05-10T09:58:24.983604+0000","last_active":"2024-05-10T09:58:24.983470+0000","last_peered":"2024-05-10T09:58:24.983470+0000","last_clean":"2024-05-10T09:58:24.983470+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:24.983470+0000","last_undegraded":"2024-05-10T09:58:24.983470+0000","last_fullsized":"2024-05-10T09:58:24.983470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.983218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.983218+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.983218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:03.586274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'6","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.018057+0000","last_change":"2024-05-10T09:58:22.018176+0000","last_active":"2024-05-10T09:58:22.018057+0000","last_peered":"2024-05-10T09:58:22.018057+0000","last_clean":"2024-05-10T09:58:22.018057+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:22.018057+0000","last_undegraded":"2024-05-10T09:58:22.018057+0000","last_fullsized":"2024-05-10T09:58:22.018057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-05-10T09:58:22.017751+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-05-10T09:58:22.017751+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.017751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:36.819356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.241133+0000","last_change":"2024-05-10T09:57:09.642129+0000","last_active":"2024-05-10T09:58:15.241133+0000","last_peered":"2024-05-10T09:58:15.241133+0000","last_clean":"2024-05-10T09:58:15.241133+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:15.241133+0000","last_undegraded":"2024-05-10T09:58:15.241133+0000","last_fullsized":"2024-05-10T09:58:15.241133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"110'15","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.697050+0000","last_change":"2024-05-10T09:58:30.697133+0000","last_active":"2024-05-10T09:58:30.697050+0000","last_peered":"2024-05-10T09:58:30.697050+0000","last_clean":"2024-05-10T09:58:30.697050+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:30.697050+0000","last_undegraded":"2024-05-10T09:58:30.697050+0000","last_fullsized":"2024-05-10T09:58:30.697050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:30.696850+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:30.696850+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.696850+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:54.681885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'18","reported_seq":244,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.503929+0000","last_change":"2024-05-10T09:58:26.504000+0000","last_active":"2024-05-10T09:58:26.503929+0000","last_peered":"2024-05-10T09:58:26.503929+0000","last_clean":"2024-05-10T09:58:26.503929+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:26.503929+0000","last_undegraded":"2024-05-10T09:58:26.503929+0000","last_fullsized":"2024-05-10T09:58:26.503929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:26.503736+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:26.503736+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.503736+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:36:41.630591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":73,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528633+0000","last_change":"2024-05-10T09:57:09.638087+0000","last_active":"2024-05-10T09:58:04.528633+0000","last_peered":"2024-05-10T09:58:04.528633+0000","last_clean":"2024-05-10T09:58:04.528633+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:04.528633+0000","last_undegraded":"2024-05-10T09:58:04.528633+0000","last_fullsized":"2024-05-10T09:58:04.528633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.648600+0000","last_change":"2024-05-10T09:58:31.648667+0000","last_active":"2024-05-10T09:58:31.648600+0000","last_peered":"2024-05-10T09:58:31.648600+0000","last_clean":"2024-05-10T09:58:31.648600+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:31.648600+0000","last_undegraded":"2024-05-10T09:58:31.648600+0000","last_fullsized":"2024-05-10T09:58:31.648600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'46","last_scrub_stamp":"2024-05-10T09:58:31.648362+0000","last_deep_scrub":"89'46","last_deep_scrub_stamp":"2024-05-10T09:58:31.648362+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.648362+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:49.521946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.962074+0000","last_change":"2024-05-10T09:54:39.628145+0000","last_active":"2024-05-10T09:58:15.962074+0000","last_peered":"2024-05-10T09:58:15.962074+0000","last_clean":"2024-05-10T09:58:15.962074+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:15.962074+0000","last_undegraded":"2024-05-10T09:58:15.962074+0000","last_fullsized":"2024-05-10T09:58:15.962074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.073784+0000","last_change":"2024-05-10T09:58:35.073842+0000","last_active":"2024-05-10T09:58:35.073784+0000","last_peered":"2024-05-10T09:58:35.073784+0000","last_clean":"2024-05-10T09:58:35.073784+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:35.073784+0000","last_undegraded":"2024-05-10T09:58:35.073784+0000","last_fullsized":"2024-05-10T09:58:35.073784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.073567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.073567+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.073567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:45.269434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'28","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.681851+0000","last_change":"2024-05-10T09:54:45.680032+0000","last_active":"2024-05-10T09:58:15.681851+0000","last_peered":"2024-05-10T09:58:15.681851+0000","last_clean":"2024-05-10T09:58:15.681851+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:15.681851+0000","last_undegraded":"2024-05-10T09:58:15.681851+0000","last_fullsized":"2024-05-10T09:58:15.681851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":60,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.473295+0000","last_change":"2024-05-10T09:58:25.473352+0000","last_active":"2024-05-10T09:58:25.473295+0000","last_peered":"2024-05-10T09:58:25.473295+0000","last_clean":"2024-05-10T09:58:25.473295+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:25.473295+0000","last_undegraded":"2024-05-10T09:58:25.473295+0000","last_fullsized":"2024-05-10T09:58:25.473295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.473104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.473104+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.473104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:52.090751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":162,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647057+0000","last_change":"2024-05-10T09:54:49.725451+0000","last_active":"2024-05-10T09:58:04.647057+0000","last_peered":"2024-05-10T09:58:04.647057+0000","last_clean":"2024-05-10T09:58:04.647057+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:04.647057+0000","last_undegraded":"2024-05-10T09:58:04.647057+0000","last_fullsized":"2024-05-10T09:58:04.647057+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":239,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.656810+0000","last_change":"2024-05-10T09:57:11.425464+0000","last_active":"2024-05-10T09:58:04.656810+0000","last_peered":"2024-05-10T09:58:04.656810+0000","last_clean":"2024-05-10T09:58:04.656810+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:04.656810+0000","last_undegraded":"2024-05-10T09:58:04.656810+0000","last_fullsized":"2024-05-10T09:58:04.656810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":287,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.381442+0000","last_change":"2024-05-10T09:54:28.306804+0000","last_active":"2024-05-10T09:58:22.381442+0000","last_peered":"2024-05-10T09:58:22.381442+0000","last_clean":"2024-05-10T09:58:22.381442+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:22.381442+0000","last_undegraded":"2024-05-10T09:58:22.381442+0000","last_fullsized":"2024-05-10T09:58:22.381442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:26.508259+0000","last_clean_scrub_stamp":"2024-05-10T09:54:26.508259+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.652655+0000","last_change":"2024-05-10T09:54:33.580421+0000","last_active":"2024-05-10T09:58:04.652655+0000","last_peered":"2024-05-10T09:58:04.652655+0000","last_clean":"2024-05-10T09:58:04.652655+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:04.652655+0000","last_undegraded":"2024-05-10T09:58:04.652655+0000","last_fullsized":"2024-05-10T09:58:04.652655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":214,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.918294+0000","last_change":"2024-05-10T09:54:39.668744+0000","last_active":"2024-05-10T09:58:15.918294+0000","last_peered":"2024-05-10T09:58:15.918294+0000","last_clean":"2024-05-10T09:58:15.918294+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:15.918294+0000","last_undegraded":"2024-05-10T09:58:15.918294+0000","last_fullsized":"2024-05-10T09:58:15.918294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.760194+0000","last_change":"2024-05-10T09:58:27.760251+0000","last_active":"2024-05-10T09:58:27.760194+0000","last_peered":"2024-05-10T09:58:27.760194+0000","last_clean":"2024-05-10T09:58:27.760194+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:27.760194+0000","last_undegraded":"2024-05-10T09:58:27.760194+0000","last_fullsized":"2024-05-10T09:58:27.760194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.760005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.760005+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.760005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:09.164699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'43","reported_seq":238,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.889673+0000","last_change":"2024-05-10T09:54:45.679992+0000","last_active":"2024-05-10T09:58:15.889673+0000","last_peered":"2024-05-10T09:58:15.889673+0000","last_clean":"2024-05-10T09:58:15.889673+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:15.889673+0000","last_undegraded":"2024-05-10T09:58:15.889673+0000","last_fullsized":"2024-05-10T09:58:15.889673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":125,"num_write":52,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.070164+0000","last_change":"2024-05-10T09:58:23.070219+0000","last_active":"2024-05-10T09:58:23.070164+0000","last_peered":"2024-05-10T09:58:23.070164+0000","last_clean":"2024-05-10T09:58:23.070164+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:23.070164+0000","last_undegraded":"2024-05-10T09:58:23.070164+0000","last_fullsized":"2024-05-10T09:58:23.070164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.069925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.069925+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.069925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:23.967919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.545426+0000","last_change":"2024-05-10T09:58:27.545484+0000","last_active":"2024-05-10T09:58:27.545426+0000","last_peered":"2024-05-10T09:58:27.545426+0000","last_clean":"2024-05-10T09:58:27.545426+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:27.545426+0000","last_undegraded":"2024-05-10T09:58:27.545426+0000","last_fullsized":"2024-05-10T09:58:27.545426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.545228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.545228+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.545228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:30.775332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.017083+0000","last_change":"2024-05-10T09:58:28.017154+0000","last_active":"2024-05-10T09:58:28.017083+0000","last_peered":"2024-05-10T09:58:28.017083+0000","last_clean":"2024-05-10T09:58:28.017083+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:28.017083+0000","last_undegraded":"2024-05-10T09:58:28.017083+0000","last_fullsized":"2024-05-10T09:58:28.017083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.016873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.016873+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.016873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:00.261622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.381464+0000","last_change":"2024-05-10T09:54:33.578542+0000","last_active":"2024-05-10T09:58:22.381464+0000","last_peered":"2024-05-10T09:58:22.381464+0000","last_clean":"2024-05-10T09:58:22.381464+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:22.381464+0000","last_undegraded":"2024-05-10T09:58:22.381464+0000","last_fullsized":"2024-05-10T09:58:22.381464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'24","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.861116+0000","last_change":"2024-05-10T09:57:10.896047+0000","last_active":"2024-05-10T09:58:15.861116+0000","last_peered":"2024-05-10T09:58:15.861116+0000","last_clean":"2024-05-10T09:58:15.861116+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:15.861116+0000","last_undegraded":"2024-05-10T09:58:15.861116+0000","last_fullsized":"2024-05-10T09:58:15.861116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":45056,"num_write":24,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.398262+0000","last_change":"2024-05-10T09:58:34.398324+0000","last_active":"2024-05-10T09:58:34.398262+0000","last_peered":"2024-05-10T09:58:34.398262+0000","last_clean":"2024-05-10T09:58:34.398262+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:34.398262+0000","last_undegraded":"2024-05-10T09:58:34.398262+0000","last_fullsized":"2024-05-10T09:58:34.398262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.398073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.398073+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.398073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:45.040743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'72","reported_seq":326,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.724534+0000","last_change":"2024-05-10T09:58:20.724586+0000","last_active":"2024-05-10T09:58:20.724534+0000","last_peered":"2024-05-10T09:58:20.724534+0000","last_clean":"2024-05-10T09:58:20.724534+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:20.724534+0000","last_undegraded":"2024-05-10T09:58:20.724534+0000","last_fullsized":"2024-05-10T09:58:20.724534+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'72","last_scrub_stamp":"2024-05-10T09:58:20.724440+0000","last_deep_scrub":"110'72","last_deep_scrub_stamp":"2024-05-10T09:58:20.724440+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.724440+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:52.798878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":112,"num_read_kb":160,"num_write":66,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.745738+0000","last_change":"2024-05-10T09:58:36.745796+0000","last_active":"2024-05-10T09:58:36.745738+0000","last_peered":"2024-05-10T09:58:36.745738+0000","last_clean":"2024-05-10T09:58:36.745738+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:36.745738+0000","last_undegraded":"2024-05-10T09:58:36.745738+0000","last_fullsized":"2024-05-10T09:58:36.745738+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.745543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.745543+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.745543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:15.681407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.616527+0000","last_change":"2024-05-10T09:58:32.616587+0000","last_active":"2024-05-10T09:58:32.616527+0000","last_peered":"2024-05-10T09:58:32.616527+0000","last_clean":"2024-05-10T09:58:32.616527+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:32.616527+0000","last_undegraded":"2024-05-10T09:58:32.616527+0000","last_fullsized":"2024-05-10T09:58:32.616527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.616326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.616326+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.616326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:52:39.907022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.643825+0000","last_change":"2024-05-10T09:58:33.643943+0000","last_active":"2024-05-10T09:58:33.643825+0000","last_peered":"2024-05-10T09:58:33.643825+0000","last_clean":"2024-05-10T09:58:33.643825+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:33.643825+0000","last_undegraded":"2024-05-10T09:58:33.643825+0000","last_fullsized":"2024-05-10T09:58:33.643825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.643517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.643517+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.643517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:27:52.512387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.521501+0000","last_change":"2024-05-10T09:58:23.521576+0000","last_active":"2024-05-10T09:58:23.521501+0000","last_peered":"2024-05-10T09:58:23.521501+0000","last_clean":"2024-05-10T09:58:23.521501+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:23.521501+0000","last_undegraded":"2024-05-10T09:58:23.521501+0000","last_fullsized":"2024-05-10T09:58:23.521501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.521285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.521285+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.521285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:20.909272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'16","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.635575+0000","last_change":"2024-05-10T09:58:36.635575+0000","last_active":"2024-05-10T09:58:36.635575+0000","last_peered":"2024-05-10T09:58:36.635575+0000","last_clean":"2024-05-10T09:58:36.635575+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:36.635575+0000","last_undegraded":"2024-05-10T09:58:36.635575+0000","last_fullsized":"2024-05-10T09:58:36.635575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:36.635200+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:36.635200+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.635200+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:13.825864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":26636,"num_write":36,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"110'2","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.599308+0000","last_change":"2024-05-10T09:58:20.599358+0000","last_active":"2024-05-10T09:58:20.599308+0000","last_peered":"2024-05-10T09:58:20.599308+0000","last_clean":"2024-05-10T09:58:20.599308+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:20.599308+0000","last_undegraded":"2024-05-10T09:58:20.599308+0000","last_fullsized":"2024-05-10T09:58:20.599308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:20.599197+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:20.599197+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.599197+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:49.316485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"110'23","reported_seq":249,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.747019+0000","last_change":"2024-05-10T09:58:28.747116+0000","last_active":"2024-05-10T09:58:28.747019+0000","last_peered":"2024-05-10T09:58:28.747019+0000","last_clean":"2024-05-10T09:58:28.747019+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:28.747019+0000","last_undegraded":"2024-05-10T09:58:28.747019+0000","last_fullsized":"2024-05-10T09:58:28.747019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'23","last_scrub_stamp":"2024-05-10T09:58:28.746825+0000","last_deep_scrub":"110'23","last_deep_scrub_stamp":"2024-05-10T09:58:28.746825+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.746825+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:29.644819+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651781+0000","last_change":"2024-05-10T09:57:09.659318+0000","last_active":"2024-05-10T09:58:04.651781+0000","last_peered":"2024-05-10T09:58:04.651781+0000","last_clean":"2024-05-10T09:58:04.651781+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:04.651781+0000","last_undegraded":"2024-05-10T09:58:04.651781+0000","last_fullsized":"2024-05-10T09:58:04.651781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531785+0000","last_change":"2024-05-10T09:57:09.640399+0000","last_active":"2024-05-10T09:58:04.531785+0000","last_peered":"2024-05-10T09:58:04.531785+0000","last_clean":"2024-05-10T09:58:04.531785+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:04.531785+0000","last_undegraded":"2024-05-10T09:58:04.531785+0000","last_fullsized":"2024-05-10T09:58:04.531785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.680063+0000","last_change":"2024-05-10T09:58:29.680174+0000","last_active":"2024-05-10T09:58:29.680063+0000","last_peered":"2024-05-10T09:58:29.680063+0000","last_clean":"2024-05-10T09:58:29.680063+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:29.680063+0000","last_undegraded":"2024-05-10T09:58:29.680063+0000","last_fullsized":"2024-05-10T09:58:29.680063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.679760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.679760+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.679760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:50.969118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653790+0000","last_change":"2024-05-10T09:54:33.579353+0000","last_active":"2024-05-10T09:58:04.653790+0000","last_peered":"2024-05-10T09:58:04.653790+0000","last_clean":"2024-05-10T09:58:04.653790+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:04.653790+0000","last_undegraded":"2024-05-10T09:58:04.653790+0000","last_fullsized":"2024-05-10T09:58:04.653790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'16","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.922619+0000","last_change":"2024-05-10T09:57:09.823131+0000","last_active":"2024-05-10T09:58:15.922619+0000","last_peered":"2024-05-10T09:58:15.922619+0000","last_clean":"2024-05-10T09:58:15.922619+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:15.922619+0000","last_undegraded":"2024-05-10T09:58:15.922619+0000","last_fullsized":"2024-05-10T09:58:15.922619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24588,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.044017+0000","last_change":"2024-05-10T09:58:33.044073+0000","last_active":"2024-05-10T09:58:33.044017+0000","last_peered":"2024-05-10T09:58:33.044017+0000","last_clean":"2024-05-10T09:58:33.044017+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:33.044017+0000","last_undegraded":"2024-05-10T09:58:33.044017+0000","last_fullsized":"2024-05-10T09:58:33.044017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.043821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.043821+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.043821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:57.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530832+0000","last_change":"2024-05-10T09:57:09.649456+0000","last_active":"2024-05-10T09:58:04.530832+0000","last_peered":"2024-05-10T09:58:04.530832+0000","last_clean":"2024-05-10T09:58:04.530832+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:04.530832+0000","last_undegraded":"2024-05-10T09:58:04.530832+0000","last_fullsized":"2024-05-10T09:58:04.530832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.503635+0000","last_change":"2024-05-10T09:58:23.503767+0000","last_active":"2024-05-10T09:58:23.503635+0000","last_peered":"2024-05-10T09:58:23.503635+0000","last_clean":"2024-05-10T09:58:23.503635+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:23.503635+0000","last_undegraded":"2024-05-10T09:58:23.503635+0000","last_fullsized":"2024-05-10T09:58:23.503635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.503406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.503406+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.503406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:14.753078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.410048+0000","last_change":"2024-05-10T09:58:23.410155+0000","last_active":"2024-05-10T09:58:23.410048+0000","last_peered":"2024-05-10T09:58:23.410048+0000","last_clean":"2024-05-10T09:58:23.410048+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:23.410048+0000","last_undegraded":"2024-05-10T09:58:23.410048+0000","last_fullsized":"2024-05-10T09:58:23.410048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.409763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.409763+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.409763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:04.814457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646958+0000","last_change":"2024-05-10T09:54:41.665530+0000","last_active":"2024-05-10T09:58:04.646958+0000","last_peered":"2024-05-10T09:58:04.646958+0000","last_clean":"2024-05-10T09:58:04.646958+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:04.646958+0000","last_undegraded":"2024-05-10T09:58:04.646958+0000","last_fullsized":"2024-05-10T09:58:04.646958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'24","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.471670+0000","last_change":"2024-05-10T09:58:37.471738+0000","last_active":"2024-05-10T09:58:37.471670+0000","last_peered":"2024-05-10T09:58:37.471670+0000","last_clean":"2024-05-10T09:58:37.471670+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:37.471670+0000","last_undegraded":"2024-05-10T09:58:37.471670+0000","last_fullsized":"2024-05-10T09:58:37.471670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:37.471473+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:37.471473+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.471473+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:08.642738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45068,"num_write":44,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.626706+0000","last_change":"2024-05-10T09:58:35.626764+0000","last_active":"2024-05-10T09:58:35.626706+0000","last_peered":"2024-05-10T09:58:35.626706+0000","last_clean":"2024-05-10T09:58:35.626706+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:35.626706+0000","last_undegraded":"2024-05-10T09:58:35.626706+0000","last_fullsized":"2024-05-10T09:58:35.626706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.626500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.626500+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.626500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:29.673295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.014901+0000","last_change":"2024-05-10T09:58:29.014960+0000","last_active":"2024-05-10T09:58:29.014901+0000","last_peered":"2024-05-10T09:58:29.014901+0000","last_clean":"2024-05-10T09:58:29.014901+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:29.014901+0000","last_undegraded":"2024-05-10T09:58:29.014901+0000","last_fullsized":"2024-05-10T09:58:29.014901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.014717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.014717+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.014717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:02.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'42","reported_seq":243,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.137260+0000","last_change":"2024-05-10T09:58:35.137352+0000","last_active":"2024-05-10T09:58:35.137260+0000","last_peered":"2024-05-10T09:58:35.137260+0000","last_clean":"2024-05-10T09:58:35.137260+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:35.137260+0000","last_undegraded":"2024-05-10T09:58:35.137260+0000","last_fullsized":"2024-05-10T09:58:35.137260+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'42","last_scrub_stamp":"2024-05-10T09:58:35.137041+0000","last_deep_scrub":"110'42","last_deep_scrub_stamp":"2024-05-10T09:58:35.137041+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.137041+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:53.846732+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":74,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.451259+0000","last_change":"2024-05-10T09:57:19.676469+0000","last_active":"2024-05-10T09:58:20.451259+0000","last_peered":"2024-05-10T09:58:20.451259+0000","last_clean":"2024-05-10T09:58:20.451259+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:58:20.451259+0000","last_undegraded":"2024-05-10T09:58:20.451259+0000","last_fullsized":"2024-05-10T09:58:20.451259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.077887+0000","last_change":"2024-05-10T09:58:21.077905+0000","last_active":"2024-05-10T09:58:21.077887+0000","last_peered":"2024-05-10T09:58:21.077887+0000","last_clean":"2024-05-10T09:58:21.077887+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:21.077887+0000","last_undegraded":"2024-05-10T09:58:21.077887+0000","last_fullsized":"2024-05-10T09:58:21.077887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:21.077818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:21.077818+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.077818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:37.122527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.085025+0000","last_change":"2024-05-10T09:58:34.085123+0000","last_active":"2024-05-10T09:58:34.085025+0000","last_peered":"2024-05-10T09:58:34.085025+0000","last_clean":"2024-05-10T09:58:34.085025+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:34.085025+0000","last_undegraded":"2024-05-10T09:58:34.085025+0000","last_fullsized":"2024-05-10T09:58:34.085025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:34.084795+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:34.084795+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.084795+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:23.851346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"110'6","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.589806+0000","last_change":"2024-05-10T09:58:38.589873+0000","last_active":"2024-05-10T09:58:38.589806+0000","last_peered":"2024-05-10T09:58:38.589806+0000","last_clean":"2024-05-10T09:58:38.589806+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:38.589806+0000","last_undegraded":"2024-05-10T09:58:38.589806+0000","last_fullsized":"2024-05-10T09:58:38.589806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-05-10T09:58:38.589615+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-05-10T09:58:38.589615+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.589615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:01:52.298107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.657235+0000","last_change":"2024-05-10T09:54:34.045223+0000","last_active":"2024-05-10T09:58:04.657235+0000","last_peered":"2024-05-10T09:58:04.657235+0000","last_clean":"2024-05-10T09:58:04.657235+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:04.657235+0000","last_undegraded":"2024-05-10T09:58:04.657235+0000","last_fullsized":"2024-05-10T09:58:04.657235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:32.552880+0000","last_clean_scrub_stamp":"2024-05-10T09:54:32.552880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"110'2","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.529542+0000","last_change":"2024-05-10T09:58:28.529614+0000","last_active":"2024-05-10T09:58:28.529542+0000","last_peered":"2024-05-10T09:58:28.529542+0000","last_clean":"2024-05-10T09:58:28.529542+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:28.529542+0000","last_undegraded":"2024-05-10T09:58:28.529542+0000","last_fullsized":"2024-05-10T09:58:28.529542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:28.529340+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:28.529340+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.529340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:49.028373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"110'22","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.705882+0000","last_change":"2024-05-10T09:58:24.705964+0000","last_active":"2024-05-10T09:58:24.705882+0000","last_peered":"2024-05-10T09:58:24.705882+0000","last_clean":"2024-05-10T09:58:24.705882+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:24.705882+0000","last_undegraded":"2024-05-10T09:58:24.705882+0000","last_fullsized":"2024-05-10T09:58:24.705882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:24.705658+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:24.705658+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.705658+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:13:15.819312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'18","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.411900+0000","last_change":"2024-05-10T09:58:25.411966+0000","last_active":"2024-05-10T09:58:25.411900+0000","last_peered":"2024-05-10T09:58:25.411900+0000","last_clean":"2024-05-10T09:58:25.411900+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:25.411900+0000","last_undegraded":"2024-05-10T09:58:25.411900+0000","last_fullsized":"2024-05-10T09:58:25.411900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:25.411703+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:25.411703+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.411703+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:38.566132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.532059+0000","last_change":"2024-05-10T09:54:49.735583+0000","last_active":"2024-05-10T09:58:04.532059+0000","last_peered":"2024-05-10T09:58:04.532059+0000","last_clean":"2024-05-10T09:58:04.532059+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:04.532059+0000","last_undegraded":"2024-05-10T09:58:04.532059+0000","last_fullsized":"2024-05-10T09:58:04.532059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.528024+0000","last_change":"2024-05-10T09:54:41.662279+0000","last_active":"2024-05-10T09:58:04.528024+0000","last_peered":"2024-05-10T09:58:04.528024+0000","last_clean":"2024-05-10T09:58:04.528024+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:04.528024+0000","last_undegraded":"2024-05-10T09:58:04.528024+0000","last_fullsized":"2024-05-10T09:58:04.528024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"110'20","reported_seq":214,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.857192+0000","last_change":"2024-05-10T09:54:39.638812+0000","last_active":"2024-05-10T09:58:15.857192+0000","last_peered":"2024-05-10T09:58:15.857192+0000","last_clean":"2024-05-10T09:58:15.857192+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:15.857192+0000","last_undegraded":"2024-05-10T09:58:15.857192+0000","last_fullsized":"2024-05-10T09:58:15.857192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.609329+0000","last_change":"2024-05-10T09:58:34.609389+0000","last_active":"2024-05-10T09:58:34.609329+0000","last_peered":"2024-05-10T09:58:34.609329+0000","last_clean":"2024-05-10T09:58:34.609329+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:34.609329+0000","last_undegraded":"2024-05-10T09:58:34.609329+0000","last_fullsized":"2024-05-10T09:58:34.609329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.609126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.609126+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.609126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:25.552434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.000209+0000","last_change":"2024-05-10T09:58:27.000271+0000","last_active":"2024-05-10T09:58:27.000209+0000","last_peered":"2024-05-10T09:58:27.000209+0000","last_clean":"2024-05-10T09:58:27.000209+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:27.000209+0000","last_undegraded":"2024-05-10T09:58:27.000209+0000","last_fullsized":"2024-05-10T09:58:27.000209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.000007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.000007+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.000007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:26:25.604303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"110'15","reported_seq":113,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.042957+0000","last_change":"2024-05-10T09:58:30.043029+0000","last_active":"2024-05-10T09:58:30.042957+0000","last_peered":"2024-05-10T09:58:30.042957+0000","last_clean":"2024-05-10T09:58:30.042957+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:30.042957+0000","last_undegraded":"2024-05-10T09:58:30.042957+0000","last_fullsized":"2024-05-10T09:58:30.042957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:30.042782+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:30.042782+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.042782+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:56.239837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"110'18","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.661282+0000","last_change":"2024-05-10T09:58:24.661351+0000","last_active":"2024-05-10T09:58:24.661282+0000","last_peered":"2024-05-10T09:58:24.661282+0000","last_clean":"2024-05-10T09:58:24.661282+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:24.661282+0000","last_undegraded":"2024-05-10T09:58:24.661282+0000","last_fullsized":"2024-05-10T09:58:24.661282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.661080+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.661080+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.661080+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:10.798769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.054847+0000","last_change":"2024-05-10T09:58:25.054976+0000","last_active":"2024-05-10T09:58:25.054847+0000","last_peered":"2024-05-10T09:58:25.054847+0000","last_clean":"2024-05-10T09:58:25.054847+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:25.054847+0000","last_undegraded":"2024-05-10T09:58:25.054847+0000","last_fullsized":"2024-05-10T09:58:25.054847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'8","last_scrub_stamp":"2024-05-10T09:58:25.054516+0000","last_deep_scrub":"89'8","last_deep_scrub_stamp":"2024-05-10T09:58:25.054516+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.054516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:00.234290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.009334+0000","last_change":"2024-05-10T09:58:23.009453+0000","last_active":"2024-05-10T09:58:23.009334+0000","last_peered":"2024-05-10T09:58:23.009334+0000","last_clean":"2024-05-10T09:58:23.009334+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:23.009334+0000","last_undegraded":"2024-05-10T09:58:23.009334+0000","last_fullsized":"2024-05-10T09:58:23.009334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'76","last_scrub_stamp":"2024-05-10T09:58:23.009098+0000","last_deep_scrub":"89'76","last_deep_scrub_stamp":"2024-05-10T09:58:23.009098+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.009098+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:41.058451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'32","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.915870+0000","last_change":"2024-05-10T09:54:39.636943+0000","last_active":"2024-05-10T09:58:15.915870+0000","last_peered":"2024-05-10T09:58:15.915870+0000","last_clean":"2024-05-10T09:58:15.915870+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:15.915870+0000","last_undegraded":"2024-05-10T09:58:15.915870+0000","last_fullsized":"2024-05-10T09:58:15.915870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":59422,"num_write":82,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.607901+0000","last_change":"2024-05-10T09:58:31.607958+0000","last_active":"2024-05-10T09:58:31.607901+0000","last_peered":"2024-05-10T09:58:31.607901+0000","last_clean":"2024-05-10T09:58:31.607901+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:31.607901+0000","last_undegraded":"2024-05-10T09:58:31.607901+0000","last_fullsized":"2024-05-10T09:58:31.607901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.607683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.607683+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.607683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:32.505677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.594057+0000","last_change":"2024-05-10T09:58:39.594114+0000","last_active":"2024-05-10T09:58:39.594057+0000","last_peered":"2024-05-10T09:58:39.594057+0000","last_clean":"2024-05-10T09:58:39.594057+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:39.594057+0000","last_undegraded":"2024-05-10T09:58:39.594057+0000","last_fullsized":"2024-05-10T09:58:39.594057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:39.593867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:39.593867+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.593867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:42.581485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'52","reported_seq":261,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.745907+0000","last_change":"2024-05-10T09:58:30.745985+0000","last_active":"2024-05-10T09:58:30.745907+0000","last_peered":"2024-05-10T09:58:30.745907+0000","last_clean":"2024-05-10T09:58:30.745907+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:30.745907+0000","last_undegraded":"2024-05-10T09:58:30.745907+0000","last_fullsized":"2024-05-10T09:58:30.745907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'52","last_scrub_stamp":"2024-05-10T09:58:30.745724+0000","last_deep_scrub":"110'52","last_deep_scrub_stamp":"2024-05-10T09:58:30.745724+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.745724+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:05.925497+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":86,"num_read_kb":121,"num_write":54,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.674024+0000","last_change":"2024-05-10T09:58:27.674126+0000","last_active":"2024-05-10T09:58:27.674024+0000","last_peered":"2024-05-10T09:58:27.674024+0000","last_clean":"2024-05-10T09:58:27.674024+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:27.674024+0000","last_undegraded":"2024-05-10T09:58:27.674024+0000","last_fullsized":"2024-05-10T09:58:27.674024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.673776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.673776+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.673776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:28.034168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":161,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.650773+0000","last_change":"2024-05-10T09:54:49.729130+0000","last_active":"2024-05-10T09:58:04.650773+0000","last_peered":"2024-05-10T09:58:04.650773+0000","last_clean":"2024-05-10T09:58:04.650773+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:04.650773+0000","last_undegraded":"2024-05-10T09:58:04.650773+0000","last_fullsized":"2024-05-10T09:58:04.650773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653085+0000","last_change":"2024-05-10T09:54:49.728820+0000","last_active":"2024-05-10T09:58:04.653085+0000","last_peered":"2024-05-10T09:58:04.653085+0000","last_clean":"2024-05-10T09:58:04.653085+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:04.653085+0000","last_undegraded":"2024-05-10T09:58:04.653085+0000","last_fullsized":"2024-05-10T09:58:04.653085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.988357+0000","last_change":"2024-05-10T09:58:20.988539+0000","last_active":"2024-05-10T09:58:20.988357+0000","last_peered":"2024-05-10T09:58:20.988357+0000","last_clean":"2024-05-10T09:58:20.988357+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:20.988357+0000","last_undegraded":"2024-05-10T09:58:20.988357+0000","last_fullsized":"2024-05-10T09:58:20.988357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:20.988131+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:20.988131+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.988131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:29.354050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'14","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.834004+0000","last_change":"2024-05-10T09:57:10.011575+0000","last_active":"2024-05-10T09:58:15.834004+0000","last_peered":"2024-05-10T09:58:15.834004+0000","last_clean":"2024-05-10T09:58:15.834004+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:15.834004+0000","last_undegraded":"2024-05-10T09:58:15.834004+0000","last_fullsized":"2024-05-10T09:58:15.834004+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:19.706450+0000","last_change":"2024-05-10T09:58:19.706490+0000","last_active":"2024-05-10T09:58:19.706450+0000","last_peered":"2024-05-10T09:58:19.706450+0000","last_clean":"2024-05-10T09:58:19.706450+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:19.706450+0000","last_undegraded":"2024-05-10T09:58:19.706450+0000","last_fullsized":"2024-05-10T09:58:19.706450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:19.706342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:19.706342+0000","last_clean_scrub_stamp":"2024-05-10T09:58:19.706342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:09.648820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'21","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.754706+0000","last_change":"2024-05-10T09:54:45.681809+0000","last_active":"2024-05-10T09:58:15.754706+0000","last_peered":"2024-05-10T09:58:15.754706+0000","last_clean":"2024-05-10T09:58:15.754706+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:15.754706+0000","last_undegraded":"2024-05-10T09:58:15.754706+0000","last_fullsized":"2024-05-10T09:58:15.754706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":59,"num_write":24,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.640995+0000","last_change":"2024-05-10T09:58:26.641053+0000","last_active":"2024-05-10T09:58:26.640995+0000","last_peered":"2024-05-10T09:58:26.640995+0000","last_clean":"2024-05-10T09:58:26.640995+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:26.640995+0000","last_undegraded":"2024-05-10T09:58:26.640995+0000","last_fullsized":"2024-05-10T09:58:26.640995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.640791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.640791+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.640791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:59.872868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.732106+0000","last_change":"2024-05-10T09:58:29.732171+0000","last_active":"2024-05-10T09:58:29.732106+0000","last_peered":"2024-05-10T09:58:29.732106+0000","last_clean":"2024-05-10T09:58:29.732106+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:29.732106+0000","last_undegraded":"2024-05-10T09:58:29.732106+0000","last_fullsized":"2024-05-10T09:58:29.732106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-05-10T09:58:29.731904+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-05-10T09:58:29.731904+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.731904+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:11.897873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.689257+0000","last_change":"2024-05-10T09:58:23.689402+0000","last_active":"2024-05-10T09:58:23.689257+0000","last_peered":"2024-05-10T09:58:23.689257+0000","last_clean":"2024-05-10T09:58:23.689257+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:23.689257+0000","last_undegraded":"2024-05-10T09:58:23.689257+0000","last_fullsized":"2024-05-10T09:58:23.689257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.688993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.688993+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.688993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:42.872307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'18","reported_seq":214,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.886030+0000","last_change":"2024-05-10T09:54:39.652782+0000","last_active":"2024-05-10T09:58:15.886030+0000","last_peered":"2024-05-10T09:58:15.886030+0000","last_clean":"2024-05-10T09:58:15.886030+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:15.886030+0000","last_undegraded":"2024-05-10T09:58:15.886030+0000","last_fullsized":"2024-05-10T09:58:15.886030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30738,"num_write":48,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.701282+0000","last_change":"2024-05-10T09:58:35.701337+0000","last_active":"2024-05-10T09:58:35.701282+0000","last_peered":"2024-05-10T09:58:35.701282+0000","last_clean":"2024-05-10T09:58:35.701282+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:35.701282+0000","last_undegraded":"2024-05-10T09:58:35.701282+0000","last_fullsized":"2024-05-10T09:58:35.701282+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.701084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.701084+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.701084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:06.093005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"43'5","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646650+0000","last_change":"2024-05-10T09:54:45.689881+0000","last_active":"2024-05-10T09:58:04.646650+0000","last_peered":"2024-05-10T09:58:04.646650+0000","last_clean":"2024-05-10T09:58:04.646650+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:04.646650+0000","last_undegraded":"2024-05-10T09:58:04.646650+0000","last_fullsized":"2024-05-10T09:58:04.646650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.779870+0000","last_change":"2024-05-10T09:58:38.779932+0000","last_active":"2024-05-10T09:58:38.779870+0000","last_peered":"2024-05-10T09:58:38.779870+0000","last_clean":"2024-05-10T09:58:38.779870+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:38.779870+0000","last_undegraded":"2024-05-10T09:58:38.779870+0000","last_fullsized":"2024-05-10T09:58:38.779870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.779652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.779652+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.779652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:02.764687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":163,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.651898+0000","last_change":"2024-05-10T09:54:49.719247+0000","last_active":"2024-05-10T09:58:04.651898+0000","last_peered":"2024-05-10T09:58:04.651898+0000","last_clean":"2024-05-10T09:58:04.651898+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:04.651898+0000","last_undegraded":"2024-05-10T09:58:04.651898+0000","last_fullsized":"2024-05-10T09:58:04.651898+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.650996+0000","last_change":"2024-05-10T09:58:34.651060+0000","last_active":"2024-05-10T09:58:34.650996+0000","last_peered":"2024-05-10T09:58:34.650996+0000","last_clean":"2024-05-10T09:58:34.650996+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:34.650996+0000","last_undegraded":"2024-05-10T09:58:34.650996+0000","last_fullsized":"2024-05-10T09:58:34.650996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:34.650791+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:34.650791+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.650791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:39.747177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'14","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.963885+0000","last_change":"2024-05-10T09:54:39.653277+0000","last_active":"2024-05-10T09:58:15.963885+0000","last_peered":"2024-05-10T09:58:15.963885+0000","last_clean":"2024-05-10T09:58:15.963885+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:15.963885+0000","last_undegraded":"2024-05-10T09:58:15.963885+0000","last_fullsized":"2024-05-10T09:58:15.963885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.649859+0000","last_change":"2024-05-10T09:57:09.646596+0000","last_active":"2024-05-10T09:58:04.649859+0000","last_peered":"2024-05-10T09:58:04.649859+0000","last_clean":"2024-05-10T09:58:04.649859+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:04.649859+0000","last_undegraded":"2024-05-10T09:58:04.649859+0000","last_fullsized":"2024-05-10T09:58:04.649859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'22","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.585333+0000","last_change":"2024-05-10T09:54:45.682934+0000","last_active":"2024-05-10T09:58:15.585333+0000","last_peered":"2024-05-10T09:58:15.585333+0000","last_clean":"2024-05-10T09:58:15.585333+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:15.585333+0000","last_undegraded":"2024-05-10T09:58:15.585333+0000","last_fullsized":"2024-05-10T09:58:15.585333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":64,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.476233+0000","last_change":"2024-05-10T09:58:22.476288+0000","last_active":"2024-05-10T09:58:22.476233+0000","last_peered":"2024-05-10T09:58:22.476233+0000","last_clean":"2024-05-10T09:58:22.476233+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:22.476233+0000","last_undegraded":"2024-05-10T09:58:22.476233+0000","last_fullsized":"2024-05-10T09:58:22.476233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.476038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.476038+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.476038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:37.420373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.421141+0000","last_change":"2024-05-10T09:58:22.421194+0000","last_active":"2024-05-10T09:58:22.421141+0000","last_peered":"2024-05-10T09:58:22.421141+0000","last_clean":"2024-05-10T09:58:22.421141+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:22.421141+0000","last_undegraded":"2024-05-10T09:58:22.421141+0000","last_fullsized":"2024-05-10T09:58:22.421141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.420950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.420950+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.420950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:01.544851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.670336+0000","last_change":"2024-05-10T09:58:36.670390+0000","last_active":"2024-05-10T09:58:36.670336+0000","last_peered":"2024-05-10T09:58:36.670336+0000","last_clean":"2024-05-10T09:58:36.670336+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:36.670336+0000","last_undegraded":"2024-05-10T09:58:36.670336+0000","last_fullsized":"2024-05-10T09:58:36.670336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.670113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.670113+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.670113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:46.633988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"110'22","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.962822+0000","last_change":"2024-05-10T09:54:39.664291+0000","last_active":"2024-05-10T09:58:15.962822+0000","last_peered":"2024-05-10T09:58:15.962822+0000","last_clean":"2024-05-10T09:58:15.962822+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:15.962822+0000","last_undegraded":"2024-05-10T09:58:15.962822+0000","last_fullsized":"2024-05-10T09:58:15.962822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40978,"num_write":52,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.654657+0000","last_change":"2024-05-10T09:57:09.667274+0000","last_active":"2024-05-10T09:58:04.654657+0000","last_peered":"2024-05-10T09:58:04.654657+0000","last_clean":"2024-05-10T09:58:04.654657+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:04.654657+0000","last_undegraded":"2024-05-10T09:58:04.654657+0000","last_fullsized":"2024-05-10T09:58:04.654657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'22","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.728359+0000","last_change":"2024-05-10T09:58:26.728434+0000","last_active":"2024-05-10T09:58:26.728359+0000","last_peered":"2024-05-10T09:58:26.728359+0000","last_clean":"2024-05-10T09:58:26.728359+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:26.728359+0000","last_undegraded":"2024-05-10T09:58:26.728359+0000","last_fullsized":"2024-05-10T09:58:26.728359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:26.728132+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:26.728132+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.728132+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.928098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.105498+0000","last_change":"2024-05-10T09:58:20.105557+0000","last_active":"2024-05-10T09:58:20.105498+0000","last_peered":"2024-05-10T09:58:20.105498+0000","last_clean":"2024-05-10T09:58:20.105498+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:20.105498+0000","last_undegraded":"2024-05-10T09:58:20.105498+0000","last_fullsized":"2024-05-10T09:58:20.105498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:20.105310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:20.105310+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.105310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:59.229211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.552094+0000","last_change":"2024-05-10T09:58:38.552151+0000","last_active":"2024-05-10T09:58:38.552094+0000","last_peered":"2024-05-10T09:58:38.552094+0000","last_clean":"2024-05-10T09:58:38.552094+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:38.552094+0000","last_undegraded":"2024-05-10T09:58:38.552094+0000","last_fullsized":"2024-05-10T09:58:38.552094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.551899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.551899+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.551899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:38.912291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.675185+0000","last_change":"2024-05-10T09:54:39.625851+0000","last_active":"2024-05-10T09:58:15.675185+0000","last_peered":"2024-05-10T09:58:15.675185+0000","last_clean":"2024-05-10T09:58:15.675185+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:15.675185+0000","last_undegraded":"2024-05-10T09:58:15.675185+0000","last_fullsized":"2024-05-10T09:58:15.675185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18444,"num_write":30,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.071300+0000","last_change":"2024-05-10T09:58:31.071356+0000","last_active":"2024-05-10T09:58:31.071300+0000","last_peered":"2024-05-10T09:58:31.071300+0000","last_clean":"2024-05-10T09:58:31.071300+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:31.071300+0000","last_undegraded":"2024-05-10T09:58:31.071300+0000","last_fullsized":"2024-05-10T09:58:31.071300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.071107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.071107+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.071107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:10.006971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'32","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.716239+0000","last_change":"2024-05-10T09:58:22.716326+0000","last_active":"2024-05-10T09:58:22.716239+0000","last_peered":"2024-05-10T09:58:22.716239+0000","last_clean":"2024-05-10T09:58:22.716239+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:22.716239+0000","last_undegraded":"2024-05-10T09:58:22.716239+0000","last_fullsized":"2024-05-10T09:58:22.716239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'32","last_scrub_stamp":"2024-05-10T09:58:22.716035+0000","last_deep_scrub":"110'32","last_deep_scrub_stamp":"2024-05-10T09:58:22.716035+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.716035+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:50.706433+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":69,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.390291+0000","last_change":"2024-05-10T09:58:24.390348+0000","last_active":"2024-05-10T09:58:24.390291+0000","last_peered":"2024-05-10T09:58:24.390291+0000","last_clean":"2024-05-10T09:58:24.390291+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:24.390291+0000","last_undegraded":"2024-05-10T09:58:24.390291+0000","last_fullsized":"2024-05-10T09:58:24.390291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.390096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.390096+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.390096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:03.262178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.608033+0000","last_change":"2024-05-10T09:58:21.608055+0000","last_active":"2024-05-10T09:58:21.608033+0000","last_peered":"2024-05-10T09:58:21.608033+0000","last_clean":"2024-05-10T09:58:21.608033+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:21.608033+0000","last_undegraded":"2024-05-10T09:58:21.608033+0000","last_fullsized":"2024-05-10T09:58:21.608033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:21.607964+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:21.607964+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.607964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:19.930647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.079589+0000","last_change":"2024-05-10T09:58:32.079643+0000","last_active":"2024-05-10T09:58:32.079589+0000","last_peered":"2024-05-10T09:58:32.079589+0000","last_clean":"2024-05-10T09:58:32.079589+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:32.079589+0000","last_undegraded":"2024-05-10T09:58:32.079589+0000","last_fullsized":"2024-05-10T09:58:32.079589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.079384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.079384+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.079384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:14.245352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'20","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.936249+0000","last_change":"2024-05-10T09:55:19.368110+0000","last_active":"2024-05-10T09:58:15.936249+0000","last_peered":"2024-05-10T09:58:15.936249+0000","last_clean":"2024-05-10T09:58:15.936249+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:15.936249+0000","last_undegraded":"2024-05-10T09:58:15.936249+0000","last_fullsized":"2024-05-10T09:58:15.936249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30726,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"28'1","reported_seq":194,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.219483+0000","last_change":"2024-05-10T09:57:09.667091+0000","last_active":"2024-05-10T09:58:15.219483+0000","last_peered":"2024-05-10T09:58:15.219483+0000","last_clean":"2024-05-10T09:58:15.219483+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:15.219483+0000","last_undegraded":"2024-05-10T09:58:15.219483+0000","last_fullsized":"2024-05-10T09:58:15.219483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'31","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.675531+0000","last_change":"2024-05-10T09:58:24.675582+0000","last_active":"2024-05-10T09:58:24.675531+0000","last_peered":"2024-05-10T09:58:24.675531+0000","last_clean":"2024-05-10T09:58:24.675531+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:24.675531+0000","last_undegraded":"2024-05-10T09:58:24.675531+0000","last_fullsized":"2024-05-10T09:58:24.675531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'31","last_scrub_stamp":"2024-05-10T09:58:24.675424+0000","last_deep_scrub":"110'31","last_deep_scrub_stamp":"2024-05-10T09:58:24.675424+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.675424+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:27.905528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":63,"num_write":28,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.713237+0000","last_change":"2024-05-10T09:58:28.713292+0000","last_active":"2024-05-10T09:58:28.713237+0000","last_peered":"2024-05-10T09:58:28.713237+0000","last_clean":"2024-05-10T09:58:28.713237+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:28.713237+0000","last_undegraded":"2024-05-10T09:58:28.713237+0000","last_fullsized":"2024-05-10T09:58:28.713237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.713029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.713029+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.713029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:53.020340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.528431+0000","last_change":"2024-05-10T09:58:29.528483+0000","last_active":"2024-05-10T09:58:29.528431+0000","last_peered":"2024-05-10T09:58:29.528431+0000","last_clean":"2024-05-10T09:58:29.528431+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:29.528431+0000","last_undegraded":"2024-05-10T09:58:29.528431+0000","last_fullsized":"2024-05-10T09:58:29.528431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.528245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.528245+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.528245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:54.728210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.735264+0000","last_change":"2024-05-10T09:58:31.735333+0000","last_active":"2024-05-10T09:58:31.735264+0000","last_peered":"2024-05-10T09:58:31.735264+0000","last_clean":"2024-05-10T09:58:31.735264+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:31.735264+0000","last_undegraded":"2024-05-10T09:58:31.735264+0000","last_fullsized":"2024-05-10T09:58:31.735264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-05-10T09:58:31.735058+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-05-10T09:58:31.735058+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.735058+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:21.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"110'12","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.847979+0000","last_change":"2024-05-10T09:57:10.397350+0000","last_active":"2024-05-10T09:58:15.847979+0000","last_peered":"2024-05-10T09:58:15.847979+0000","last_clean":"2024-05-10T09:58:15.847979+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:15.847979+0000","last_undegraded":"2024-05-10T09:58:15.847979+0000","last_fullsized":"2024-05-10T09:58:15.847979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18438,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":157,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529170+0000","last_change":"2024-05-10T09:57:09.644593+0000","last_active":"2024-05-10T09:58:04.529170+0000","last_peered":"2024-05-10T09:58:04.529170+0000","last_clean":"2024-05-10T09:58:04.529170+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:04.529170+0000","last_undegraded":"2024-05-10T09:58:04.529170+0000","last_fullsized":"2024-05-10T09:58:04.529170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'24","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.723345+0000","last_change":"2024-05-10T09:58:28.723424+0000","last_active":"2024-05-10T09:58:28.723345+0000","last_peered":"2024-05-10T09:58:28.723345+0000","last_clean":"2024-05-10T09:58:28.723345+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:28.723345+0000","last_undegraded":"2024-05-10T09:58:28.723345+0000","last_fullsized":"2024-05-10T09:58:28.723345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:28.723147+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:28.723147+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.723147+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:07.659011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":62,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.630694+0000","last_change":"2024-05-10T09:58:30.630755+0000","last_active":"2024-05-10T09:58:30.630694+0000","last_peered":"2024-05-10T09:58:30.630694+0000","last_clean":"2024-05-10T09:58:30.630694+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:30.630694+0000","last_undegraded":"2024-05-10T09:58:30.630694+0000","last_fullsized":"2024-05-10T09:58:30.630694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.630484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.630484+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.630484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:23.219778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.459856+0000","last_change":"2024-05-10T09:58:26.459909+0000","last_active":"2024-05-10T09:58:26.459856+0000","last_peered":"2024-05-10T09:58:26.459856+0000","last_clean":"2024-05-10T09:58:26.459856+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:26.459856+0000","last_undegraded":"2024-05-10T09:58:26.459856+0000","last_fullsized":"2024-05-10T09:58:26.459856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.459654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.459654+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.459654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:24.782336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.470197+0000","last_change":"2024-05-10T09:58:28.470258+0000","last_active":"2024-05-10T09:58:28.470197+0000","last_peered":"2024-05-10T09:58:28.470197+0000","last_clean":"2024-05-10T09:58:28.470197+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:28.470197+0000","last_undegraded":"2024-05-10T09:58:28.470197+0000","last_fullsized":"2024-05-10T09:58:28.470197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:28.469996+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:28.469996+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.469996+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:13:12.438475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'20","reported_seq":242,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.825032+0000","last_change":"2024-05-10T09:57:10.018391+0000","last_active":"2024-05-10T09:58:15.825032+0000","last_peered":"2024-05-10T09:58:15.825032+0000","last_clean":"2024-05-10T09:58:15.825032+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:15.825032+0000","last_undegraded":"2024-05-10T09:58:15.825032+0000","last_fullsized":"2024-05-10T09:58:15.825032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647819+0000","last_change":"2024-05-10T09:57:09.651227+0000","last_active":"2024-05-10T09:58:04.647819+0000","last_peered":"2024-05-10T09:58:04.647819+0000","last_clean":"2024-05-10T09:58:04.647819+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:04.647819+0000","last_undegraded":"2024-05-10T09:58:04.647819+0000","last_fullsized":"2024-05-10T09:58:04.647819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"76'11","reported_seq":104,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530511+0000","last_change":"2024-05-10T09:57:09.881928+0000","last_active":"2024-05-10T09:58:04.530511+0000","last_peered":"2024-05-10T09:58:04.530511+0000","last_clean":"2024-05-10T09:58:04.530511+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:04.530511+0000","last_undegraded":"2024-05-10T09:58:04.530511+0000","last_fullsized":"2024-05-10T09:58:04.530511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'20","reported_seq":240,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.975064+0000","last_change":"2024-05-10T09:57:12.424381+0000","last_active":"2024-05-10T09:58:15.975064+0000","last_peered":"2024-05-10T09:58:15.975064+0000","last_clean":"2024-05-10T09:58:15.975064+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:15.975064+0000","last_undegraded":"2024-05-10T09:58:15.975064+0000","last_fullsized":"2024-05-10T09:58:15.975064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.683081+0000","last_change":"2024-05-10T09:58:23.683137+0000","last_active":"2024-05-10T09:58:23.683081+0000","last_peered":"2024-05-10T09:58:23.683081+0000","last_clean":"2024-05-10T09:58:23.683081+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:23.683081+0000","last_undegraded":"2024-05-10T09:58:23.683081+0000","last_fullsized":"2024-05-10T09:58:23.683081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.682883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.682883+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.682883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:39.213976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":132,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.646794+0000","last_change":"2024-05-10T09:55:33.434180+0000","last_active":"2024-05-10T09:58:04.646794+0000","last_peered":"2024-05-10T09:58:04.646794+0000","last_clean":"2024-05-10T09:58:04.646794+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:04.646794+0000","last_undegraded":"2024-05-10T09:58:04.646794+0000","last_fullsized":"2024-05-10T09:58:04.646794+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"110'12","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.949885+0000","last_change":"2024-05-10T09:57:11.141338+0000","last_active":"2024-05-10T09:58:15.949885+0000","last_peered":"2024-05-10T09:58:15.949885+0000","last_clean":"2024-05-10T09:58:15.949885+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:15.949885+0000","last_undegraded":"2024-05-10T09:58:15.949885+0000","last_fullsized":"2024-05-10T09:58:15.949885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":18450,"num_write":42,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653856+0000","last_change":"2024-05-10T09:57:09.659311+0000","last_active":"2024-05-10T09:58:04.653856+0000","last_peered":"2024-05-10T09:58:04.653856+0000","last_clean":"2024-05-10T09:58:04.653856+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:04.653856+0000","last_undegraded":"2024-05-10T09:58:04.653856+0000","last_fullsized":"2024-05-10T09:58:04.653856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:42.629241+0000","last_clean_scrub_stamp":"2024-05-10T09:54:42.629241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'23","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.942531+0000","last_change":"2024-05-10T09:54:45.682866+0000","last_active":"2024-05-10T09:58:15.942531+0000","last_peered":"2024-05-10T09:58:15.942531+0000","last_clean":"2024-05-10T09:58:15.942531+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:15.942531+0000","last_undegraded":"2024-05-10T09:58:15.942531+0000","last_fullsized":"2024-05-10T09:58:15.942531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.041935+0000","last_change":"2024-05-10T09:58:22.041957+0000","last_active":"2024-05-10T09:58:22.041935+0000","last_peered":"2024-05-10T09:58:22.041935+0000","last_clean":"2024-05-10T09:58:22.041935+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:22.041935+0000","last_undegraded":"2024-05-10T09:58:22.041935+0000","last_fullsized":"2024-05-10T09:58:22.041935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.041837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.041837+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.041837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:24.798814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.658325+0000","last_change":"2024-05-10T09:54:49.730944+0000","last_active":"2024-05-10T09:58:04.658325+0000","last_peered":"2024-05-10T09:58:04.658325+0000","last_clean":"2024-05-10T09:58:04.658325+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:04.658325+0000","last_undegraded":"2024-05-10T09:58:04.658325+0000","last_fullsized":"2024-05-10T09:58:04.658325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:48.673851+0000","last_clean_scrub_stamp":"2024-05-10T09:54:48.673851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":164,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.529676+0000","last_change":"2024-05-10T09:57:10.020238+0000","last_active":"2024-05-10T09:58:04.529676+0000","last_peered":"2024-05-10T09:58:04.529676+0000","last_clean":"2024-05-10T09:58:04.529676+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:04.529676+0000","last_undegraded":"2024-05-10T09:58:04.529676+0000","last_fullsized":"2024-05-10T09:58:04.529676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'16","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.965967+0000","last_change":"2024-05-10T09:57:10.282759+0000","last_active":"2024-05-10T09:58:15.965967+0000","last_peered":"2024-05-10T09:58:15.965967+0000","last_clean":"2024-05-10T09:58:15.965967+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:15.965967+0000","last_undegraded":"2024-05-10T09:58:15.965967+0000","last_fullsized":"2024-05-10T09:58:15.965967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22534,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.422349+0000","last_change":"2024-05-10T09:58:38.422404+0000","last_active":"2024-05-10T09:58:38.422349+0000","last_peered":"2024-05-10T09:58:38.422349+0000","last_clean":"2024-05-10T09:58:38.422349+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:38.422349+0000","last_undegraded":"2024-05-10T09:58:38.422349+0000","last_fullsized":"2024-05-10T09:58:38.422349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.422156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.422156+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.422156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:10.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'21","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.147381+0000","last_change":"2024-05-10T09:58:37.147550+0000","last_active":"2024-05-10T09:58:37.147381+0000","last_peered":"2024-05-10T09:58:37.147381+0000","last_clean":"2024-05-10T09:58:37.147381+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:37.147381+0000","last_undegraded":"2024-05-10T09:58:37.147381+0000","last_fullsized":"2024-05-10T09:58:37.147381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'21","last_scrub_stamp":"2024-05-10T09:58:37.147106+0000","last_deep_scrub":"110'21","last_deep_scrub_stamp":"2024-05-10T09:58:37.147106+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.147106+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:42.243492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.454339+0000","last_change":"2024-05-10T09:58:24.454466+0000","last_active":"2024-05-10T09:58:24.454339+0000","last_peered":"2024-05-10T09:58:24.454339+0000","last_clean":"2024-05-10T09:58:24.454339+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:24.454339+0000","last_undegraded":"2024-05-10T09:58:24.454339+0000","last_fullsized":"2024-05-10T09:58:24.454339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.454065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.454065+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.454065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:15.614108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.607649+0000","last_change":"2024-05-10T09:58:20.607669+0000","last_active":"2024-05-10T09:58:20.607649+0000","last_peered":"2024-05-10T09:58:20.607649+0000","last_clean":"2024-05-10T09:58:20.607649+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:20.607649+0000","last_undegraded":"2024-05-10T09:58:20.607649+0000","last_fullsized":"2024-05-10T09:58:20.607649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:20.607571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:20.607571+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.607571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:33.762000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531819+0000","last_change":"2024-05-10T09:54:41.653290+0000","last_active":"2024-05-10T09:58:04.531819+0000","last_peered":"2024-05-10T09:58:04.531819+0000","last_clean":"2024-05-10T09:58:04.531819+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:04.531819+0000","last_undegraded":"2024-05-10T09:58:04.531819+0000","last_fullsized":"2024-05-10T09:58:04.531819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'12","reported_seq":203,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.450435+0000","last_change":"2024-05-10T09:54:39.643267+0000","last_active":"2024-05-10T09:58:20.450435+0000","last_peered":"2024-05-10T09:58:20.450435+0000","last_clean":"2024-05-10T09:58:20.450435+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:20.450435+0000","last_undegraded":"2024-05-10T09:58:20.450435+0000","last_fullsized":"2024-05-10T09:58:20.450435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.105522+0000","last_change":"2024-05-10T09:58:37.105575+0000","last_active":"2024-05-10T09:58:37.105522+0000","last_peered":"2024-05-10T09:58:37.105522+0000","last_clean":"2024-05-10T09:58:37.105522+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:37.105522+0000","last_undegraded":"2024-05-10T09:58:37.105522+0000","last_fullsized":"2024-05-10T09:58:37.105522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.105327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.105327+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.105327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:57:10.396266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'12","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.778981+0000","last_change":"2024-05-10T09:54:45.687994+0000","last_active":"2024-05-10T09:58:15.778981+0000","last_peered":"2024-05-10T09:58:15.778981+0000","last_clean":"2024-05-10T09:58:15.778981+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:15.778981+0000","last_undegraded":"2024-05-10T09:58:15.778981+0000","last_fullsized":"2024-05-10T09:58:15.778981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.091628+0000","last_change":"2024-05-10T09:58:32.091683+0000","last_active":"2024-05-10T09:58:32.091628+0000","last_peered":"2024-05-10T09:58:32.091628+0000","last_clean":"2024-05-10T09:58:32.091628+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:32.091628+0000","last_undegraded":"2024-05-10T09:58:32.091628+0000","last_fullsized":"2024-05-10T09:58:32.091628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.091410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.091410+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.091410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:01:06.375141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.686251+0000","last_change":"2024-05-10T09:58:22.686310+0000","last_active":"2024-05-10T09:58:22.686251+0000","last_peered":"2024-05-10T09:58:22.686251+0000","last_clean":"2024-05-10T09:58:22.686251+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:22.686251+0000","last_undegraded":"2024-05-10T09:58:22.686251+0000","last_fullsized":"2024-05-10T09:58:22.686251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.686046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.686046+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.686046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:24.576447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":158,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.527686+0000","last_change":"2024-05-10T09:57:09.643737+0000","last_active":"2024-05-10T09:58:04.527686+0000","last_peered":"2024-05-10T09:58:04.527686+0000","last_clean":"2024-05-10T09:58:04.527686+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:04.527686+0000","last_undegraded":"2024-05-10T09:58:04.527686+0000","last_fullsized":"2024-05-10T09:58:04.527686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'22","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.936392+0000","last_change":"2024-05-10T09:54:39.665271+0000","last_active":"2024-05-10T09:58:15.936392+0000","last_peered":"2024-05-10T09:58:15.936392+0000","last_clean":"2024-05-10T09:58:15.936392+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:15.936392+0000","last_undegraded":"2024-05-10T09:58:15.936392+0000","last_fullsized":"2024-05-10T09:58:15.936392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"110'2","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.683364+0000","last_change":"2024-05-10T09:58:21.683429+0000","last_active":"2024-05-10T09:58:21.683364+0000","last_peered":"2024-05-10T09:58:21.683364+0000","last_clean":"2024-05-10T09:58:21.683364+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:21.683364+0000","last_undegraded":"2024-05-10T09:58:21.683364+0000","last_fullsized":"2024-05-10T09:58:21.683364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:21.683174+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:21.683174+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.683174+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:30.907539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'18","reported_seq":116,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.866744+0000","last_change":"2024-05-10T09:57:10.401974+0000","last_active":"2024-05-10T09:58:15.866744+0000","last_peered":"2024-05-10T09:58:15.866744+0000","last_clean":"2024-05-10T09:58:15.866744+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:15.866744+0000","last_undegraded":"2024-05-10T09:58:15.866744+0000","last_fullsized":"2024-05-10T09:58:15.866744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:44.635803+0000","last_clean_scrub_stamp":"2024-05-10T09:54:44.635803+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":49,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.042614+0000","last_change":"2024-05-10T09:58:26.042680+0000","last_active":"2024-05-10T09:58:26.042614+0000","last_peered":"2024-05-10T09:58:26.042614+0000","last_clean":"2024-05-10T09:58:26.042614+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:26.042614+0000","last_undegraded":"2024-05-10T09:58:26.042614+0000","last_fullsized":"2024-05-10T09:58:26.042614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.042401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.042401+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.042401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:57.235776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.069925+0000","last_change":"2024-05-10T09:58:31.069979+0000","last_active":"2024-05-10T09:58:31.069925+0000","last_peered":"2024-05-10T09:58:31.069925+0000","last_clean":"2024-05-10T09:58:31.069925+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:31.069925+0000","last_undegraded":"2024-05-10T09:58:31.069925+0000","last_fullsized":"2024-05-10T09:58:31.069925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.069713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.069713+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.069713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:05.240073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.703908+0000","last_change":"2024-05-10T09:58:25.703976+0000","last_active":"2024-05-10T09:58:25.703908+0000","last_peered":"2024-05-10T09:58:25.703908+0000","last_clean":"2024-05-10T09:58:25.703908+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:25.703908+0000","last_undegraded":"2024-05-10T09:58:25.703908+0000","last_fullsized":"2024-05-10T09:58:25.703908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.703686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.703686+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.703686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:42.256271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'16","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.593652+0000","last_change":"2024-05-10T09:58:34.593721+0000","last_active":"2024-05-10T09:58:34.593652+0000","last_peered":"2024-05-10T09:58:34.593652+0000","last_clean":"2024-05-10T09:58:34.593652+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:34.593652+0000","last_undegraded":"2024-05-10T09:58:34.593652+0000","last_fullsized":"2024-05-10T09:58:34.593652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:34.593437+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:34.593437+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.593437+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:05.786811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24588,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.647466+0000","last_change":"2024-05-10T09:54:41.665746+0000","last_active":"2024-05-10T09:58:04.647466+0000","last_peered":"2024-05-10T09:58:04.647466+0000","last_clean":"2024-05-10T09:58:04.647466+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:04.647466+0000","last_undegraded":"2024-05-10T09:58:04.647466+0000","last_fullsized":"2024-05-10T09:58:04.647466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.496411+0000","last_change":"2024-05-10T09:58:34.496484+0000","last_active":"2024-05-10T09:58:34.496411+0000","last_peered":"2024-05-10T09:58:34.496411+0000","last_clean":"2024-05-10T09:58:34.496411+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:34.496411+0000","last_undegraded":"2024-05-10T09:58:34.496411+0000","last_fullsized":"2024-05-10T09:58:34.496411+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:34.496200+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:34.496200+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.496200+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:47.885674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.476315+0000","last_change":"2024-05-10T09:58:28.476375+0000","last_active":"2024-05-10T09:58:28.476315+0000","last_peered":"2024-05-10T09:58:28.476315+0000","last_clean":"2024-05-10T09:58:28.476315+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:28.476315+0000","last_undegraded":"2024-05-10T09:58:28.476315+0000","last_fullsized":"2024-05-10T09:58:28.476315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'34","last_scrub_stamp":"2024-05-10T09:58:28.476111+0000","last_deep_scrub":"89'34","last_deep_scrub_stamp":"2024-05-10T09:58:28.476111+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.476111+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:17.045359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'12","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.910195+0000","last_change":"2024-05-10T09:54:39.663986+0000","last_active":"2024-05-10T09:58:15.910195+0000","last_peered":"2024-05-10T09:58:15.910195+0000","last_clean":"2024-05-10T09:58:15.910195+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:15.910195+0000","last_undegraded":"2024-05-10T09:58:15.910195+0000","last_fullsized":"2024-05-10T09:58:15.910195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.720812+0000","last_change":"2024-05-10T09:58:27.720873+0000","last_active":"2024-05-10T09:58:27.720812+0000","last_peered":"2024-05-10T09:58:27.720812+0000","last_clean":"2024-05-10T09:58:27.720812+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:27.720812+0000","last_undegraded":"2024-05-10T09:58:27.720812+0000","last_fullsized":"2024-05-10T09:58:27.720812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.720599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.720599+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.720599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:05.163347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'38","reported_seq":242,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.961079+0000","last_change":"2024-05-10T09:54:39.625641+0000","last_active":"2024-05-10T09:58:15.961079+0000","last_peered":"2024-05-10T09:58:15.961079+0000","last_clean":"2024-05-10T09:58:15.961079+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:15.961079+0000","last_undegraded":"2024-05-10T09:58:15.961079+0000","last_fullsized":"2024-05-10T09:58:15.961079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":71692,"num_write":58,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.531058+0000","last_change":"2024-05-10T09:54:41.662153+0000","last_active":"2024-05-10T09:58:04.531058+0000","last_peered":"2024-05-10T09:58:04.531058+0000","last_clean":"2024-05-10T09:58:04.531058+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:04.531058+0000","last_undegraded":"2024-05-10T09:58:04.531058+0000","last_fullsized":"2024-05-10T09:58:04.531058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'8","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.962003+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:58:15.962003+0000","last_peered":"2024-05-10T09:58:15.962003+0000","last_clean":"2024-05-10T09:58:15.962003+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:58:15.962003+0000","last_undegraded":"2024-05-10T09:58:15.962003+0000","last_fullsized":"2024-05-10T09:58:15.962003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14342,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.028954+0000","last_change":"2024-05-10T09:58:24.029008+0000","last_active":"2024-05-10T09:58:24.028954+0000","last_peered":"2024-05-10T09:58:24.028954+0000","last_clean":"2024-05-10T09:58:24.028954+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:24.028954+0000","last_undegraded":"2024-05-10T09:58:24.028954+0000","last_fullsized":"2024-05-10T09:58:24.028954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.028735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.028735+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.028735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:30:00.155236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'16","reported_seq":214,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.639007+0000","last_change":"2024-05-10T09:58:37.639083+0000","last_active":"2024-05-10T09:58:37.639007+0000","last_peered":"2024-05-10T09:58:37.639007+0000","last_clean":"2024-05-10T09:58:37.639007+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:37.639007+0000","last_undegraded":"2024-05-10T09:58:37.639007+0000","last_fullsized":"2024-05-10T09:58:37.639007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:37.638729+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:37.638729+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.638729+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:44.710395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":30720,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":154,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.476011+0000","last_change":"2024-05-10T09:58:33.476072+0000","last_active":"2024-05-10T09:58:33.476011+0000","last_peered":"2024-05-10T09:58:33.476011+0000","last_clean":"2024-05-10T09:58:33.476011+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:33.476011+0000","last_undegraded":"2024-05-10T09:58:33.476011+0000","last_fullsized":"2024-05-10T09:58:33.476011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.475811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.475811+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.475811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:31.453235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"110'10","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.572496+0000","last_change":"2024-05-10T09:58:32.572560+0000","last_active":"2024-05-10T09:58:32.572496+0000","last_peered":"2024-05-10T09:58:32.572496+0000","last_clean":"2024-05-10T09:58:32.572496+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:32.572496+0000","last_undegraded":"2024-05-10T09:58:32.572496+0000","last_fullsized":"2024-05-10T09:58:32.572496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-05-10T09:58:32.572302+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-05-10T09:58:32.572302+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.572302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:30.894984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.587265+0000","last_change":"2024-05-10T09:58:37.587318+0000","last_active":"2024-05-10T09:58:37.587265+0000","last_peered":"2024-05-10T09:58:37.587265+0000","last_clean":"2024-05-10T09:58:37.587265+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:37.587265+0000","last_undegraded":"2024-05-10T09:58:37.587265+0000","last_fullsized":"2024-05-10T09:58:37.587265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.587062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.587062+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.587062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:10.819139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'20","reported_seq":240,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.884303+0000","last_change":"2024-05-10T09:57:09.841645+0000","last_active":"2024-05-10T09:58:15.884303+0000","last_peered":"2024-05-10T09:58:15.884303+0000","last_clean":"2024-05-10T09:58:15.884303+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:15.884303+0000","last_undegraded":"2024-05-10T09:58:15.884303+0000","last_fullsized":"2024-05-10T09:58:15.884303+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36870,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.653466+0000","last_change":"2024-05-10T09:54:41.656353+0000","last_active":"2024-05-10T09:58:04.653466+0000","last_peered":"2024-05-10T09:58:04.653466+0000","last_clean":"2024-05-10T09:58:04.653466+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:04.653466+0000","last_undegraded":"2024-05-10T09:58:04.653466+0000","last_fullsized":"2024-05-10T09:58:04.653466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'18","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.918835+0000","last_change":"2024-05-10T09:54:39.653948+0000","last_active":"2024-05-10T09:58:15.918835+0000","last_peered":"2024-05-10T09:58:15.918835+0000","last_clean":"2024-05-10T09:58:15.918835+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:15.918835+0000","last_undegraded":"2024-05-10T09:58:15.918835+0000","last_fullsized":"2024-05-10T09:58:15.918835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":36870,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.993944+0000","last_change":"2024-05-10T09:58:25.994051+0000","last_active":"2024-05-10T09:58:25.993944+0000","last_peered":"2024-05-10T09:58:25.993944+0000","last_clean":"2024-05-10T09:58:25.993944+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:25.993944+0000","last_undegraded":"2024-05-10T09:58:25.993944+0000","last_fullsized":"2024-05-10T09:58:25.993944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.993717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.993717+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.993717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:27.219541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'24","reported_seq":252,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.850900+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:58:15.850900+0000","last_peered":"2024-05-10T09:58:15.850900+0000","last_clean":"2024-05-10T09:58:15.850900+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:58:15.850900+0000","last_undegraded":"2024-05-10T09:58:15.850900+0000","last_fullsized":"2024-05-10T09:58:15.850900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":45080,"num_write":64,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.496560+0000","last_change":"2024-05-10T09:58:27.496620+0000","last_active":"2024-05-10T09:58:27.496560+0000","last_peered":"2024-05-10T09:58:27.496560+0000","last_clean":"2024-05-10T09:58:27.496560+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:27.496560+0000","last_undegraded":"2024-05-10T09:58:27.496560+0000","last_fullsized":"2024-05-10T09:58:27.496560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.496364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.496364+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.496364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:42.146854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'16","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.707707+0000","last_change":"2024-05-10T09:54:39.667856+0000","last_active":"2024-05-10T09:58:15.707707+0000","last_peered":"2024-05-10T09:58:15.707707+0000","last_clean":"2024-05-10T09:58:15.707707+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:15.707707+0000","last_undegraded":"2024-05-10T09:58:15.707707+0000","last_fullsized":"2024-05-10T09:58:15.707707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.088448+0000","last_change":"2024-05-10T09:58:34.088518+0000","last_active":"2024-05-10T09:58:34.088448+0000","last_peered":"2024-05-10T09:58:34.088448+0000","last_clean":"2024-05-10T09:58:34.088448+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:34.088448+0000","last_undegraded":"2024-05-10T09:58:34.088448+0000","last_fullsized":"2024-05-10T09:58:34.088448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.088162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.088162+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.088162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:44.874236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'16","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.922499+0000","last_change":"2024-05-10T09:54:39.638593+0000","last_active":"2024-05-10T09:58:15.922499+0000","last_peered":"2024-05-10T09:58:15.922499+0000","last_clean":"2024-05-10T09:58:15.922499+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:15.922499+0000","last_undegraded":"2024-05-10T09:58:15.922499+0000","last_fullsized":"2024-05-10T09:58:15.922499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.788251+0000","last_change":"2024-05-10T09:58:37.788309+0000","last_active":"2024-05-10T09:58:37.788251+0000","last_peered":"2024-05-10T09:58:37.788251+0000","last_clean":"2024-05-10T09:58:37.788251+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:37.788251+0000","last_undegraded":"2024-05-10T09:58:37.788251+0000","last_fullsized":"2024-05-10T09:58:37.788251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.788055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.788055+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.788055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:19.954023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'22","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.949033+0000","last_change":"2024-05-10T09:57:12.422648+0000","last_active":"2024-05-10T09:58:15.949033+0000","last_peered":"2024-05-10T09:58:15.949033+0000","last_clean":"2024-05-10T09:58:15.949033+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:15.949033+0000","last_undegraded":"2024-05-10T09:58:15.949033+0000","last_fullsized":"2024-05-10T09:58:15.949033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":36880,"num_write":52,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.025637+0000","last_change":"2024-05-10T09:58:27.025701+0000","last_active":"2024-05-10T09:58:27.025637+0000","last_peered":"2024-05-10T09:58:27.025637+0000","last_clean":"2024-05-10T09:58:27.025637+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:27.025637+0000","last_undegraded":"2024-05-10T09:58:27.025637+0000","last_fullsized":"2024-05-10T09:58:27.025637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-05-10T09:58:27.025433+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-05-10T09:58:27.025433+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.025433+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:13.163122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"110'20","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.863671+0000","last_change":"2024-05-10T09:54:39.649798+0000","last_active":"2024-05-10T09:58:15.863671+0000","last_peered":"2024-05-10T09:58:15.863671+0000","last_clean":"2024-05-10T09:58:15.863671+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:15.863671+0000","last_undegraded":"2024-05-10T09:58:15.863671+0000","last_fullsized":"2024-05-10T09:58:15.863671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":34834,"num_write":50,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:04.530582+0000","last_change":"2024-05-10T09:54:41.656483+0000","last_active":"2024-05-10T09:58:04.530582+0000","last_peered":"2024-05-10T09:58:04.530582+0000","last_clean":"2024-05-10T09:58:04.530582+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:04.530582+0000","last_undegraded":"2024-05-10T09:58:04.530582+0000","last_fullsized":"2024-05-10T09:58:04.530582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:40.616109+0000","last_clean_scrub_stamp":"2024-05-10T09:54:40.616109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'18","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.501496+0000","last_change":"2024-05-10T09:58:24.501561+0000","last_active":"2024-05-10T09:58:24.501496+0000","last_peered":"2024-05-10T09:58:24.501496+0000","last_clean":"2024-05-10T09:58:24.501496+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:24.501496+0000","last_undegraded":"2024-05-10T09:58:24.501496+0000","last_fullsized":"2024-05-10T09:58:24.501496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.501285+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.501285+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.501285+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:14.059384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36864,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.753115+0000","last_change":"2024-05-10T09:58:35.753173+0000","last_active":"2024-05-10T09:58:35.753115+0000","last_peered":"2024-05-10T09:58:35.753115+0000","last_clean":"2024-05-10T09:58:35.753115+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:35.753115+0000","last_undegraded":"2024-05-10T09:58:35.753115+0000","last_fullsized":"2024-05-10T09:58:35.753115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.752877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.752877+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.752877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:36.113270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'22","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.805860+0000","last_change":"2024-05-10T09:54:39.660661+0000","last_active":"2024-05-10T09:58:15.805860+0000","last_peered":"2024-05-10T09:58:15.805860+0000","last_clean":"2024-05-10T09:58:15.805860+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:15.805860+0000","last_undegraded":"2024-05-10T09:58:15.805860+0000","last_fullsized":"2024-05-10T09:58:15.805860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":36882,"num_write":52,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"110'16","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.896126+0000","last_change":"2024-05-10T09:54:39.663699+0000","last_active":"2024-05-10T09:58:15.896126+0000","last_peered":"2024-05-10T09:58:15.896126+0000","last_clean":"2024-05-10T09:58:15.896126+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:15.896126+0000","last_undegraded":"2024-05-10T09:58:15.896126+0000","last_fullsized":"2024-05-10T09:58:15.896126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.125433+0000","last_change":"2024-05-10T09:58:40.125488+0000","last_active":"2024-05-10T09:58:40.125433+0000","last_peered":"2024-05-10T09:58:40.125433+0000","last_clean":"2024-05-10T09:58:40.125433+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:40.125433+0000","last_undegraded":"2024-05-10T09:58:40.125433+0000","last_fullsized":"2024-05-10T09:58:40.125433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.125229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.125229+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.125229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.505146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'16","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.820481+0000","last_change":"2024-05-10T09:57:10.462450+0000","last_active":"2024-05-10T09:58:15.820481+0000","last_peered":"2024-05-10T09:58:15.820481+0000","last_clean":"2024-05-10T09:58:15.820481+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:15.820481+0000","last_undegraded":"2024-05-10T09:58:15.820481+0000","last_fullsized":"2024-05-10T09:58:15.820481+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24582,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.378615+0000","last_change":"2024-05-10T09:58:33.378667+0000","last_active":"2024-05-10T09:58:33.378615+0000","last_peered":"2024-05-10T09:58:33.378615+0000","last_clean":"2024-05-10T09:58:33.378615+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:33.378615+0000","last_undegraded":"2024-05-10T09:58:33.378615+0000","last_fullsized":"2024-05-10T09:58:33.378615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.378427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.378427+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.378427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:07.970531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1213,"num_read_kb":1594,"num_write":779,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":798,"ondisk_log_size":798,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1522,"num_read_kb":2003600,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1949696,"data_stored":1353311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1339392,"data_stored":763712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1376256,"data_stored":763111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285588,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1292,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1323008,"data_stored":762774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1347584,"data_stored":762679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1318912,"data_stored":761845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37224,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1933312,"data_stored":1353153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542200,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1347584,"data_stored":762533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:58:43.209 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.209 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.209 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.210 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.210 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.210 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.210 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.210 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.210 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.210 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.211 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.211 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.211 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.211 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.211 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.211 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.211 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.211 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.212 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.212 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.212 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.212 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.212 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.212 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.212 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.212 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.213 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.213 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.213 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.213 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.213 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.213 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.213 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.214 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.214 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.214 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.214 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.214 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.214 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.215 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.215 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.215 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.215 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.215 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.215 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T09:54:26.508259+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=26, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.215 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.215 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.216 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.216 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.216 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.216 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.216 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.216 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.216 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.217 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.217 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.217 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.217 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-10T09:54:32.552880+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=32, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.217 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.217 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.218 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.218 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.218 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.218 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.218 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.218 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.218 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.219 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.219 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.219 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.219 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.219 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.219 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.219 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.220 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.220 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.220 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.220 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.220 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.220 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.220 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.220 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-10T09:54:42.629241+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=42, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-10T09:54:48.673851+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=48, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.221 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.222 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.222 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.222 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.222 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.222 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-10T09:54:44.635803+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=44, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.222 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.222 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.223 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.223 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.223 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.223 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.223 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.223 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.223 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.223 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.224 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.224 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.224 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.224 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-10T09:54:40.616109+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=40, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.224 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.224 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.224 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:58:43.224 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T09:59:03.225 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:59:03.586 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:59:03.592 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:59:03.611 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-05-10T09:59:02.295506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723235,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4543,"num_read_kb":2006570,"num_write":3838,"num_write_kb":2050326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2700,"ondisk_log_size":2700,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282440,"kb_used_data":11656,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":754692280,"statfs":{"total":773094113280,"available":772804894720,"internally_reserved":0,"allocated":11935744,"data_stored":7283118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006840"},"pg_stats":[{"pgid":"3.3f","version":"110'20","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.649888+0000","last_change":"2024-05-10T09:58:46.649888+0000","last_active":"2024-05-10T09:58:46.649888+0000","last_peered":"2024-05-10T09:58:46.649888+0000","last_clean":"2024-05-10T09:58:46.649888+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:46.649888+0000","last_undegraded":"2024-05-10T09:58:46.649888+0000","last_fullsized":"2024-05-10T09:58:46.649888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:46.649632+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:46.649632+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.649632+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:51.167238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":40,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:55.646806+0000","last_change":"2024-05-10T09:58:55.646867+0000","last_active":"2024-05-10T09:58:55.646806+0000","last_peered":"2024-05-10T09:58:55.646806+0000","last_clean":"2024-05-10T09:58:55.646806+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:55.646806+0000","last_undegraded":"2024-05-10T09:58:55.646806+0000","last_fullsized":"2024-05-10T09:58:55.646806+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:55.646589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:55.646589+0000","last_clean_scrub_stamp":"2024-05-10T09:58:55.646589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:19.231627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'16","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.559145+0000","last_change":"2024-05-10T09:58:39.559145+0000","last_active":"2024-05-10T09:58:39.559145+0000","last_peered":"2024-05-10T09:58:39.559145+0000","last_clean":"2024-05-10T09:58:39.559145+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:39.559145+0000","last_undegraded":"2024-05-10T09:58:39.559145+0000","last_fullsized":"2024-05-10T09:58:39.559145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:39.558841+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:39.558841+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.558841+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:43.069821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.737000+0000","last_change":"2024-05-10T09:58:33.737064+0000","last_active":"2024-05-10T09:58:33.737000+0000","last_peered":"2024-05-10T09:58:33.737000+0000","last_clean":"2024-05-10T09:58:33.737000+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:33.737000+0000","last_undegraded":"2024-05-10T09:58:33.737000+0000","last_fullsized":"2024-05-10T09:58:33.737000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'32","last_scrub_stamp":"2024-05-10T09:58:33.736797+0000","last_deep_scrub":"89'32","last_deep_scrub_stamp":"2024-05-10T09:58:33.736797+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.736797+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:05.981545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'14","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.145725+0000","last_change":"2024-05-10T09:58:44.145725+0000","last_active":"2024-05-10T09:58:44.145725+0000","last_peered":"2024-05-10T09:58:44.145725+0000","last_clean":"2024-05-10T09:58:44.145725+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:44.145725+0000","last_undegraded":"2024-05-10T09:58:44.145725+0000","last_fullsized":"2024-05-10T09:58:44.145725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:44.145467+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:44.145467+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.145467+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:54.582468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28690,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.060961+0000","last_change":"2024-05-10T09:58:40.061013+0000","last_active":"2024-05-10T09:58:40.060961+0000","last_peered":"2024-05-10T09:58:40.060961+0000","last_clean":"2024-05-10T09:58:40.060961+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:40.060961+0000","last_undegraded":"2024-05-10T09:58:40.060961+0000","last_fullsized":"2024-05-10T09:58:40.060961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.060758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.060758+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.060758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:43.844732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'16","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.440609+0000","last_change":"2024-05-10T09:58:43.440671+0000","last_active":"2024-05-10T09:58:43.440609+0000","last_peered":"2024-05-10T09:58:43.440609+0000","last_clean":"2024-05-10T09:58:43.440609+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:43.440609+0000","last_undegraded":"2024-05-10T09:58:43.440609+0000","last_fullsized":"2024-05-10T09:58:43.440609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:43.440411+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:43.440411+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.440411+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:53.984112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32792,"num_write":56,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.106220+0000","last_change":"2024-05-10T09:58:36.106341+0000","last_active":"2024-05-10T09:58:36.106220+0000","last_peered":"2024-05-10T09:58:36.106220+0000","last_clean":"2024-05-10T09:58:36.106220+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:36.106220+0000","last_undegraded":"2024-05-10T09:58:36.106220+0000","last_fullsized":"2024-05-10T09:58:36.106220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.105962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.105962+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.105962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:28.047939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"110'24","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.691228+0000","last_change":"2024-05-10T09:58:43.691290+0000","last_active":"2024-05-10T09:58:43.691228+0000","last_peered":"2024-05-10T09:58:43.691228+0000","last_clean":"2024-05-10T09:58:43.691228+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:43.691228+0000","last_undegraded":"2024-05-10T09:58:43.691228+0000","last_fullsized":"2024-05-10T09:58:43.691228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:43.691041+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:43.691041+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.691041+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:14.082962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":43032,"num_write":64,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.544696+0000","last_change":"2024-05-10T09:58:36.544696+0000","last_active":"2024-05-10T09:58:36.544696+0000","last_peered":"2024-05-10T09:58:36.544696+0000","last_clean":"2024-05-10T09:58:36.544696+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:36.544696+0000","last_undegraded":"2024-05-10T09:58:36.544696+0000","last_fullsized":"2024-05-10T09:58:36.544696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.544306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.544306+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.544306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:08.789054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'18","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.397600+0000","last_change":"2024-05-10T09:58:39.397763+0000","last_active":"2024-05-10T09:58:39.397600+0000","last_peered":"2024-05-10T09:58:39.397600+0000","last_clean":"2024-05-10T09:58:39.397600+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:39.397600+0000","last_undegraded":"2024-05-10T09:58:39.397600+0000","last_fullsized":"2024-05-10T09:58:39.397600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:39.397381+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:39.397381+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.397381+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:23:14.181483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":36876,"num_write":38,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.985854+0000","last_change":"2024-05-10T09:58:47.985922+0000","last_active":"2024-05-10T09:58:47.985854+0000","last_peered":"2024-05-10T09:58:47.985854+0000","last_clean":"2024-05-10T09:58:47.985854+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:47.985854+0000","last_undegraded":"2024-05-10T09:58:47.985854+0000","last_fullsized":"2024-05-10T09:58:47.985854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:47.985655+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:47.985655+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.985655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:20.951714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'8","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.488851+0000","last_change":"2024-05-10T09:58:35.488913+0000","last_active":"2024-05-10T09:58:35.488851+0000","last_peered":"2024-05-10T09:58:35.488851+0000","last_clean":"2024-05-10T09:58:35.488851+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:35.488851+0000","last_undegraded":"2024-05-10T09:58:35.488851+0000","last_fullsized":"2024-05-10T09:58:35.488851+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'8","last_scrub_stamp":"2024-05-10T09:58:35.488651+0000","last_deep_scrub":"110'8","last_deep_scrub_stamp":"2024-05-10T09:58:35.488651+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.488651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:50.432986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.418697+0000","last_change":"2024-05-10T09:58:31.418697+0000","last_active":"2024-05-10T09:58:31.418697+0000","last_peered":"2024-05-10T09:58:31.418697+0000","last_clean":"2024-05-10T09:58:31.418697+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:31.418697+0000","last_undegraded":"2024-05-10T09:58:31.418697+0000","last_fullsized":"2024-05-10T09:58:31.418697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.418452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.418452+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.418452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:54.823224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'12","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.631816+0000","last_change":"2024-05-10T09:58:53.631977+0000","last_active":"2024-05-10T09:58:53.631816+0000","last_peered":"2024-05-10T09:58:53.631816+0000","last_clean":"2024-05-10T09:58:53.631816+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:53.631816+0000","last_undegraded":"2024-05-10T09:58:53.631816+0000","last_fullsized":"2024-05-10T09:58:53.631816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:53.631517+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:53.631517+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.631517+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:40:35.129145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.454471+0000","last_change":"2024-05-10T09:58:25.454471+0000","last_active":"2024-05-10T09:58:25.454471+0000","last_peered":"2024-05-10T09:58:25.454471+0000","last_clean":"2024-05-10T09:58:25.454471+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:25.454471+0000","last_undegraded":"2024-05-10T09:58:25.454471+0000","last_fullsized":"2024-05-10T09:58:25.454471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.454208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.454208+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.454208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:38.690662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.006325+0000","last_change":"2024-05-10T09:58:45.006424+0000","last_active":"2024-05-10T09:58:45.006325+0000","last_peered":"2024-05-10T09:58:45.006325+0000","last_clean":"2024-05-10T09:58:45.006325+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:45.006325+0000","last_undegraded":"2024-05-10T09:58:45.006325+0000","last_fullsized":"2024-05-10T09:58:45.006325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:45.005979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:45.005979+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.005979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:29.330451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"110'12","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.731448+0000","last_change":"2024-05-10T09:58:39.731579+0000","last_active":"2024-05-10T09:58:39.731448+0000","last_peered":"2024-05-10T09:58:39.731448+0000","last_clean":"2024-05-10T09:58:39.731448+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:39.731448+0000","last_undegraded":"2024-05-10T09:58:39.731448+0000","last_fullsized":"2024-05-10T09:58:39.731448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:39.731164+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:39.731164+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.731164+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:29.497714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.746367+0000","last_change":"2024-05-10T09:58:31.746420+0000","last_active":"2024-05-10T09:58:31.746367+0000","last_peered":"2024-05-10T09:58:31.746367+0000","last_clean":"2024-05-10T09:58:31.746367+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:31.746367+0000","last_undegraded":"2024-05-10T09:58:31.746367+0000","last_fullsized":"2024-05-10T09:58:31.746367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.746174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.746174+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.746174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:02.939549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'12","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.524565+0000","last_change":"2024-05-10T09:58:39.524692+0000","last_active":"2024-05-10T09:58:39.524565+0000","last_peered":"2024-05-10T09:58:39.524565+0000","last_clean":"2024-05-10T09:58:39.524565+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:39.524565+0000","last_undegraded":"2024-05-10T09:58:39.524565+0000","last_fullsized":"2024-05-10T09:58:39.524565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:39.524324+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:39.524324+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.524324+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:18.460188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.370826+0000","last_change":"2024-05-10T09:58:35.370887+0000","last_active":"2024-05-10T09:58:35.370826+0000","last_peered":"2024-05-10T09:58:35.370826+0000","last_clean":"2024-05-10T09:58:35.370826+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:35.370826+0000","last_undegraded":"2024-05-10T09:58:35.370826+0000","last_fullsized":"2024-05-10T09:58:35.370826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'34","last_scrub_stamp":"2024-05-10T09:58:35.370626+0000","last_deep_scrub":"89'34","last_deep_scrub_stamp":"2024-05-10T09:58:35.370626+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.370626+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:38.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'10","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.548047+0000","last_change":"2024-05-10T09:58:35.548111+0000","last_active":"2024-05-10T09:58:35.548047+0000","last_peered":"2024-05-10T09:58:35.548047+0000","last_clean":"2024-05-10T09:58:35.548047+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:35.548047+0000","last_undegraded":"2024-05-10T09:58:35.548047+0000","last_fullsized":"2024-05-10T09:58:35.548047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-05-10T09:58:35.547851+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-05-10T09:58:35.547851+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.547851+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:21.685540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.500980+0000","last_change":"2024-05-10T09:58:26.501035+0000","last_active":"2024-05-10T09:58:26.500980+0000","last_peered":"2024-05-10T09:58:26.500980+0000","last_clean":"2024-05-10T09:58:26.500980+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:26.500980+0000","last_undegraded":"2024-05-10T09:58:26.500980+0000","last_fullsized":"2024-05-10T09:58:26.500980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.500752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.500752+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.500752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:14.199743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"110'34","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.983537+0000","last_change":"2024-05-10T09:58:52.983601+0000","last_active":"2024-05-10T09:58:52.983537+0000","last_peered":"2024-05-10T09:58:52.983537+0000","last_clean":"2024-05-10T09:58:52.983537+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:52.983537+0000","last_undegraded":"2024-05-10T09:58:52.983537+0000","last_fullsized":"2024-05-10T09:58:52.983537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'34","last_scrub_stamp":"2024-05-10T09:58:52.983318+0000","last_deep_scrub":"110'34","last_deep_scrub_stamp":"2024-05-10T09:58:52.983318+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.983318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:49.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":61452,"num_write":54,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":240,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.440776+0000","last_change":"2024-05-10T09:58:38.440840+0000","last_active":"2024-05-10T09:58:38.440776+0000","last_peered":"2024-05-10T09:58:38.440776+0000","last_clean":"2024-05-10T09:58:38.440776+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:38.440776+0000","last_undegraded":"2024-05-10T09:58:38.440776+0000","last_fullsized":"2024-05-10T09:58:38.440776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:38.440564+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:38.440564+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.440564+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:05.058211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'8","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.637556+0000","last_change":"2024-05-10T09:58:50.637621+0000","last_active":"2024-05-10T09:58:50.637556+0000","last_peered":"2024-05-10T09:58:50.637556+0000","last_clean":"2024-05-10T09:58:50.637556+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:50.637556+0000","last_undegraded":"2024-05-10T09:58:50.637556+0000","last_fullsized":"2024-05-10T09:58:50.637556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'8","last_scrub_stamp":"2024-05-10T09:58:50.637360+0000","last_deep_scrub":"110'8","last_deep_scrub_stamp":"2024-05-10T09:58:50.637360+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.637360+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:38.370801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.084199+0000","last_change":"2024-05-10T09:58:43.084254+0000","last_active":"2024-05-10T09:58:43.084199+0000","last_peered":"2024-05-10T09:58:43.084199+0000","last_clean":"2024-05-10T09:58:43.084199+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:43.084199+0000","last_undegraded":"2024-05-10T09:58:43.084199+0000","last_fullsized":"2024-05-10T09:58:43.084199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:43.083992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:43.083992+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.083992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:34.681583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"110'18","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.175212+0000","last_change":"2024-05-10T09:58:46.175280+0000","last_active":"2024-05-10T09:58:46.175212+0000","last_peered":"2024-05-10T09:58:46.175212+0000","last_clean":"2024-05-10T09:58:46.175212+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:46.175212+0000","last_undegraded":"2024-05-10T09:58:46.175212+0000","last_fullsized":"2024-05-10T09:58:46.175212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:46.174985+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:46.174985+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.174985+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:15.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30720,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.998074+0000","last_change":"2024-05-10T09:58:46.998163+0000","last_active":"2024-05-10T09:58:46.998074+0000","last_peered":"2024-05-10T09:58:46.998074+0000","last_clean":"2024-05-10T09:58:46.998074+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:46.998074+0000","last_undegraded":"2024-05-10T09:58:46.998074+0000","last_fullsized":"2024-05-10T09:58:46.998074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:46.997843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:46.997843+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.997843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:16:05.647702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.688936+0000","last_change":"2024-05-10T09:58:32.688993+0000","last_active":"2024-05-10T09:58:32.688936+0000","last_peered":"2024-05-10T09:58:32.688936+0000","last_clean":"2024-05-10T09:58:32.688936+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:32.688936+0000","last_undegraded":"2024-05-10T09:58:32.688936+0000","last_fullsized":"2024-05-10T09:58:32.688936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.688703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.688703+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.688703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:51.398393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"110'16","reported_seq":243,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.739732+0000","last_change":"2024-05-10T09:58:52.739796+0000","last_active":"2024-05-10T09:58:52.739732+0000","last_peered":"2024-05-10T09:58:52.739732+0000","last_clean":"2024-05-10T09:58:52.739732+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:52.739732+0000","last_undegraded":"2024-05-10T09:58:52.739732+0000","last_fullsized":"2024-05-10T09:58:52.739732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:52.739538+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:52.739538+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.739538+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:34.942139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":18442,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.421152+0000","last_change":"2024-05-10T09:58:36.421282+0000","last_active":"2024-05-10T09:58:36.421152+0000","last_peered":"2024-05-10T09:58:36.421152+0000","last_clean":"2024-05-10T09:58:36.421152+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:36.421152+0000","last_undegraded":"2024-05-10T09:58:36.421152+0000","last_fullsized":"2024-05-10T09:58:36.421152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.420867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.420867+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.420867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:25.605867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'21","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.169722+0000","last_change":"2024-05-10T09:58:41.169894+0000","last_active":"2024-05-10T09:58:41.169722+0000","last_peered":"2024-05-10T09:58:41.169722+0000","last_clean":"2024-05-10T09:58:41.169722+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:41.169722+0000","last_undegraded":"2024-05-10T09:58:41.169722+0000","last_fullsized":"2024-05-10T09:58:41.169722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'21","last_scrub_stamp":"2024-05-10T09:58:41.169482+0000","last_deep_scrub":"110'21","last_deep_scrub_stamp":"2024-05-10T09:58:41.169482+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.169482+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:45.687088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.705012+0000","last_change":"2024-05-10T09:58:34.705073+0000","last_active":"2024-05-10T09:58:34.705012+0000","last_peered":"2024-05-10T09:58:34.705012+0000","last_clean":"2024-05-10T09:58:34.705012+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:34.705012+0000","last_undegraded":"2024-05-10T09:58:34.705012+0000","last_fullsized":"2024-05-10T09:58:34.705012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.704808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.704808+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.704808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:07.936885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:56.630199+0000","last_change":"2024-05-10T09:58:56.630259+0000","last_active":"2024-05-10T09:58:56.630199+0000","last_peered":"2024-05-10T09:58:56.630199+0000","last_clean":"2024-05-10T09:58:56.630199+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:56.630199+0000","last_undegraded":"2024-05-10T09:58:56.630199+0000","last_fullsized":"2024-05-10T09:58:56.630199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:56.629992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:56.629992+0000","last_clean_scrub_stamp":"2024-05-10T09:58:56.629992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:28.311396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.439959+0000","last_change":"2024-05-10T09:58:29.440013+0000","last_active":"2024-05-10T09:58:29.439959+0000","last_peered":"2024-05-10T09:58:29.439959+0000","last_clean":"2024-05-10T09:58:29.439959+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:29.439959+0000","last_undegraded":"2024-05-10T09:58:29.439959+0000","last_fullsized":"2024-05-10T09:58:29.439959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.439758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.439758+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.439758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:15.577447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'18","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.178417+0000","last_change":"2024-05-10T09:58:45.178476+0000","last_active":"2024-05-10T09:58:45.178417+0000","last_peered":"2024-05-10T09:58:45.178417+0000","last_clean":"2024-05-10T09:58:45.178417+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:45.178417+0000","last_undegraded":"2024-05-10T09:58:45.178417+0000","last_fullsized":"2024-05-10T09:58:45.178417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:45.178217+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:45.178217+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.178217+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:03.395783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.689999+0000","last_change":"2024-05-10T09:58:33.690132+0000","last_active":"2024-05-10T09:58:33.689999+0000","last_peered":"2024-05-10T09:58:33.689999+0000","last_clean":"2024-05-10T09:58:33.689999+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:33.689999+0000","last_undegraded":"2024-05-10T09:58:33.689999+0000","last_fullsized":"2024-05-10T09:58:33.689999+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.689780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.689780+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.689780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:25.631757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"110'9","reported_seq":105,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.053551+0000","last_change":"2024-05-10T09:58:44.053620+0000","last_active":"2024-05-10T09:58:44.053551+0000","last_peered":"2024-05-10T09:58:44.053551+0000","last_clean":"2024-05-10T09:58:44.053551+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:44.053551+0000","last_undegraded":"2024-05-10T09:58:44.053551+0000","last_fullsized":"2024-05-10T09:58:44.053551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'9","last_scrub_stamp":"2024-05-10T09:58:44.053347+0000","last_deep_scrub":"110'9","last_deep_scrub_stamp":"2024-05-10T09:58:44.053347+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.053347+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:19:14.172812+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.997826+0000","last_change":"2024-05-10T09:58:28.997883+0000","last_active":"2024-05-10T09:58:28.997826+0000","last_peered":"2024-05-10T09:58:28.997826+0000","last_clean":"2024-05-10T09:58:28.997826+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:28.997826+0000","last_undegraded":"2024-05-10T09:58:28.997826+0000","last_fullsized":"2024-05-10T09:58:28.997826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.997630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.997630+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.997630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:58.539156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.129836+0000","last_change":"2024-05-10T09:58:54.129911+0000","last_active":"2024-05-10T09:58:54.129836+0000","last_peered":"2024-05-10T09:58:54.129836+0000","last_clean":"2024-05-10T09:58:54.129836+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:54.129836+0000","last_undegraded":"2024-05-10T09:58:54.129836+0000","last_fullsized":"2024-05-10T09:58:54.129836+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:54.129628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:54.129628+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.129628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:35:32.639658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.119463+0000","last_change":"2024-05-10T09:58:38.119530+0000","last_active":"2024-05-10T09:58:38.119463+0000","last_peered":"2024-05-10T09:58:38.119463+0000","last_clean":"2024-05-10T09:58:38.119463+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:38.119463+0000","last_undegraded":"2024-05-10T09:58:38.119463+0000","last_fullsized":"2024-05-10T09:58:38.119463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:38.119215+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:38.119215+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.119215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:08.511135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'20","reported_seq":253,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:55.740931+0000","last_change":"2024-05-10T09:58:55.740990+0000","last_active":"2024-05-10T09:58:55.740931+0000","last_peered":"2024-05-10T09:58:55.740931+0000","last_clean":"2024-05-10T09:58:55.740931+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:55.740931+0000","last_undegraded":"2024-05-10T09:58:55.740931+0000","last_fullsized":"2024-05-10T09:58:55.740931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:55.740745+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:55.740745+0000","last_clean_scrub_stamp":"2024-05-10T09:58:55.740745+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:05:18.225706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":34834,"num_write":50,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.654992+0000","last_change":"2024-05-10T09:58:37.655086+0000","last_active":"2024-05-10T09:58:37.654992+0000","last_peered":"2024-05-10T09:58:37.654992+0000","last_clean":"2024-05-10T09:58:37.654992+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:37.654992+0000","last_undegraded":"2024-05-10T09:58:37.654992+0000","last_fullsized":"2024-05-10T09:58:37.654992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.654760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.654760+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.654760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.034677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"110'15","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.488930+0000","last_change":"2024-05-10T09:58:37.489092+0000","last_active":"2024-05-10T09:58:37.488930+0000","last_peered":"2024-05-10T09:58:37.488930+0000","last_clean":"2024-05-10T09:58:37.488930+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:37.488930+0000","last_undegraded":"2024-05-10T09:58:37.488930+0000","last_fullsized":"2024-05-10T09:58:37.488930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:37.488682+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:37.488682+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.488682+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:28.648725+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'19","reported_seq":248,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.720913+0000","last_change":"2024-05-10T09:58:48.720980+0000","last_active":"2024-05-10T09:58:48.720913+0000","last_peered":"2024-05-10T09:58:48.720913+0000","last_clean":"2024-05-10T09:58:48.720913+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:48.720913+0000","last_undegraded":"2024-05-10T09:58:48.720913+0000","last_fullsized":"2024-05-10T09:58:48.720913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'19","last_scrub_stamp":"2024-05-10T09:58:48.720726+0000","last_deep_scrub":"110'19","last_deep_scrub_stamp":"2024-05-10T09:58:48.720726+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.720726+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:20.221864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.068352+0000","last_change":"2024-05-10T09:58:39.068409+0000","last_active":"2024-05-10T09:58:39.068352+0000","last_peered":"2024-05-10T09:58:39.068352+0000","last_clean":"2024-05-10T09:58:39.068352+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:39.068352+0000","last_undegraded":"2024-05-10T09:58:39.068352+0000","last_fullsized":"2024-05-10T09:58:39.068352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:39.068154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:39.068154+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.068154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:10:30.638064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.613907+0000","last_change":"2024-05-10T09:58:38.613964+0000","last_active":"2024-05-10T09:58:38.613907+0000","last_peered":"2024-05-10T09:58:38.613907+0000","last_clean":"2024-05-10T09:58:38.613907+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:38.613907+0000","last_undegraded":"2024-05-10T09:58:38.613907+0000","last_fullsized":"2024-05-10T09:58:38.613907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.613707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.613707+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.613707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:43.131314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'18","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.586366+0000","last_change":"2024-05-10T09:58:33.586500+0000","last_active":"2024-05-10T09:58:33.586366+0000","last_peered":"2024-05-10T09:58:33.586366+0000","last_clean":"2024-05-10T09:58:33.586366+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:33.586366+0000","last_undegraded":"2024-05-10T09:58:33.586366+0000","last_fullsized":"2024-05-10T09:58:33.586366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:33.586099+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:33.586099+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.586099+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:08.765872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.393466+0000","last_change":"2024-05-10T09:58:32.393522+0000","last_active":"2024-05-10T09:58:32.393466+0000","last_peered":"2024-05-10T09:58:32.393466+0000","last_clean":"2024-05-10T09:58:32.393466+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:32.393466+0000","last_undegraded":"2024-05-10T09:58:32.393466+0000","last_fullsized":"2024-05-10T09:58:32.393466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.393279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.393279+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.393279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:25:32.242983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'20","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.728239+0000","last_change":"2024-05-10T09:58:32.728406+0000","last_active":"2024-05-10T09:58:32.728239+0000","last_peered":"2024-05-10T09:58:32.728239+0000","last_clean":"2024-05-10T09:58:32.728239+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:32.728239+0000","last_undegraded":"2024-05-10T09:58:32.728239+0000","last_fullsized":"2024-05-10T09:58:32.728239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:32.727966+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:32.727966+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.727966+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:18.865655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"110'18","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.618816+0000","last_change":"2024-05-10T09:58:23.618883+0000","last_active":"2024-05-10T09:58:23.618816+0000","last_peered":"2024-05-10T09:58:23.618816+0000","last_clean":"2024-05-10T09:58:23.618816+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:23.618816+0000","last_undegraded":"2024-05-10T09:58:23.618816+0000","last_fullsized":"2024-05-10T09:58:23.618816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:23.618614+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:23.618614+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.618614+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:54.811989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.418848+0000","last_change":"2024-05-10T09:58:30.418905+0000","last_active":"2024-05-10T09:58:30.418848+0000","last_peered":"2024-05-10T09:58:30.418848+0000","last_clean":"2024-05-10T09:58:30.418848+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:30.418848+0000","last_undegraded":"2024-05-10T09:58:30.418848+0000","last_fullsized":"2024-05-10T09:58:30.418848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.418650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.418650+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.418650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:38:28.888661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'12","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.732290+0000","last_change":"2024-05-10T09:58:53.732361+0000","last_active":"2024-05-10T09:58:53.732290+0000","last_peered":"2024-05-10T09:58:53.732290+0000","last_clean":"2024-05-10T09:58:53.732290+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:53.732290+0000","last_undegraded":"2024-05-10T09:58:53.732290+0000","last_fullsized":"2024-05-10T09:58:53.732290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:53.732081+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:53.732081+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.732081+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:25.119682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":18444,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.731858+0000","last_change":"2024-05-10T09:58:29.731914+0000","last_active":"2024-05-10T09:58:29.731858+0000","last_peered":"2024-05-10T09:58:29.731858+0000","last_clean":"2024-05-10T09:58:29.731858+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:29.731858+0000","last_undegraded":"2024-05-10T09:58:29.731858+0000","last_fullsized":"2024-05-10T09:58:29.731858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.731667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.731667+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.731667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:28.054350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'35","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.520764+0000","last_change":"2024-05-10T09:58:27.520851+0000","last_active":"2024-05-10T09:58:27.520764+0000","last_peered":"2024-05-10T09:58:27.520764+0000","last_clean":"2024-05-10T09:58:27.520764+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:27.520764+0000","last_undegraded":"2024-05-10T09:58:27.520764+0000","last_fullsized":"2024-05-10T09:58:27.520764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'35","last_scrub_stamp":"2024-05-10T09:58:27.520581+0000","last_deep_scrub":"110'35","last_deep_scrub_stamp":"2024-05-10T09:58:27.520581+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.520581+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:51.985220+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.735893+0000","last_change":"2024-05-10T09:58:26.735956+0000","last_active":"2024-05-10T09:58:26.735893+0000","last_peered":"2024-05-10T09:58:26.735893+0000","last_clean":"2024-05-10T09:58:26.735893+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:26.735893+0000","last_undegraded":"2024-05-10T09:58:26.735893+0000","last_fullsized":"2024-05-10T09:58:26.735893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.735648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.735648+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.735648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:39.607212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:57.677547+0000","last_change":"2024-05-10T09:58:57.677547+0000","last_active":"2024-05-10T09:58:57.677547+0000","last_peered":"2024-05-10T09:58:57.677547+0000","last_clean":"2024-05-10T09:58:57.677547+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:57.677547+0000","last_undegraded":"2024-05-10T09:58:57.677547+0000","last_fullsized":"2024-05-10T09:58:57.677547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:57.677268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:57.677268+0000","last_clean_scrub_stamp":"2024-05-10T09:58:57.677268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:00.859809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.113342+0000","last_change":"2024-05-10T09:58:36.113416+0000","last_active":"2024-05-10T09:58:36.113342+0000","last_peered":"2024-05-10T09:58:36.113342+0000","last_clean":"2024-05-10T09:58:36.113342+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:36.113342+0000","last_undegraded":"2024-05-10T09:58:36.113342+0000","last_fullsized":"2024-05-10T09:58:36.113342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:36.113103+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:36.113103+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.113103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:20.605682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'20","reported_seq":251,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.707107+0000","last_change":"2024-05-10T09:58:54.707169+0000","last_active":"2024-05-10T09:58:54.707107+0000","last_peered":"2024-05-10T09:58:54.707107+0000","last_clean":"2024-05-10T09:58:54.707107+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:54.707107+0000","last_undegraded":"2024-05-10T09:58:54.707107+0000","last_fullsized":"2024-05-10T09:58:54.707107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:54.706916+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:54.706916+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.706916+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:18.036494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38930,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.562833+0000","last_change":"2024-05-10T09:58:22.562854+0000","last_active":"2024-05-10T09:58:22.562833+0000","last_peered":"2024-05-10T09:58:22.562833+0000","last_clean":"2024-05-10T09:58:22.562833+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:22.562833+0000","last_undegraded":"2024-05-10T09:58:22.562833+0000","last_fullsized":"2024-05-10T09:58:22.562833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.562754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.562754+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.562754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:32.614610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'22","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.603214+0000","last_change":"2024-05-10T09:58:45.603303+0000","last_active":"2024-05-10T09:58:45.603214+0000","last_peered":"2024-05-10T09:58:45.603214+0000","last_clean":"2024-05-10T09:58:45.603214+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:45.603214+0000","last_undegraded":"2024-05-10T09:58:45.603214+0000","last_fullsized":"2024-05-10T09:58:45.603214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:45.603028+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:45.603028+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.603028+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:16.990629+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.580361+0000","last_change":"2024-05-10T09:58:22.580404+0000","last_active":"2024-05-10T09:58:22.580361+0000","last_peered":"2024-05-10T09:58:22.580361+0000","last_clean":"2024-05-10T09:58:22.580361+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:22.580361+0000","last_undegraded":"2024-05-10T09:58:22.580361+0000","last_fullsized":"2024-05-10T09:58:22.580361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.580217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.580217+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.580217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:31:57.759990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.524497+0000","last_change":"2024-05-10T09:58:42.524497+0000","last_active":"2024-05-10T09:58:42.524497+0000","last_peered":"2024-05-10T09:58:42.524497+0000","last_clean":"2024-05-10T09:58:42.524497+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:42.524497+0000","last_undegraded":"2024-05-10T09:58:42.524497+0000","last_fullsized":"2024-05-10T09:58:42.524497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-05-10T09:58:42.524211+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-05-10T09:58:42.524211+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.524211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:32.290761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.558940+0000","last_change":"2024-05-10T09:58:30.559000+0000","last_active":"2024-05-10T09:58:30.558940+0000","last_peered":"2024-05-10T09:58:30.558940+0000","last_clean":"2024-05-10T09:58:30.558940+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:30.558940+0000","last_undegraded":"2024-05-10T09:58:30.558940+0000","last_fullsized":"2024-05-10T09:58:30.558940+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.558746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.558746+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.558746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.963440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'16","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.674526+0000","last_change":"2024-05-10T09:58:47.674615+0000","last_active":"2024-05-10T09:58:47.674526+0000","last_peered":"2024-05-10T09:58:47.674526+0000","last_clean":"2024-05-10T09:58:47.674526+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:47.674526+0000","last_undegraded":"2024-05-10T09:58:47.674526+0000","last_fullsized":"2024-05-10T09:58:47.674526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:47.674315+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:47.674315+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.674315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:50.661933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.439441+0000","last_change":"2024-05-10T09:58:29.439613+0000","last_active":"2024-05-10T09:58:29.439441+0000","last_peered":"2024-05-10T09:58:29.439441+0000","last_clean":"2024-05-10T09:58:29.439441+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:29.439441+0000","last_undegraded":"2024-05-10T09:58:29.439441+0000","last_fullsized":"2024-05-10T09:58:29.439441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.439219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.439219+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.439219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:09:31.720031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'29","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.686141+0000","last_change":"2024-05-10T09:58:25.686292+0000","last_active":"2024-05-10T09:58:25.686141+0000","last_peered":"2024-05-10T09:58:25.686141+0000","last_clean":"2024-05-10T09:58:25.686141+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:25.686141+0000","last_undegraded":"2024-05-10T09:58:25.686141+0000","last_fullsized":"2024-05-10T09:58:25.686141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'29","last_scrub_stamp":"2024-05-10T09:58:25.685859+0000","last_deep_scrub":"110'29","last_deep_scrub_stamp":"2024-05-10T09:58:25.685859+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.685859+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:46.184892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'18","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.085482+0000","last_change":"2024-05-10T09:58:24.085550+0000","last_active":"2024-05-10T09:58:24.085482+0000","last_peered":"2024-05-10T09:58:24.085482+0000","last_clean":"2024-05-10T09:58:24.085482+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:24.085482+0000","last_undegraded":"2024-05-10T09:58:24.085482+0000","last_fullsized":"2024-05-10T09:58:24.085482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.085290+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.085290+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.085290+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:22.407972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.124342+0000","last_change":"2024-05-10T09:58:53.124415+0000","last_active":"2024-05-10T09:58:53.124342+0000","last_peered":"2024-05-10T09:58:53.124342+0000","last_clean":"2024-05-10T09:58:53.124342+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:53.124342+0000","last_undegraded":"2024-05-10T09:58:53.124342+0000","last_fullsized":"2024-05-10T09:58:53.124342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:53.124129+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:53.124129+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.124129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:47.964582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.049200+0000","last_change":"2024-05-10T09:58:30.049267+0000","last_active":"2024-05-10T09:58:30.049200+0000","last_peered":"2024-05-10T09:58:30.049200+0000","last_clean":"2024-05-10T09:58:30.049200+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:30.049200+0000","last_undegraded":"2024-05-10T09:58:30.049200+0000","last_fullsized":"2024-05-10T09:58:30.049200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'42","last_scrub_stamp":"2024-05-10T09:58:30.049003+0000","last_deep_scrub":"89'42","last_deep_scrub_stamp":"2024-05-10T09:58:30.049003+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.049003+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:30.409395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'24","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.599513+0000","last_change":"2024-05-10T09:58:51.599571+0000","last_active":"2024-05-10T09:58:51.599513+0000","last_peered":"2024-05-10T09:58:51.599513+0000","last_clean":"2024-05-10T09:58:51.599513+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:51.599513+0000","last_undegraded":"2024-05-10T09:58:51.599513+0000","last_fullsized":"2024-05-10T09:58:51.599513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:51.599284+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:51.599284+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.599284+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:05:14.084244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":49170,"num_write":54,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.473944+0000","last_change":"2024-05-10T09:58:36.473998+0000","last_active":"2024-05-10T09:58:36.473944+0000","last_peered":"2024-05-10T09:58:36.473944+0000","last_clean":"2024-05-10T09:58:36.473944+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:36.473944+0000","last_undegraded":"2024-05-10T09:58:36.473944+0000","last_fullsized":"2024-05-10T09:58:36.473944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.473749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.473749+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.473749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.723420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'35","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.142029+0000","last_change":"2024-05-10T09:58:39.142110+0000","last_active":"2024-05-10T09:58:39.142029+0000","last_peered":"2024-05-10T09:58:39.142029+0000","last_clean":"2024-05-10T09:58:39.142029+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:39.142029+0000","last_undegraded":"2024-05-10T09:58:39.142029+0000","last_fullsized":"2024-05-10T09:58:39.142029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'35","last_scrub_stamp":"2024-05-10T09:58:39.141835+0000","last_deep_scrub":"110'35","last_deep_scrub_stamp":"2024-05-10T09:58:39.141835+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.141835+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:49.105710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":59,"num_read_kb":98,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.489069+0000","last_change":"2024-05-10T09:58:32.489127+0000","last_active":"2024-05-10T09:58:32.489069+0000","last_peered":"2024-05-10T09:58:32.489069+0000","last_clean":"2024-05-10T09:58:32.489069+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:32.489069+0000","last_undegraded":"2024-05-10T09:58:32.489069+0000","last_fullsized":"2024-05-10T09:58:32.489069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.488872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.488872+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.488872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:29.913561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.508962+0000","last_change":"2024-05-10T09:58:43.509117+0000","last_active":"2024-05-10T09:58:43.508962+0000","last_peered":"2024-05-10T09:58:43.508962+0000","last_clean":"2024-05-10T09:58:43.508962+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:43.508962+0000","last_undegraded":"2024-05-10T09:58:43.508962+0000","last_fullsized":"2024-05-10T09:58:43.508962+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:43.508733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:43.508733+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.508733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:50.855174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.034595+0000","last_change":"2024-05-10T09:58:28.034649+0000","last_active":"2024-05-10T09:58:28.034595+0000","last_peered":"2024-05-10T09:58:28.034595+0000","last_clean":"2024-05-10T09:58:28.034595+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:28.034595+0000","last_undegraded":"2024-05-10T09:58:28.034595+0000","last_fullsized":"2024-05-10T09:58:28.034595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.034404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.034404+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.034404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:09:35.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'14","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.617127+0000","last_change":"2024-05-10T09:58:47.617201+0000","last_active":"2024-05-10T09:58:47.617127+0000","last_peered":"2024-05-10T09:58:47.617127+0000","last_clean":"2024-05-10T09:58:47.617127+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:47.617127+0000","last_undegraded":"2024-05-10T09:58:47.617127+0000","last_fullsized":"2024-05-10T09:58:47.617127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:47.616927+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:47.616927+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.616927+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:05:10.101888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28696,"num_write":54,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.404205+0000","last_change":"2024-05-10T09:58:30.404259+0000","last_active":"2024-05-10T09:58:30.404205+0000","last_peered":"2024-05-10T09:58:30.404205+0000","last_clean":"2024-05-10T09:58:30.404205+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:30.404205+0000","last_undegraded":"2024-05-10T09:58:30.404205+0000","last_fullsized":"2024-05-10T09:58:30.404205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.404013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.404013+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.404013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:53.231386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'29","reported_seq":137,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.951204+0000","last_change":"2024-05-10T09:58:50.951287+0000","last_active":"2024-05-10T09:58:50.951204+0000","last_peered":"2024-05-10T09:58:50.951204+0000","last_clean":"2024-05-10T09:58:50.951204+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:50.951204+0000","last_undegraded":"2024-05-10T09:58:50.951204+0000","last_fullsized":"2024-05-10T09:58:50.951204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'29","last_scrub_stamp":"2024-05-10T09:58:50.951018+0000","last_deep_scrub":"110'29","last_deep_scrub_stamp":"2024-05-10T09:58:50.951018+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.951018+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:48.112574+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":62,"num_write":32,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":858,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:19.097639+0000","last_change":"2024-05-10T09:58:19.097693+0000","last_active":"2024-05-10T09:58:19.097639+0000","last_peered":"2024-05-10T09:58:19.097639+0000","last_clean":"2024-05-10T09:58:19.097639+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:19.097639+0000","last_undegraded":"2024-05-10T09:58:19.097639+0000","last_fullsized":"2024-05-10T09:58:19.097639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:19.097509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:19.097509+0000","last_clean_scrub_stamp":"2024-05-10T09:58:19.097509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.252931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.686138+0000","last_change":"2024-05-10T09:58:25.686138+0000","last_active":"2024-05-10T09:58:25.686138+0000","last_peered":"2024-05-10T09:58:25.686138+0000","last_clean":"2024-05-10T09:58:25.686138+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:25.686138+0000","last_undegraded":"2024-05-10T09:58:25.686138+0000","last_fullsized":"2024-05-10T09:58:25.686138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.685801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.685801+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.685801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:57.930550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.103814+0000","last_change":"2024-05-10T09:58:33.103870+0000","last_active":"2024-05-10T09:58:33.103814+0000","last_peered":"2024-05-10T09:58:33.103814+0000","last_clean":"2024-05-10T09:58:33.103814+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:33.103814+0000","last_undegraded":"2024-05-10T09:58:33.103814+0000","last_fullsized":"2024-05-10T09:58:33.103814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.103627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.103627+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.103627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:21.064029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'12","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.512999+0000","last_change":"2024-05-10T09:58:43.512999+0000","last_active":"2024-05-10T09:58:43.512999+0000","last_peered":"2024-05-10T09:58:43.512999+0000","last_clean":"2024-05-10T09:58:43.512999+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:43.512999+0000","last_undegraded":"2024-05-10T09:58:43.512999+0000","last_fullsized":"2024-05-10T09:58:43.512999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:43.512550+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:43.512550+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.512550+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:02.222240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.392347+0000","last_change":"2024-05-10T09:58:48.392405+0000","last_active":"2024-05-10T09:58:48.392347+0000","last_peered":"2024-05-10T09:58:48.392347+0000","last_clean":"2024-05-10T09:58:48.392347+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:48.392347+0000","last_undegraded":"2024-05-10T09:58:48.392347+0000","last_fullsized":"2024-05-10T09:58:48.392347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:48.392147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:48.392147+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.392147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:22.771321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'32","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.560442+0000","last_change":"2024-05-10T09:58:21.560479+0000","last_active":"2024-05-10T09:58:21.560442+0000","last_peered":"2024-05-10T09:58:21.560442+0000","last_clean":"2024-05-10T09:58:21.560442+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:21.560442+0000","last_undegraded":"2024-05-10T09:58:21.560442+0000","last_fullsized":"2024-05-10T09:58:21.560442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'32","last_scrub_stamp":"2024-05-10T09:58:21.560361+0000","last_deep_scrub":"110'32","last_deep_scrub_stamp":"2024-05-10T09:58:21.560361+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.560361+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:36.972412+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":68,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'18","reported_seq":263,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.440450+0000","last_change":"2024-05-10T09:58:31.440554+0000","last_active":"2024-05-10T09:58:31.440450+0000","last_peered":"2024-05-10T09:58:31.440450+0000","last_clean":"2024-05-10T09:58:31.440450+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:31.440450+0000","last_undegraded":"2024-05-10T09:58:31.440450+0000","last_fullsized":"2024-05-10T09:58:31.440450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:31.440173+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:31.440173+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.440173+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:41.837626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.511283+0000","last_change":"2024-05-10T09:58:42.511283+0000","last_active":"2024-05-10T09:58:42.511283+0000","last_peered":"2024-05-10T09:58:42.511283+0000","last_clean":"2024-05-10T09:58:42.511283+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:42.511283+0000","last_undegraded":"2024-05-10T09:58:42.511283+0000","last_fullsized":"2024-05-10T09:58:42.511283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-05-10T09:58:42.511010+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-05-10T09:58:42.511010+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.511010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:27.177849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.983470+0000","last_change":"2024-05-10T09:58:24.983604+0000","last_active":"2024-05-10T09:58:24.983470+0000","last_peered":"2024-05-10T09:58:24.983470+0000","last_clean":"2024-05-10T09:58:24.983470+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:24.983470+0000","last_undegraded":"2024-05-10T09:58:24.983470+0000","last_fullsized":"2024-05-10T09:58:24.983470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.983218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.983218+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.983218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:03.586274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'6","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.018057+0000","last_change":"2024-05-10T09:58:22.018176+0000","last_active":"2024-05-10T09:58:22.018057+0000","last_peered":"2024-05-10T09:58:22.018057+0000","last_clean":"2024-05-10T09:58:22.018057+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:22.018057+0000","last_undegraded":"2024-05-10T09:58:22.018057+0000","last_fullsized":"2024-05-10T09:58:22.018057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-05-10T09:58:22.017751+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-05-10T09:58:22.017751+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.017751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:36.819356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"110'4","reported_seq":214,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.668615+0000","last_change":"2024-05-10T09:58:54.668688+0000","last_active":"2024-05-10T09:58:54.668615+0000","last_peered":"2024-05-10T09:58:54.668615+0000","last_clean":"2024-05-10T09:58:54.668615+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:54.668615+0000","last_undegraded":"2024-05-10T09:58:54.668615+0000","last_fullsized":"2024-05-10T09:58:54.668615+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-05-10T09:58:54.668402+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-05-10T09:58:54.668402+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.668402+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:28.660826+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"110'15","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.697050+0000","last_change":"2024-05-10T09:58:30.697133+0000","last_active":"2024-05-10T09:58:30.697050+0000","last_peered":"2024-05-10T09:58:30.697050+0000","last_clean":"2024-05-10T09:58:30.697050+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:30.697050+0000","last_undegraded":"2024-05-10T09:58:30.697050+0000","last_fullsized":"2024-05-10T09:58:30.697050+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:30.696850+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:30.696850+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.696850+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:54.681885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'18","reported_seq":244,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.503929+0000","last_change":"2024-05-10T09:58:26.504000+0000","last_active":"2024-05-10T09:58:26.503929+0000","last_peered":"2024-05-10T09:58:26.503929+0000","last_clean":"2024-05-10T09:58:26.503929+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:26.503929+0000","last_undegraded":"2024-05-10T09:58:26.503929+0000","last_fullsized":"2024-05-10T09:58:26.503929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:26.503736+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:26.503736+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.503736+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:36:41.630591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.097673+0000","last_change":"2024-05-10T09:58:41.097728+0000","last_active":"2024-05-10T09:58:41.097673+0000","last_peered":"2024-05-10T09:58:41.097673+0000","last_clean":"2024-05-10T09:58:41.097673+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:41.097673+0000","last_undegraded":"2024-05-10T09:58:41.097673+0000","last_fullsized":"2024-05-10T09:58:41.097673+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:41.097472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:41.097472+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.097472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:52.314872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.648600+0000","last_change":"2024-05-10T09:58:31.648667+0000","last_active":"2024-05-10T09:58:31.648600+0000","last_peered":"2024-05-10T09:58:31.648600+0000","last_clean":"2024-05-10T09:58:31.648600+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:31.648600+0000","last_undegraded":"2024-05-10T09:58:31.648600+0000","last_fullsized":"2024-05-10T09:58:31.648600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'46","last_scrub_stamp":"2024-05-10T09:58:31.648362+0000","last_deep_scrub":"89'46","last_deep_scrub_stamp":"2024-05-10T09:58:31.648362+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.648362+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:49.521946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.644836+0000","last_change":"2024-05-10T09:58:49.644836+0000","last_active":"2024-05-10T09:58:49.644836+0000","last_peered":"2024-05-10T09:58:49.644836+0000","last_clean":"2024-05-10T09:58:49.644836+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:49.644836+0000","last_undegraded":"2024-05-10T09:58:49.644836+0000","last_fullsized":"2024-05-10T09:58:49.644836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:49.644586+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:49.644586+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.644586+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:05.257093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.073784+0000","last_change":"2024-05-10T09:58:35.073842+0000","last_active":"2024-05-10T09:58:35.073784+0000","last_peered":"2024-05-10T09:58:35.073784+0000","last_clean":"2024-05-10T09:58:35.073784+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:35.073784+0000","last_undegraded":"2024-05-10T09:58:35.073784+0000","last_fullsized":"2024-05-10T09:58:35.073784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.073567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.073567+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.073567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:45.269434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'35","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.426328+0000","last_change":"2024-05-10T09:58:42.426504+0000","last_active":"2024-05-10T09:58:42.426328+0000","last_peered":"2024-05-10T09:58:42.426328+0000","last_clean":"2024-05-10T09:58:42.426328+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:42.426328+0000","last_undegraded":"2024-05-10T09:58:42.426328+0000","last_fullsized":"2024-05-10T09:58:42.426328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'35","last_scrub_stamp":"2024-05-10T09:58:42.426118+0000","last_deep_scrub":"110'35","last_deep_scrub_stamp":"2024-05-10T09:58:42.426118+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.426118+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:20:18.277735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":60,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.473295+0000","last_change":"2024-05-10T09:58:25.473352+0000","last_active":"2024-05-10T09:58:25.473295+0000","last_peered":"2024-05-10T09:58:25.473295+0000","last_clean":"2024-05-10T09:58:25.473295+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:25.473295+0000","last_undegraded":"2024-05-10T09:58:25.473295+0000","last_fullsized":"2024-05-10T09:58:25.473295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.473104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.473104+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.473104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:52.090751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.474417+0000","last_change":"2024-05-10T09:58:44.474417+0000","last_active":"2024-05-10T09:58:44.474417+0000","last_peered":"2024-05-10T09:58:44.474417+0000","last_clean":"2024-05-10T09:58:44.474417+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:44.474417+0000","last_undegraded":"2024-05-10T09:58:44.474417+0000","last_fullsized":"2024-05-10T09:58:44.474417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:44.474053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:44.474053+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.474053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:55.343037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":248,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.525360+0000","last_change":"2024-05-10T09:58:44.525360+0000","last_active":"2024-05-10T09:58:44.525360+0000","last_peered":"2024-05-10T09:58:44.525360+0000","last_clean":"2024-05-10T09:58:44.525360+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:44.525360+0000","last_undegraded":"2024-05-10T09:58:44.525360+0000","last_fullsized":"2024-05-10T09:58:44.525360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'46","last_scrub_stamp":"2024-05-10T09:58:44.525111+0000","last_deep_scrub":"89'46","last_deep_scrub_stamp":"2024-05-10T09:58:44.525111+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.525111+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:36.467088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"110'74","reported_seq":297,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.706920+0000","last_change":"2024-05-10T09:58:40.707080+0000","last_active":"2024-05-10T09:58:40.706920+0000","last_peered":"2024-05-10T09:58:40.706920+0000","last_clean":"2024-05-10T09:58:40.706920+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:40.706920+0000","last_undegraded":"2024-05-10T09:58:40.706920+0000","last_fullsized":"2024-05-10T09:58:40.706920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'74","last_scrub_stamp":"2024-05-10T09:58:40.706652+0000","last_deep_scrub":"110'74","last_deep_scrub_stamp":"2024-05-10T09:58:40.706652+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.706652+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:59.416342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.525443+0000","last_change":"2024-05-10T09:58:45.525502+0000","last_active":"2024-05-10T09:58:45.525443+0000","last_peered":"2024-05-10T09:58:45.525443+0000","last_clean":"2024-05-10T09:58:45.525443+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:45.525443+0000","last_undegraded":"2024-05-10T09:58:45.525443+0000","last_fullsized":"2024-05-10T09:58:45.525443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:45.525234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:45.525234+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.525234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:29.150695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.594035+0000","last_change":"2024-05-10T09:58:54.594095+0000","last_active":"2024-05-10T09:58:54.594035+0000","last_peered":"2024-05-10T09:58:54.594035+0000","last_clean":"2024-05-10T09:58:54.594035+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:54.594035+0000","last_undegraded":"2024-05-10T09:58:54.594035+0000","last_fullsized":"2024-05-10T09:58:54.594035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:54.593842+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:54.593842+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.593842+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:39.439459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.760251+0000","last_change":"2024-05-10T09:58:27.760251+0000","last_active":"2024-05-10T09:58:27.760251+0000","last_peered":"2024-05-10T09:58:27.760251+0000","last_clean":"2024-05-10T09:58:27.760251+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:27.760251+0000","last_undegraded":"2024-05-10T09:58:27.760251+0000","last_fullsized":"2024-05-10T09:58:27.760251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.760005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.760005+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.760005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:09.164699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'45","reported_seq":248,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.404536+0000","last_change":"2024-05-10T09:58:40.404617+0000","last_active":"2024-05-10T09:58:40.404536+0000","last_peered":"2024-05-10T09:58:40.404536+0000","last_clean":"2024-05-10T09:58:40.404536+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:40.404536+0000","last_undegraded":"2024-05-10T09:58:40.404536+0000","last_fullsized":"2024-05-10T09:58:40.404536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'45","last_scrub_stamp":"2024-05-10T09:58:40.404348+0000","last_deep_scrub":"110'45","last_deep_scrub_stamp":"2024-05-10T09:58:40.404348+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.404348+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:50.368223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":125,"num_write":52,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.070164+0000","last_change":"2024-05-10T09:58:23.070219+0000","last_active":"2024-05-10T09:58:23.070164+0000","last_peered":"2024-05-10T09:58:23.070164+0000","last_clean":"2024-05-10T09:58:23.070164+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:23.070164+0000","last_undegraded":"2024-05-10T09:58:23.070164+0000","last_fullsized":"2024-05-10T09:58:23.070164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.069925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.069925+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.069925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:23.967919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.545426+0000","last_change":"2024-05-10T09:58:27.545484+0000","last_active":"2024-05-10T09:58:27.545426+0000","last_peered":"2024-05-10T09:58:27.545426+0000","last_clean":"2024-05-10T09:58:27.545426+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:27.545426+0000","last_undegraded":"2024-05-10T09:58:27.545426+0000","last_fullsized":"2024-05-10T09:58:27.545426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.545228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.545228+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.545228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:30.775332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.017083+0000","last_change":"2024-05-10T09:58:28.017154+0000","last_active":"2024-05-10T09:58:28.017083+0000","last_peered":"2024-05-10T09:58:28.017083+0000","last_clean":"2024-05-10T09:58:28.017083+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:28.017083+0000","last_undegraded":"2024-05-10T09:58:28.017083+0000","last_fullsized":"2024-05-10T09:58:28.017083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.016873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.016873+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.016873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:00.261622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.716040+0000","last_change":"2024-05-10T09:58:41.716099+0000","last_active":"2024-05-10T09:58:41.716040+0000","last_peered":"2024-05-10T09:58:41.716040+0000","last_clean":"2024-05-10T09:58:41.716040+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:41.716040+0000","last_undegraded":"2024-05-10T09:58:41.716040+0000","last_fullsized":"2024-05-10T09:58:41.716040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:41.715853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:41.715853+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.715853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:33.657830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'24","reported_seq":259,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:58.095323+0000","last_change":"2024-05-10T09:58:58.095394+0000","last_active":"2024-05-10T09:58:58.095323+0000","last_peered":"2024-05-10T09:58:58.095323+0000","last_clean":"2024-05-10T09:58:58.095323+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:58.095323+0000","last_undegraded":"2024-05-10T09:58:58.095323+0000","last_fullsized":"2024-05-10T09:58:58.095323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:58.095120+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:58.095120+0000","last_clean_scrub_stamp":"2024-05-10T09:58:58.095120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:01.775995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":45056,"num_write":24,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.398262+0000","last_change":"2024-05-10T09:58:34.398324+0000","last_active":"2024-05-10T09:58:34.398262+0000","last_peered":"2024-05-10T09:58:34.398262+0000","last_clean":"2024-05-10T09:58:34.398262+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:34.398262+0000","last_undegraded":"2024-05-10T09:58:34.398262+0000","last_fullsized":"2024-05-10T09:58:34.398262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.398073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.398073+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.398073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:45.040743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'72","reported_seq":327,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.724586+0000","last_change":"2024-05-10T09:58:20.724586+0000","last_active":"2024-05-10T09:58:20.724586+0000","last_peered":"2024-05-10T09:58:20.724586+0000","last_clean":"2024-05-10T09:58:20.724586+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:20.724586+0000","last_undegraded":"2024-05-10T09:58:20.724586+0000","last_fullsized":"2024-05-10T09:58:20.724586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'72","last_scrub_stamp":"2024-05-10T09:58:20.724440+0000","last_deep_scrub":"110'72","last_deep_scrub_stamp":"2024-05-10T09:58:20.724440+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.724440+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:52.798878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":112,"num_read_kb":160,"num_write":66,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.745796+0000","last_change":"2024-05-10T09:58:36.745796+0000","last_active":"2024-05-10T09:58:36.745796+0000","last_peered":"2024-05-10T09:58:36.745796+0000","last_clean":"2024-05-10T09:58:36.745796+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:36.745796+0000","last_undegraded":"2024-05-10T09:58:36.745796+0000","last_fullsized":"2024-05-10T09:58:36.745796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.745543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.745543+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.745543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:15.681407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.616527+0000","last_change":"2024-05-10T09:58:32.616587+0000","last_active":"2024-05-10T09:58:32.616527+0000","last_peered":"2024-05-10T09:58:32.616527+0000","last_clean":"2024-05-10T09:58:32.616527+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:32.616527+0000","last_undegraded":"2024-05-10T09:58:32.616527+0000","last_fullsized":"2024-05-10T09:58:32.616527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.616326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.616326+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.616326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:52:39.907022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.643825+0000","last_change":"2024-05-10T09:58:33.643943+0000","last_active":"2024-05-10T09:58:33.643825+0000","last_peered":"2024-05-10T09:58:33.643825+0000","last_clean":"2024-05-10T09:58:33.643825+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:33.643825+0000","last_undegraded":"2024-05-10T09:58:33.643825+0000","last_fullsized":"2024-05-10T09:58:33.643825+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.643517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.643517+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.643517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:27:52.512387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.521576+0000","last_change":"2024-05-10T09:58:23.521576+0000","last_active":"2024-05-10T09:58:23.521576+0000","last_peered":"2024-05-10T09:58:23.521576+0000","last_clean":"2024-05-10T09:58:23.521576+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:23.521576+0000","last_undegraded":"2024-05-10T09:58:23.521576+0000","last_fullsized":"2024-05-10T09:58:23.521576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.521285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.521285+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.521285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:20.909272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'16","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.635575+0000","last_change":"2024-05-10T09:58:36.635575+0000","last_active":"2024-05-10T09:58:36.635575+0000","last_peered":"2024-05-10T09:58:36.635575+0000","last_clean":"2024-05-10T09:58:36.635575+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:36.635575+0000","last_undegraded":"2024-05-10T09:58:36.635575+0000","last_fullsized":"2024-05-10T09:58:36.635575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:36.635200+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:36.635200+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.635200+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:13.825864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":26636,"num_write":36,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"110'2","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.599308+0000","last_change":"2024-05-10T09:58:20.599358+0000","last_active":"2024-05-10T09:58:20.599308+0000","last_peered":"2024-05-10T09:58:20.599308+0000","last_clean":"2024-05-10T09:58:20.599308+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:20.599308+0000","last_undegraded":"2024-05-10T09:58:20.599308+0000","last_fullsized":"2024-05-10T09:58:20.599308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:20.599197+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:20.599197+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.599197+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:49.316485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"110'23","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.747116+0000","last_change":"2024-05-10T09:58:28.747116+0000","last_active":"2024-05-10T09:58:28.747116+0000","last_peered":"2024-05-10T09:58:28.747116+0000","last_clean":"2024-05-10T09:58:28.747116+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:28.747116+0000","last_undegraded":"2024-05-10T09:58:28.747116+0000","last_fullsized":"2024-05-10T09:58:28.747116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'23","last_scrub_stamp":"2024-05-10T09:58:28.746825+0000","last_deep_scrub":"110'23","last_deep_scrub_stamp":"2024-05-10T09:58:28.746825+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.746825+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:29.644819+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:56.129968+0000","last_change":"2024-05-10T09:58:56.129968+0000","last_active":"2024-05-10T09:58:56.129968+0000","last_peered":"2024-05-10T09:58:56.129968+0000","last_clean":"2024-05-10T09:58:56.129968+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:56.129968+0000","last_undegraded":"2024-05-10T09:58:56.129968+0000","last_fullsized":"2024-05-10T09:58:56.129968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:56.129704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:56.129704+0000","last_clean_scrub_stamp":"2024-05-10T09:58:56.129704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:45.289616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:57.640177+0000","last_change":"2024-05-10T09:58:57.640238+0000","last_active":"2024-05-10T09:58:57.640177+0000","last_peered":"2024-05-10T09:58:57.640177+0000","last_clean":"2024-05-10T09:58:57.640177+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:57.640177+0000","last_undegraded":"2024-05-10T09:58:57.640177+0000","last_fullsized":"2024-05-10T09:58:57.640177+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:57.639975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:57.639975+0000","last_clean_scrub_stamp":"2024-05-10T09:58:57.639975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:09:30.798737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.680174+0000","last_change":"2024-05-10T09:58:29.680174+0000","last_active":"2024-05-10T09:58:29.680174+0000","last_peered":"2024-05-10T09:58:29.680174+0000","last_clean":"2024-05-10T09:58:29.680174+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:29.680174+0000","last_undegraded":"2024-05-10T09:58:29.680174+0000","last_fullsized":"2024-05-10T09:58:29.680174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.679760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.679760+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.679760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:50.969118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.476257+0000","last_change":"2024-05-10T09:58:44.476257+0000","last_active":"2024-05-10T09:58:44.476257+0000","last_peered":"2024-05-10T09:58:44.476257+0000","last_clean":"2024-05-10T09:58:44.476257+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:44.476257+0000","last_undegraded":"2024-05-10T09:58:44.476257+0000","last_fullsized":"2024-05-10T09:58:44.476257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:44.476009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:44.476009+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.476009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:28.251767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'16","reported_seq":195,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.103364+0000","last_change":"2024-05-10T09:58:38.103446+0000","last_active":"2024-05-10T09:58:38.103364+0000","last_peered":"2024-05-10T09:58:38.103364+0000","last_clean":"2024-05-10T09:58:38.103364+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:38.103364+0000","last_undegraded":"2024-05-10T09:58:38.103364+0000","last_fullsized":"2024-05-10T09:58:38.103364+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:38.103113+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:38.103113+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.103113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:49.490393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24588,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.044073+0000","last_change":"2024-05-10T09:58:33.044073+0000","last_active":"2024-05-10T09:58:33.044073+0000","last_peered":"2024-05-10T09:58:33.044073+0000","last_clean":"2024-05-10T09:58:33.044073+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:33.044073+0000","last_undegraded":"2024-05-10T09:58:33.044073+0000","last_fullsized":"2024-05-10T09:58:33.044073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.043821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.043821+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.043821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:57.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"110'18","reported_seq":210,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:58.684606+0000","last_change":"2024-05-10T09:58:58.684694+0000","last_active":"2024-05-10T09:58:58.684606+0000","last_peered":"2024-05-10T09:58:58.684606+0000","last_clean":"2024-05-10T09:58:58.684606+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:58.684606+0000","last_undegraded":"2024-05-10T09:58:58.684606+0000","last_fullsized":"2024-05-10T09:58:58.684606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:58.684402+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:58.684402+0000","last_clean_scrub_stamp":"2024-05-10T09:58:58.684402+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:30:00.174784+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.503635+0000","last_change":"2024-05-10T09:58:23.503767+0000","last_active":"2024-05-10T09:58:23.503635+0000","last_peered":"2024-05-10T09:58:23.503635+0000","last_clean":"2024-05-10T09:58:23.503635+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:23.503635+0000","last_undegraded":"2024-05-10T09:58:23.503635+0000","last_fullsized":"2024-05-10T09:58:23.503635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.503406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.503406+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.503406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:14.753078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.410048+0000","last_change":"2024-05-10T09:58:23.410155+0000","last_active":"2024-05-10T09:58:23.410048+0000","last_peered":"2024-05-10T09:58:23.410048+0000","last_clean":"2024-05-10T09:58:23.410048+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:23.410048+0000","last_undegraded":"2024-05-10T09:58:23.410048+0000","last_fullsized":"2024-05-10T09:58:23.410048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.409763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.409763+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.409763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:04.814457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.558647+0000","last_change":"2024-05-10T09:58:40.558647+0000","last_active":"2024-05-10T09:58:40.558647+0000","last_peered":"2024-05-10T09:58:40.558647+0000","last_clean":"2024-05-10T09:58:40.558647+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:40.558647+0000","last_undegraded":"2024-05-10T09:58:40.558647+0000","last_fullsized":"2024-05-10T09:58:40.558647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.558384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.558384+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.558384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:39.137697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'24","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.471738+0000","last_change":"2024-05-10T09:58:37.471738+0000","last_active":"2024-05-10T09:58:37.471738+0000","last_peered":"2024-05-10T09:58:37.471738+0000","last_clean":"2024-05-10T09:58:37.471738+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:37.471738+0000","last_undegraded":"2024-05-10T09:58:37.471738+0000","last_fullsized":"2024-05-10T09:58:37.471738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:37.471473+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:37.471473+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.471473+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:08.642738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45068,"num_write":44,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.626764+0000","last_change":"2024-05-10T09:58:35.626764+0000","last_active":"2024-05-10T09:58:35.626764+0000","last_peered":"2024-05-10T09:58:35.626764+0000","last_clean":"2024-05-10T09:58:35.626764+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:35.626764+0000","last_undegraded":"2024-05-10T09:58:35.626764+0000","last_fullsized":"2024-05-10T09:58:35.626764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.626500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.626500+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.626500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:29.673295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.014960+0000","last_change":"2024-05-10T09:58:29.014960+0000","last_active":"2024-05-10T09:58:29.014960+0000","last_peered":"2024-05-10T09:58:29.014960+0000","last_clean":"2024-05-10T09:58:29.014960+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:29.014960+0000","last_undegraded":"2024-05-10T09:58:29.014960+0000","last_fullsized":"2024-05-10T09:58:29.014960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.014717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.014717+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.014717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:02.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'42","reported_seq":244,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.137352+0000","last_change":"2024-05-10T09:58:35.137352+0000","last_active":"2024-05-10T09:58:35.137352+0000","last_peered":"2024-05-10T09:58:35.137352+0000","last_clean":"2024-05-10T09:58:35.137352+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:35.137352+0000","last_undegraded":"2024-05-10T09:58:35.137352+0000","last_fullsized":"2024-05-10T09:58:35.137352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'42","last_scrub_stamp":"2024-05-10T09:58:35.137041+0000","last_deep_scrub":"110'42","last_deep_scrub_stamp":"2024-05-10T09:58:35.137041+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.137041+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:53.846732+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":74,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.451259+0000","last_change":"2024-05-10T09:57:19.676469+0000","last_active":"2024-05-10T09:58:20.451259+0000","last_peered":"2024-05-10T09:58:20.451259+0000","last_clean":"2024-05-10T09:58:20.451259+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:58:20.451259+0000","last_undegraded":"2024-05-10T09:58:20.451259+0000","last_fullsized":"2024-05-10T09:58:20.451259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:46.655823+0000","last_clean_scrub_stamp":"2024-05-10T09:54:46.655823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.077887+0000","last_change":"2024-05-10T09:58:21.077905+0000","last_active":"2024-05-10T09:58:21.077887+0000","last_peered":"2024-05-10T09:58:21.077887+0000","last_clean":"2024-05-10T09:58:21.077887+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:21.077887+0000","last_undegraded":"2024-05-10T09:58:21.077887+0000","last_fullsized":"2024-05-10T09:58:21.077887+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:21.077818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:21.077818+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.077818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:37.122527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.085123+0000","last_change":"2024-05-10T09:58:34.085123+0000","last_active":"2024-05-10T09:58:34.085123+0000","last_peered":"2024-05-10T09:58:34.085123+0000","last_clean":"2024-05-10T09:58:34.085123+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:34.085123+0000","last_undegraded":"2024-05-10T09:58:34.085123+0000","last_fullsized":"2024-05-10T09:58:34.085123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:34.084795+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:34.084795+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.084795+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:23.851346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"110'6","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.589873+0000","last_change":"2024-05-10T09:58:38.589873+0000","last_active":"2024-05-10T09:58:38.589873+0000","last_peered":"2024-05-10T09:58:38.589873+0000","last_clean":"2024-05-10T09:58:38.589873+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:38.589873+0000","last_undegraded":"2024-05-10T09:58:38.589873+0000","last_fullsized":"2024-05-10T09:58:38.589873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-05-10T09:58:38.589615+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-05-10T09:58:38.589615+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.589615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:01:52.298107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.693571+0000","last_change":"2024-05-10T09:58:42.693571+0000","last_active":"2024-05-10T09:58:42.693571+0000","last_peered":"2024-05-10T09:58:42.693571+0000","last_clean":"2024-05-10T09:58:42.693571+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:42.693571+0000","last_undegraded":"2024-05-10T09:58:42.693571+0000","last_fullsized":"2024-05-10T09:58:42.693571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:42.693198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:42.693198+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.693198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:47.789584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"110'2","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.529614+0000","last_change":"2024-05-10T09:58:28.529614+0000","last_active":"2024-05-10T09:58:28.529614+0000","last_peered":"2024-05-10T09:58:28.529614+0000","last_clean":"2024-05-10T09:58:28.529614+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:28.529614+0000","last_undegraded":"2024-05-10T09:58:28.529614+0000","last_fullsized":"2024-05-10T09:58:28.529614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:28.529340+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:28.529340+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.529340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:49.028373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"110'22","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.705964+0000","last_change":"2024-05-10T09:58:24.705964+0000","last_active":"2024-05-10T09:58:24.705964+0000","last_peered":"2024-05-10T09:58:24.705964+0000","last_clean":"2024-05-10T09:58:24.705964+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:24.705964+0000","last_undegraded":"2024-05-10T09:58:24.705964+0000","last_fullsized":"2024-05-10T09:58:24.705964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:24.705658+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:24.705658+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.705658+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:13:15.819312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'18","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.411966+0000","last_change":"2024-05-10T09:58:25.411966+0000","last_active":"2024-05-10T09:58:25.411966+0000","last_peered":"2024-05-10T09:58:25.411966+0000","last_clean":"2024-05-10T09:58:25.411966+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:25.411966+0000","last_undegraded":"2024-05-10T09:58:25.411966+0000","last_fullsized":"2024-05-10T09:58:25.411966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:25.411703+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:25.411703+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.411703+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:38.566132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:56.607153+0000","last_change":"2024-05-10T09:58:56.607266+0000","last_active":"2024-05-10T09:58:56.607153+0000","last_peered":"2024-05-10T09:58:56.607153+0000","last_clean":"2024-05-10T09:58:56.607153+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:56.607153+0000","last_undegraded":"2024-05-10T09:58:56.607153+0000","last_fullsized":"2024-05-10T09:58:56.607153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:56.606852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:56.606852+0000","last_clean_scrub_stamp":"2024-05-10T09:58:56.606852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:47.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.614034+0000","last_change":"2024-05-10T09:58:40.614034+0000","last_active":"2024-05-10T09:58:40.614034+0000","last_peered":"2024-05-10T09:58:40.614034+0000","last_clean":"2024-05-10T09:58:40.614034+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:40.614034+0000","last_undegraded":"2024-05-10T09:58:40.614034+0000","last_fullsized":"2024-05-10T09:58:40.614034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.613635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.613635+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.613635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:12.114773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"110'20","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.681180+0000","last_change":"2024-05-10T09:58:51.681180+0000","last_active":"2024-05-10T09:58:51.681180+0000","last_peered":"2024-05-10T09:58:51.681180+0000","last_clean":"2024-05-10T09:58:51.681180+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:51.681180+0000","last_undegraded":"2024-05-10T09:58:51.681180+0000","last_fullsized":"2024-05-10T09:58:51.681180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:51.680915+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:51.680915+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.680915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:46.521369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.609389+0000","last_change":"2024-05-10T09:58:34.609389+0000","last_active":"2024-05-10T09:58:34.609389+0000","last_peered":"2024-05-10T09:58:34.609389+0000","last_clean":"2024-05-10T09:58:34.609389+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:34.609389+0000","last_undegraded":"2024-05-10T09:58:34.609389+0000","last_fullsized":"2024-05-10T09:58:34.609389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.609126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.609126+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.609126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:25.552434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.000209+0000","last_change":"2024-05-10T09:58:27.000271+0000","last_active":"2024-05-10T09:58:27.000209+0000","last_peered":"2024-05-10T09:58:27.000209+0000","last_clean":"2024-05-10T09:58:27.000209+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:27.000209+0000","last_undegraded":"2024-05-10T09:58:27.000209+0000","last_fullsized":"2024-05-10T09:58:27.000209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.000007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.000007+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.000007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:26:25.604303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"110'15","reported_seq":113,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.042957+0000","last_change":"2024-05-10T09:58:30.043029+0000","last_active":"2024-05-10T09:58:30.042957+0000","last_peered":"2024-05-10T09:58:30.042957+0000","last_clean":"2024-05-10T09:58:30.042957+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:30.042957+0000","last_undegraded":"2024-05-10T09:58:30.042957+0000","last_fullsized":"2024-05-10T09:58:30.042957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:30.042782+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:30.042782+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.042782+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:56.239837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"110'18","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.661351+0000","last_change":"2024-05-10T09:58:24.661351+0000","last_active":"2024-05-10T09:58:24.661351+0000","last_peered":"2024-05-10T09:58:24.661351+0000","last_clean":"2024-05-10T09:58:24.661351+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:24.661351+0000","last_undegraded":"2024-05-10T09:58:24.661351+0000","last_fullsized":"2024-05-10T09:58:24.661351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.661080+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.661080+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.661080+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:10.798769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.054847+0000","last_change":"2024-05-10T09:58:25.054976+0000","last_active":"2024-05-10T09:58:25.054847+0000","last_peered":"2024-05-10T09:58:25.054847+0000","last_clean":"2024-05-10T09:58:25.054847+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:25.054847+0000","last_undegraded":"2024-05-10T09:58:25.054847+0000","last_fullsized":"2024-05-10T09:58:25.054847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'8","last_scrub_stamp":"2024-05-10T09:58:25.054516+0000","last_deep_scrub":"89'8","last_deep_scrub_stamp":"2024-05-10T09:58:25.054516+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.054516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:00.234290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.009334+0000","last_change":"2024-05-10T09:58:23.009453+0000","last_active":"2024-05-10T09:58:23.009334+0000","last_peered":"2024-05-10T09:58:23.009334+0000","last_clean":"2024-05-10T09:58:23.009334+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:23.009334+0000","last_undegraded":"2024-05-10T09:58:23.009334+0000","last_fullsized":"2024-05-10T09:58:23.009334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'76","last_scrub_stamp":"2024-05-10T09:58:23.009098+0000","last_deep_scrub":"89'76","last_deep_scrub_stamp":"2024-05-10T09:58:23.009098+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.009098+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:41.058451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'32","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.145555+0000","last_change":"2024-05-10T09:58:47.145555+0000","last_active":"2024-05-10T09:58:47.145555+0000","last_peered":"2024-05-10T09:58:47.145555+0000","last_clean":"2024-05-10T09:58:47.145555+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:47.145555+0000","last_undegraded":"2024-05-10T09:58:47.145555+0000","last_fullsized":"2024-05-10T09:58:47.145555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'32","last_scrub_stamp":"2024-05-10T09:58:47.145102+0000","last_deep_scrub":"110'32","last_deep_scrub_stamp":"2024-05-10T09:58:47.145102+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.145102+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:42.413032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":59422,"num_write":82,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.607958+0000","last_change":"2024-05-10T09:58:31.607958+0000","last_active":"2024-05-10T09:58:31.607958+0000","last_peered":"2024-05-10T09:58:31.607958+0000","last_clean":"2024-05-10T09:58:31.607958+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:31.607958+0000","last_undegraded":"2024-05-10T09:58:31.607958+0000","last_fullsized":"2024-05-10T09:58:31.607958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.607683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.607683+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.607683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:32.505677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.594114+0000","last_change":"2024-05-10T09:58:39.594114+0000","last_active":"2024-05-10T09:58:39.594114+0000","last_peered":"2024-05-10T09:58:39.594114+0000","last_clean":"2024-05-10T09:58:39.594114+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:39.594114+0000","last_undegraded":"2024-05-10T09:58:39.594114+0000","last_fullsized":"2024-05-10T09:58:39.594114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:39.593867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:39.593867+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.593867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:42.581485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'52","reported_seq":262,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.745985+0000","last_change":"2024-05-10T09:58:30.745985+0000","last_active":"2024-05-10T09:58:30.745985+0000","last_peered":"2024-05-10T09:58:30.745985+0000","last_clean":"2024-05-10T09:58:30.745985+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:30.745985+0000","last_undegraded":"2024-05-10T09:58:30.745985+0000","last_fullsized":"2024-05-10T09:58:30.745985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'52","last_scrub_stamp":"2024-05-10T09:58:30.745724+0000","last_deep_scrub":"110'52","last_deep_scrub_stamp":"2024-05-10T09:58:30.745724+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.745724+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:05.925497+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":86,"num_read_kb":121,"num_write":54,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.674126+0000","last_change":"2024-05-10T09:58:27.674126+0000","last_active":"2024-05-10T09:58:27.674126+0000","last_peered":"2024-05-10T09:58:27.674126+0000","last_clean":"2024-05-10T09:58:27.674126+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:27.674126+0000","last_undegraded":"2024-05-10T09:58:27.674126+0000","last_fullsized":"2024-05-10T09:58:27.674126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.673776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.673776+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.673776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:28.034168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.649875+0000","last_change":"2024-05-10T09:58:53.650009+0000","last_active":"2024-05-10T09:58:53.649875+0000","last_peered":"2024-05-10T09:58:53.649875+0000","last_clean":"2024-05-10T09:58:53.649875+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:53.649875+0000","last_undegraded":"2024-05-10T09:58:53.649875+0000","last_fullsized":"2024-05-10T09:58:53.649875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:53.649617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:53.649617+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.649617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:49.956967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:55.091205+0000","last_change":"2024-05-10T09:58:55.091205+0000","last_active":"2024-05-10T09:58:55.091205+0000","last_peered":"2024-05-10T09:58:55.091205+0000","last_clean":"2024-05-10T09:58:55.091205+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:55.091205+0000","last_undegraded":"2024-05-10T09:58:55.091205+0000","last_fullsized":"2024-05-10T09:58:55.091205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:55.090945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:55.090945+0000","last_clean_scrub_stamp":"2024-05-10T09:58:55.090945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:26.772349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.988357+0000","last_change":"2024-05-10T09:58:20.988539+0000","last_active":"2024-05-10T09:58:20.988357+0000","last_peered":"2024-05-10T09:58:20.988357+0000","last_clean":"2024-05-10T09:58:20.988357+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:20.988357+0000","last_undegraded":"2024-05-10T09:58:20.988357+0000","last_fullsized":"2024-05-10T09:58:20.988357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:20.988131+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:20.988131+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.988131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:29.354050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'14","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.968273+0000","last_change":"2024-05-10T09:58:49.968333+0000","last_active":"2024-05-10T09:58:49.968273+0000","last_peered":"2024-05-10T09:58:49.968273+0000","last_clean":"2024-05-10T09:58:49.968273+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:49.968273+0000","last_undegraded":"2024-05-10T09:58:49.968273+0000","last_fullsized":"2024-05-10T09:58:49.968273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:49.968088+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:49.968088+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.968088+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:10.191282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:19.706450+0000","last_change":"2024-05-10T09:58:19.706490+0000","last_active":"2024-05-10T09:58:19.706450+0000","last_peered":"2024-05-10T09:58:19.706450+0000","last_clean":"2024-05-10T09:58:19.706450+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:19.706450+0000","last_undegraded":"2024-05-10T09:58:19.706450+0000","last_fullsized":"2024-05-10T09:58:19.706450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:19.706342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:19.706342+0000","last_clean_scrub_stamp":"2024-05-10T09:58:19.706342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:09.648820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'25","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.602396+0000","last_change":"2024-05-10T09:58:41.602477+0000","last_active":"2024-05-10T09:58:41.602396+0000","last_peered":"2024-05-10T09:58:41.602396+0000","last_clean":"2024-05-10T09:58:41.602396+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:41.602396+0000","last_undegraded":"2024-05-10T09:58:41.602396+0000","last_fullsized":"2024-05-10T09:58:41.602396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'25","last_scrub_stamp":"2024-05-10T09:58:41.602189+0000","last_deep_scrub":"110'25","last_deep_scrub_stamp":"2024-05-10T09:58:41.602189+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.602189+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:25.227651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":59,"num_write":24,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.640995+0000","last_change":"2024-05-10T09:58:26.641053+0000","last_active":"2024-05-10T09:58:26.640995+0000","last_peered":"2024-05-10T09:58:26.640995+0000","last_clean":"2024-05-10T09:58:26.640995+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:26.640995+0000","last_undegraded":"2024-05-10T09:58:26.640995+0000","last_fullsized":"2024-05-10T09:58:26.640995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.640791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.640791+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.640791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:59.872868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.732171+0000","last_change":"2024-05-10T09:58:29.732171+0000","last_active":"2024-05-10T09:58:29.732171+0000","last_peered":"2024-05-10T09:58:29.732171+0000","last_clean":"2024-05-10T09:58:29.732171+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:29.732171+0000","last_undegraded":"2024-05-10T09:58:29.732171+0000","last_fullsized":"2024-05-10T09:58:29.732171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-05-10T09:58:29.731904+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-05-10T09:58:29.731904+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.731904+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:11.897873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.689257+0000","last_change":"2024-05-10T09:58:23.689402+0000","last_active":"2024-05-10T09:58:23.689257+0000","last_peered":"2024-05-10T09:58:23.689257+0000","last_clean":"2024-05-10T09:58:23.689257+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:23.689257+0000","last_undegraded":"2024-05-10T09:58:23.689257+0000","last_fullsized":"2024-05-10T09:58:23.689257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.688993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.688993+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.688993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:42.872307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'18","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.647411+0000","last_change":"2024-05-10T09:58:45.647565+0000","last_active":"2024-05-10T09:58:45.647411+0000","last_peered":"2024-05-10T09:58:45.647411+0000","last_clean":"2024-05-10T09:58:45.647411+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:45.647411+0000","last_undegraded":"2024-05-10T09:58:45.647411+0000","last_fullsized":"2024-05-10T09:58:45.647411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:45.647185+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:45.647185+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.647185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.027102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30738,"num_write":48,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.701282+0000","last_change":"2024-05-10T09:58:35.701337+0000","last_active":"2024-05-10T09:58:35.701282+0000","last_peered":"2024-05-10T09:58:35.701282+0000","last_clean":"2024-05-10T09:58:35.701282+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:35.701282+0000","last_undegraded":"2024-05-10T09:58:35.701282+0000","last_fullsized":"2024-05-10T09:58:35.701282+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.701084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.701084+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.701084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:06.093005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"110'8","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.121495+0000","last_change":"2024-05-10T09:58:51.121588+0000","last_active":"2024-05-10T09:58:51.121495+0000","last_peered":"2024-05-10T09:58:51.121495+0000","last_clean":"2024-05-10T09:58:51.121495+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:51.121495+0000","last_undegraded":"2024-05-10T09:58:51.121495+0000","last_fullsized":"2024-05-10T09:58:51.121495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'8","last_scrub_stamp":"2024-05-10T09:58:51.121305+0000","last_deep_scrub":"110'8","last_deep_scrub_stamp":"2024-05-10T09:58:51.121305+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.121305+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:37.464780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.779870+0000","last_change":"2024-05-10T09:58:38.779932+0000","last_active":"2024-05-10T09:58:38.779870+0000","last_peered":"2024-05-10T09:58:38.779870+0000","last_clean":"2024-05-10T09:58:38.779870+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:38.779870+0000","last_undegraded":"2024-05-10T09:58:38.779870+0000","last_fullsized":"2024-05-10T09:58:38.779870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.779652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.779652+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.779652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:02.764687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.141988+0000","last_change":"2024-05-10T09:58:52.142048+0000","last_active":"2024-05-10T09:58:52.141988+0000","last_peered":"2024-05-10T09:58:52.141988+0000","last_clean":"2024-05-10T09:58:52.141988+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:52.141988+0000","last_undegraded":"2024-05-10T09:58:52.141988+0000","last_fullsized":"2024-05-10T09:58:52.141988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:52.141780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:52.141780+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.141780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:07.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.650996+0000","last_change":"2024-05-10T09:58:34.651060+0000","last_active":"2024-05-10T09:58:34.650996+0000","last_peered":"2024-05-10T09:58:34.650996+0000","last_clean":"2024-05-10T09:58:34.650996+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:34.650996+0000","last_undegraded":"2024-05-10T09:58:34.650996+0000","last_fullsized":"2024-05-10T09:58:34.650996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:34.650791+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:34.650791+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.650791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:39.747177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'14","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.564700+0000","last_change":"2024-05-10T09:58:46.564770+0000","last_active":"2024-05-10T09:58:46.564700+0000","last_peered":"2024-05-10T09:58:46.564700+0000","last_clean":"2024-05-10T09:58:46.564700+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:46.564700+0000","last_undegraded":"2024-05-10T09:58:46.564700+0000","last_fullsized":"2024-05-10T09:58:46.564700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:46.564513+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:46.564513+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.564513+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.782078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.748488+0000","last_change":"2024-05-10T09:58:50.748540+0000","last_active":"2024-05-10T09:58:50.748488+0000","last_peered":"2024-05-10T09:58:50.748488+0000","last_clean":"2024-05-10T09:58:50.748488+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:50.748488+0000","last_undegraded":"2024-05-10T09:58:50.748488+0000","last_fullsized":"2024-05-10T09:58:50.748488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:50.748291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:50.748291+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.748291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:09.583528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'26","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.632786+0000","last_change":"2024-05-10T09:58:43.632862+0000","last_active":"2024-05-10T09:58:43.632786+0000","last_peered":"2024-05-10T09:58:43.632786+0000","last_clean":"2024-05-10T09:58:43.632786+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:43.632786+0000","last_undegraded":"2024-05-10T09:58:43.632786+0000","last_fullsized":"2024-05-10T09:58:43.632786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'26","last_scrub_stamp":"2024-05-10T09:58:43.632592+0000","last_deep_scrub":"110'26","last_deep_scrub_stamp":"2024-05-10T09:58:43.632592+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.632592+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:36.235541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":64,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.476233+0000","last_change":"2024-05-10T09:58:22.476288+0000","last_active":"2024-05-10T09:58:22.476233+0000","last_peered":"2024-05-10T09:58:22.476233+0000","last_clean":"2024-05-10T09:58:22.476233+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:22.476233+0000","last_undegraded":"2024-05-10T09:58:22.476233+0000","last_fullsized":"2024-05-10T09:58:22.476233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.476038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.476038+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.476038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:37.420373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.421141+0000","last_change":"2024-05-10T09:58:22.421194+0000","last_active":"2024-05-10T09:58:22.421141+0000","last_peered":"2024-05-10T09:58:22.421141+0000","last_clean":"2024-05-10T09:58:22.421141+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:22.421141+0000","last_undegraded":"2024-05-10T09:58:22.421141+0000","last_fullsized":"2024-05-10T09:58:22.421141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.420950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.420950+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.420950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:01.544851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.670336+0000","last_change":"2024-05-10T09:58:36.670390+0000","last_active":"2024-05-10T09:58:36.670336+0000","last_peered":"2024-05-10T09:58:36.670336+0000","last_clean":"2024-05-10T09:58:36.670336+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:36.670336+0000","last_undegraded":"2024-05-10T09:58:36.670336+0000","last_fullsized":"2024-05-10T09:58:36.670336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.670113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.670113+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.670113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:46.633988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"110'22","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.128670+0000","last_change":"2024-05-10T09:58:49.128849+0000","last_active":"2024-05-10T09:58:49.128670+0000","last_peered":"2024-05-10T09:58:49.128670+0000","last_clean":"2024-05-10T09:58:49.128670+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:49.128670+0000","last_undegraded":"2024-05-10T09:58:49.128670+0000","last_fullsized":"2024-05-10T09:58:49.128670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:49.128399+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:49.128399+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.128399+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:39.544121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40978,"num_write":52,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.554527+0000","last_change":"2024-05-10T09:58:41.554674+0000","last_active":"2024-05-10T09:58:41.554527+0000","last_peered":"2024-05-10T09:58:41.554527+0000","last_clean":"2024-05-10T09:58:41.554527+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:41.554527+0000","last_undegraded":"2024-05-10T09:58:41.554527+0000","last_fullsized":"2024-05-10T09:58:41.554527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:41.554296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:41.554296+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.554296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:05.539331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'22","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.728359+0000","last_change":"2024-05-10T09:58:26.728434+0000","last_active":"2024-05-10T09:58:26.728359+0000","last_peered":"2024-05-10T09:58:26.728359+0000","last_clean":"2024-05-10T09:58:26.728359+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:26.728359+0000","last_undegraded":"2024-05-10T09:58:26.728359+0000","last_fullsized":"2024-05-10T09:58:26.728359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:26.728132+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:26.728132+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.728132+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.928098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.105498+0000","last_change":"2024-05-10T09:58:20.105557+0000","last_active":"2024-05-10T09:58:20.105498+0000","last_peered":"2024-05-10T09:58:20.105498+0000","last_clean":"2024-05-10T09:58:20.105498+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:20.105498+0000","last_undegraded":"2024-05-10T09:58:20.105498+0000","last_fullsized":"2024-05-10T09:58:20.105498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:20.105310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:20.105310+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.105310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:59.229211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.552151+0000","last_change":"2024-05-10T09:58:38.552151+0000","last_active":"2024-05-10T09:58:38.552151+0000","last_peered":"2024-05-10T09:58:38.552151+0000","last_clean":"2024-05-10T09:58:38.552151+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:38.552151+0000","last_undegraded":"2024-05-10T09:58:38.552151+0000","last_fullsized":"2024-05-10T09:58:38.552151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.551899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.551899+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.551899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:38.912291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'10","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.611974+0000","last_change":"2024-05-10T09:58:48.612048+0000","last_active":"2024-05-10T09:58:48.611974+0000","last_peered":"2024-05-10T09:58:48.611974+0000","last_clean":"2024-05-10T09:58:48.611974+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:48.611974+0000","last_undegraded":"2024-05-10T09:58:48.611974+0000","last_fullsized":"2024-05-10T09:58:48.611974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-05-10T09:58:48.611766+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-05-10T09:58:48.611766+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.611766+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:34.955241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18444,"num_write":30,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.071356+0000","last_change":"2024-05-10T09:58:31.071356+0000","last_active":"2024-05-10T09:58:31.071356+0000","last_peered":"2024-05-10T09:58:31.071356+0000","last_clean":"2024-05-10T09:58:31.071356+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:31.071356+0000","last_undegraded":"2024-05-10T09:58:31.071356+0000","last_fullsized":"2024-05-10T09:58:31.071356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.071107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.071107+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.071107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:10.006971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'32","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.716239+0000","last_change":"2024-05-10T09:58:22.716326+0000","last_active":"2024-05-10T09:58:22.716239+0000","last_peered":"2024-05-10T09:58:22.716239+0000","last_clean":"2024-05-10T09:58:22.716239+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:22.716239+0000","last_undegraded":"2024-05-10T09:58:22.716239+0000","last_fullsized":"2024-05-10T09:58:22.716239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'32","last_scrub_stamp":"2024-05-10T09:58:22.716035+0000","last_deep_scrub":"110'32","last_deep_scrub_stamp":"2024-05-10T09:58:22.716035+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.716035+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:50.706433+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":69,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.390291+0000","last_change":"2024-05-10T09:58:24.390348+0000","last_active":"2024-05-10T09:58:24.390291+0000","last_peered":"2024-05-10T09:58:24.390291+0000","last_clean":"2024-05-10T09:58:24.390291+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:24.390291+0000","last_undegraded":"2024-05-10T09:58:24.390291+0000","last_fullsized":"2024-05-10T09:58:24.390291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.390096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.390096+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.390096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:03.262178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.608033+0000","last_change":"2024-05-10T09:58:21.608055+0000","last_active":"2024-05-10T09:58:21.608033+0000","last_peered":"2024-05-10T09:58:21.608033+0000","last_clean":"2024-05-10T09:58:21.608033+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:21.608033+0000","last_undegraded":"2024-05-10T09:58:21.608033+0000","last_fullsized":"2024-05-10T09:58:21.608033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:21.607964+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:21.607964+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.607964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:19.930647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.079643+0000","last_change":"2024-05-10T09:58:32.079643+0000","last_active":"2024-05-10T09:58:32.079643+0000","last_peered":"2024-05-10T09:58:32.079643+0000","last_clean":"2024-05-10T09:58:32.079643+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:32.079643+0000","last_undegraded":"2024-05-10T09:58:32.079643+0000","last_fullsized":"2024-05-10T09:58:32.079643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.079384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.079384+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.079384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:14.245352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'20","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.456529+0000","last_change":"2024-05-10T09:58:45.456594+0000","last_active":"2024-05-10T09:58:45.456529+0000","last_peered":"2024-05-10T09:58:45.456529+0000","last_clean":"2024-05-10T09:58:45.456529+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:45.456529+0000","last_undegraded":"2024-05-10T09:58:45.456529+0000","last_fullsized":"2024-05-10T09:58:45.456529+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:45.456329+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:45.456329+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.456329+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:25.251726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30726,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"110'2","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.557292+0000","last_change":"2024-05-10T09:58:40.557292+0000","last_active":"2024-05-10T09:58:40.557292+0000","last_peered":"2024-05-10T09:58:40.557292+0000","last_clean":"2024-05-10T09:58:40.557292+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:40.557292+0000","last_undegraded":"2024-05-10T09:58:40.557292+0000","last_fullsized":"2024-05-10T09:58:40.557292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:40.557001+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:40.557001+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.557001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:22.722969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'31","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.675531+0000","last_change":"2024-05-10T09:58:24.675582+0000","last_active":"2024-05-10T09:58:24.675531+0000","last_peered":"2024-05-10T09:58:24.675531+0000","last_clean":"2024-05-10T09:58:24.675531+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:24.675531+0000","last_undegraded":"2024-05-10T09:58:24.675531+0000","last_fullsized":"2024-05-10T09:58:24.675531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'31","last_scrub_stamp":"2024-05-10T09:58:24.675424+0000","last_deep_scrub":"110'31","last_deep_scrub_stamp":"2024-05-10T09:58:24.675424+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.675424+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:27.905528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":63,"num_write":28,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.713237+0000","last_change":"2024-05-10T09:58:28.713292+0000","last_active":"2024-05-10T09:58:28.713237+0000","last_peered":"2024-05-10T09:58:28.713237+0000","last_clean":"2024-05-10T09:58:28.713237+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:28.713237+0000","last_undegraded":"2024-05-10T09:58:28.713237+0000","last_fullsized":"2024-05-10T09:58:28.713237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.713029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.713029+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.713029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:53.020340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.528431+0000","last_change":"2024-05-10T09:58:29.528483+0000","last_active":"2024-05-10T09:58:29.528431+0000","last_peered":"2024-05-10T09:58:29.528431+0000","last_clean":"2024-05-10T09:58:29.528431+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:29.528431+0000","last_undegraded":"2024-05-10T09:58:29.528431+0000","last_fullsized":"2024-05-10T09:58:29.528431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.528245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.528245+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.528245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:54.728210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.735264+0000","last_change":"2024-05-10T09:58:31.735333+0000","last_active":"2024-05-10T09:58:31.735264+0000","last_peered":"2024-05-10T09:58:31.735264+0000","last_clean":"2024-05-10T09:58:31.735264+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:31.735264+0000","last_undegraded":"2024-05-10T09:58:31.735264+0000","last_fullsized":"2024-05-10T09:58:31.735264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-05-10T09:58:31.735058+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-05-10T09:58:31.735058+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.735058+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:21.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"110'12","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.942997+0000","last_change":"2024-05-10T09:58:53.943157+0000","last_active":"2024-05-10T09:58:53.942997+0000","last_peered":"2024-05-10T09:58:53.942997+0000","last_clean":"2024-05-10T09:58:53.942997+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:53.942997+0000","last_undegraded":"2024-05-10T09:58:53.942997+0000","last_fullsized":"2024-05-10T09:58:53.942997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:53.942741+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:53.942741+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.942741+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:11.550170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18438,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.973297+0000","last_change":"2024-05-10T09:58:45.973401+0000","last_active":"2024-05-10T09:58:45.973297+0000","last_peered":"2024-05-10T09:58:45.973297+0000","last_clean":"2024-05-10T09:58:45.973297+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:45.973297+0000","last_undegraded":"2024-05-10T09:58:45.973297+0000","last_fullsized":"2024-05-10T09:58:45.973297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:45.973061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:45.973061+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.973061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:22.508700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'24","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.723424+0000","last_change":"2024-05-10T09:58:28.723424+0000","last_active":"2024-05-10T09:58:28.723424+0000","last_peered":"2024-05-10T09:58:28.723424+0000","last_clean":"2024-05-10T09:58:28.723424+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:28.723424+0000","last_undegraded":"2024-05-10T09:58:28.723424+0000","last_fullsized":"2024-05-10T09:58:28.723424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:28.723147+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:28.723147+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.723147+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:07.659011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":62,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.630755+0000","last_change":"2024-05-10T09:58:30.630755+0000","last_active":"2024-05-10T09:58:30.630755+0000","last_peered":"2024-05-10T09:58:30.630755+0000","last_clean":"2024-05-10T09:58:30.630755+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:30.630755+0000","last_undegraded":"2024-05-10T09:58:30.630755+0000","last_fullsized":"2024-05-10T09:58:30.630755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.630484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.630484+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.630484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:23.219778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.459856+0000","last_change":"2024-05-10T09:58:26.459909+0000","last_active":"2024-05-10T09:58:26.459856+0000","last_peered":"2024-05-10T09:58:26.459856+0000","last_clean":"2024-05-10T09:58:26.459856+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:26.459856+0000","last_undegraded":"2024-05-10T09:58:26.459856+0000","last_fullsized":"2024-05-10T09:58:26.459856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.459654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.459654+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.459654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:24.782336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.470197+0000","last_change":"2024-05-10T09:58:28.470258+0000","last_active":"2024-05-10T09:58:28.470197+0000","last_peered":"2024-05-10T09:58:28.470197+0000","last_clean":"2024-05-10T09:58:28.470197+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:28.470197+0000","last_undegraded":"2024-05-10T09:58:28.470197+0000","last_fullsized":"2024-05-10T09:58:28.470197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:28.469996+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:28.469996+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.469996+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:13:12.438475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'20","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:57.140988+0000","last_change":"2024-05-10T09:58:57.141056+0000","last_active":"2024-05-10T09:58:57.140988+0000","last_peered":"2024-05-10T09:58:57.140988+0000","last_clean":"2024-05-10T09:58:57.140988+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:57.140988+0000","last_undegraded":"2024-05-10T09:58:57.140988+0000","last_fullsized":"2024-05-10T09:58:57.140988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:57.140745+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:57.140745+0000","last_clean_scrub_stamp":"2024-05-10T09:58:57.140745+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:29.926098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.370050+0000","last_change":"2024-05-10T09:58:47.370108+0000","last_active":"2024-05-10T09:58:47.370050+0000","last_peered":"2024-05-10T09:58:47.370050+0000","last_clean":"2024-05-10T09:58:47.370050+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:47.370050+0000","last_undegraded":"2024-05-10T09:58:47.370050+0000","last_fullsized":"2024-05-10T09:58:47.370050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:47.369840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:47.369840+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.369840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:01:54.339387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"110'17","reported_seq":118,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.962139+0000","last_change":"2024-05-10T09:58:48.962213+0000","last_active":"2024-05-10T09:58:48.962139+0000","last_peered":"2024-05-10T09:58:48.962139+0000","last_clean":"2024-05-10T09:58:48.962139+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:48.962139+0000","last_undegraded":"2024-05-10T09:58:48.962139+0000","last_fullsized":"2024-05-10T09:58:48.962139+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'17","last_scrub_stamp":"2024-05-10T09:58:48.961943+0000","last_deep_scrub":"110'17","last_deep_scrub_stamp":"2024-05-10T09:58:48.961943+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.961943+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:32.123870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":858,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'21","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.474153+0000","last_change":"2024-05-10T09:58:46.474153+0000","last_active":"2024-05-10T09:58:46.474153+0000","last_peered":"2024-05-10T09:58:46.474153+0000","last_clean":"2024-05-10T09:58:46.474153+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:46.474153+0000","last_undegraded":"2024-05-10T09:58:46.474153+0000","last_fullsized":"2024-05-10T09:58:46.474153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'21","last_scrub_stamp":"2024-05-10T09:58:46.473899+0000","last_deep_scrub":"110'21","last_deep_scrub_stamp":"2024-05-10T09:58:46.473899+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.473899+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:16.865819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.683081+0000","last_change":"2024-05-10T09:58:23.683137+0000","last_active":"2024-05-10T09:58:23.683081+0000","last_peered":"2024-05-10T09:58:23.683081+0000","last_clean":"2024-05-10T09:58:23.683081+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:23.683081+0000","last_undegraded":"2024-05-10T09:58:23.683081+0000","last_fullsized":"2024-05-10T09:58:23.683081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.682883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.682883+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.682883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:39.213976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":140,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.412673+0000","last_change":"2024-05-10T09:58:46.412731+0000","last_active":"2024-05-10T09:58:46.412673+0000","last_peered":"2024-05-10T09:58:46.412673+0000","last_clean":"2024-05-10T09:58:46.412673+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:46.412673+0000","last_undegraded":"2024-05-10T09:58:46.412673+0000","last_fullsized":"2024-05-10T09:58:46.412673+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:46.412476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:46.412476+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.412476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:45.076722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"110'12","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:59.624188+0000","last_change":"2024-05-10T09:58:59.624254+0000","last_active":"2024-05-10T09:58:59.624188+0000","last_peered":"2024-05-10T09:58:59.624188+0000","last_clean":"2024-05-10T09:58:59.624188+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:59.624188+0000","last_undegraded":"2024-05-10T09:58:59.624188+0000","last_fullsized":"2024-05-10T09:58:59.624188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:59.623976+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:59.623976+0000","last_clean_scrub_stamp":"2024-05-10T09:58:59.623976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:03.304851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":18450,"num_write":42,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.717888+0000","last_change":"2024-05-10T09:58:51.717997+0000","last_active":"2024-05-10T09:58:51.717888+0000","last_peered":"2024-05-10T09:58:51.717888+0000","last_clean":"2024-05-10T09:58:51.717888+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:51.717888+0000","last_undegraded":"2024-05-10T09:58:51.717888+0000","last_fullsized":"2024-05-10T09:58:51.717888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:51.717671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:51.717671+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.717671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:44.320620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'30","reported_seq":221,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.619079+0000","last_change":"2024-05-10T09:58:52.619156+0000","last_active":"2024-05-10T09:58:52.619079+0000","last_peered":"2024-05-10T09:58:52.619079+0000","last_clean":"2024-05-10T09:58:52.619079+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:52.619079+0000","last_undegraded":"2024-05-10T09:58:52.619079+0000","last_fullsized":"2024-05-10T09:58:52.619079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'30","last_scrub_stamp":"2024-05-10T09:58:52.618888+0000","last_deep_scrub":"110'30","last_deep_scrub_stamp":"2024-05-10T09:58:52.618888+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.618888+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:38.962363+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.041935+0000","last_change":"2024-05-10T09:58:22.041957+0000","last_active":"2024-05-10T09:58:22.041935+0000","last_peered":"2024-05-10T09:58:22.041935+0000","last_clean":"2024-05-10T09:58:22.041935+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:22.041935+0000","last_undegraded":"2024-05-10T09:58:22.041935+0000","last_fullsized":"2024-05-10T09:58:22.041935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.041837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.041837+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.041837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:24.798814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.749521+0000","last_change":"2024-05-10T09:58:49.749607+0000","last_active":"2024-05-10T09:58:49.749521+0000","last_peered":"2024-05-10T09:58:49.749521+0000","last_clean":"2024-05-10T09:58:49.749521+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:49.749521+0000","last_undegraded":"2024-05-10T09:58:49.749521+0000","last_fullsized":"2024-05-10T09:58:49.749521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:49.749315+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:49.749315+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.749315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:33.374777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.944727+0000","last_change":"2024-05-10T09:58:51.944788+0000","last_active":"2024-05-10T09:58:51.944727+0000","last_peered":"2024-05-10T09:58:51.944727+0000","last_clean":"2024-05-10T09:58:51.944727+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:51.944727+0000","last_undegraded":"2024-05-10T09:58:51.944727+0000","last_fullsized":"2024-05-10T09:58:51.944727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:51.944530+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:51.944530+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.944530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:10.954153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'16","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:58.656965+0000","last_change":"2024-05-10T09:58:58.657032+0000","last_active":"2024-05-10T09:58:58.656965+0000","last_peered":"2024-05-10T09:58:58.656965+0000","last_clean":"2024-05-10T09:58:58.656965+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:58.656965+0000","last_undegraded":"2024-05-10T09:58:58.656965+0000","last_fullsized":"2024-05-10T09:58:58.656965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:58.656764+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:58.656764+0000","last_clean_scrub_stamp":"2024-05-10T09:58:58.656764+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:31.442117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22534,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.422349+0000","last_change":"2024-05-10T09:58:38.422404+0000","last_active":"2024-05-10T09:58:38.422349+0000","last_peered":"2024-05-10T09:58:38.422349+0000","last_clean":"2024-05-10T09:58:38.422349+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:38.422349+0000","last_undegraded":"2024-05-10T09:58:38.422349+0000","last_fullsized":"2024-05-10T09:58:38.422349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.422156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.422156+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.422156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:10.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'21","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.147381+0000","last_change":"2024-05-10T09:58:37.147550+0000","last_active":"2024-05-10T09:58:37.147381+0000","last_peered":"2024-05-10T09:58:37.147381+0000","last_clean":"2024-05-10T09:58:37.147381+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:37.147381+0000","last_undegraded":"2024-05-10T09:58:37.147381+0000","last_fullsized":"2024-05-10T09:58:37.147381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'21","last_scrub_stamp":"2024-05-10T09:58:37.147106+0000","last_deep_scrub":"110'21","last_deep_scrub_stamp":"2024-05-10T09:58:37.147106+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.147106+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:42.243492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.454339+0000","last_change":"2024-05-10T09:58:24.454466+0000","last_active":"2024-05-10T09:58:24.454339+0000","last_peered":"2024-05-10T09:58:24.454339+0000","last_clean":"2024-05-10T09:58:24.454339+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:24.454339+0000","last_undegraded":"2024-05-10T09:58:24.454339+0000","last_fullsized":"2024-05-10T09:58:24.454339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.454065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.454065+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.454065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:15.614108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.607649+0000","last_change":"2024-05-10T09:58:20.607669+0000","last_active":"2024-05-10T09:58:20.607649+0000","last_peered":"2024-05-10T09:58:20.607649+0000","last_clean":"2024-05-10T09:58:20.607649+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:20.607649+0000","last_undegraded":"2024-05-10T09:58:20.607649+0000","last_fullsized":"2024-05-10T09:58:20.607649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:20.607571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:20.607571+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.607571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:33.762000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.573966+0000","last_change":"2024-05-10T09:58:46.574025+0000","last_active":"2024-05-10T09:58:46.573966+0000","last_peered":"2024-05-10T09:58:46.573966+0000","last_clean":"2024-05-10T09:58:46.573966+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:46.573966+0000","last_undegraded":"2024-05-10T09:58:46.573966+0000","last_fullsized":"2024-05-10T09:58:46.573966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:46.573730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:46.573730+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.573730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:09.903308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'12","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.662352+0000","last_change":"2024-05-10T09:58:52.662514+0000","last_active":"2024-05-10T09:58:52.662352+0000","last_peered":"2024-05-10T09:58:52.662352+0000","last_clean":"2024-05-10T09:58:52.662352+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:52.662352+0000","last_undegraded":"2024-05-10T09:58:52.662352+0000","last_fullsized":"2024-05-10T09:58:52.662352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:52.662123+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:52.662123+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.662123+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:58.046277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.105522+0000","last_change":"2024-05-10T09:58:37.105575+0000","last_active":"2024-05-10T09:58:37.105522+0000","last_peered":"2024-05-10T09:58:37.105522+0000","last_clean":"2024-05-10T09:58:37.105522+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:37.105522+0000","last_undegraded":"2024-05-10T09:58:37.105522+0000","last_fullsized":"2024-05-10T09:58:37.105522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.105327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.105327+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.105327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:57:10.396266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'14","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:55.575243+0000","last_change":"2024-05-10T09:58:55.575404+0000","last_active":"2024-05-10T09:58:55.575243+0000","last_peered":"2024-05-10T09:58:55.575243+0000","last_clean":"2024-05-10T09:58:55.575243+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:55.575243+0000","last_undegraded":"2024-05-10T09:58:55.575243+0000","last_fullsized":"2024-05-10T09:58:55.575243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:55.575001+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:55.575001+0000","last_clean_scrub_stamp":"2024-05-10T09:58:55.575001+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:09.194524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.091628+0000","last_change":"2024-05-10T09:58:32.091683+0000","last_active":"2024-05-10T09:58:32.091628+0000","last_peered":"2024-05-10T09:58:32.091628+0000","last_clean":"2024-05-10T09:58:32.091628+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:32.091628+0000","last_undegraded":"2024-05-10T09:58:32.091628+0000","last_fullsized":"2024-05-10T09:58:32.091628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.091410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.091410+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.091410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:01:06.375141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.686251+0000","last_change":"2024-05-10T09:58:22.686310+0000","last_active":"2024-05-10T09:58:22.686251+0000","last_peered":"2024-05-10T09:58:22.686251+0000","last_clean":"2024-05-10T09:58:22.686251+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:22.686251+0000","last_undegraded":"2024-05-10T09:58:22.686251+0000","last_fullsized":"2024-05-10T09:58:22.686251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.686046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.686046+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.686046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:24.576447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.071568+0000","last_change":"2024-05-10T09:58:42.071627+0000","last_active":"2024-05-10T09:58:42.071568+0000","last_peered":"2024-05-10T09:58:42.071568+0000","last_clean":"2024-05-10T09:58:42.071568+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:42.071568+0000","last_undegraded":"2024-05-10T09:58:42.071568+0000","last_fullsized":"2024-05-10T09:58:42.071568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:42.071324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:42.071324+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.071324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:10.041225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'22","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.132576+0000","last_change":"2024-05-10T09:58:50.132576+0000","last_active":"2024-05-10T09:58:50.132576+0000","last_peered":"2024-05-10T09:58:50.132576+0000","last_clean":"2024-05-10T09:58:50.132576+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:50.132576+0000","last_undegraded":"2024-05-10T09:58:50.132576+0000","last_fullsized":"2024-05-10T09:58:50.132576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:50.132281+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:50.132281+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.132281+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:05:12.617242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"110'2","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.683364+0000","last_change":"2024-05-10T09:58:21.683429+0000","last_active":"2024-05-10T09:58:21.683364+0000","last_peered":"2024-05-10T09:58:21.683364+0000","last_clean":"2024-05-10T09:58:21.683364+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:21.683364+0000","last_undegraded":"2024-05-10T09:58:21.683364+0000","last_fullsized":"2024-05-10T09:58:21.683364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:21.683174+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:21.683174+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.683174+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:30.907539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'22","reported_seq":128,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.985833+0000","last_change":"2024-05-10T09:58:54.986013+0000","last_active":"2024-05-10T09:58:54.985833+0000","last_peered":"2024-05-10T09:58:54.985833+0000","last_clean":"2024-05-10T09:58:54.985833+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:54.985833+0000","last_undegraded":"2024-05-10T09:58:54.985833+0000","last_fullsized":"2024-05-10T09:58:54.985833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:54.985599+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:54.985599+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.985599+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:40.562929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":49,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.042614+0000","last_change":"2024-05-10T09:58:26.042680+0000","last_active":"2024-05-10T09:58:26.042614+0000","last_peered":"2024-05-10T09:58:26.042614+0000","last_clean":"2024-05-10T09:58:26.042614+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:26.042614+0000","last_undegraded":"2024-05-10T09:58:26.042614+0000","last_fullsized":"2024-05-10T09:58:26.042614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.042401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.042401+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.042401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:57.235776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.069925+0000","last_change":"2024-05-10T09:58:31.069979+0000","last_active":"2024-05-10T09:58:31.069925+0000","last_peered":"2024-05-10T09:58:31.069925+0000","last_clean":"2024-05-10T09:58:31.069925+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:31.069925+0000","last_undegraded":"2024-05-10T09:58:31.069925+0000","last_fullsized":"2024-05-10T09:58:31.069925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.069713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.069713+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.069713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:05.240073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.703908+0000","last_change":"2024-05-10T09:58:25.703976+0000","last_active":"2024-05-10T09:58:25.703908+0000","last_peered":"2024-05-10T09:58:25.703908+0000","last_clean":"2024-05-10T09:58:25.703908+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:25.703908+0000","last_undegraded":"2024-05-10T09:58:25.703908+0000","last_fullsized":"2024-05-10T09:58:25.703908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.703686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.703686+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.703686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:42.256271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'16","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.593721+0000","last_change":"2024-05-10T09:58:34.593721+0000","last_active":"2024-05-10T09:58:34.593721+0000","last_peered":"2024-05-10T09:58:34.593721+0000","last_clean":"2024-05-10T09:58:34.593721+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:34.593721+0000","last_undegraded":"2024-05-10T09:58:34.593721+0000","last_fullsized":"2024-05-10T09:58:34.593721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:34.593437+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:34.593437+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.593437+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:05.786811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24588,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.532990+0000","last_change":"2024-05-10T09:58:41.533048+0000","last_active":"2024-05-10T09:58:41.532990+0000","last_peered":"2024-05-10T09:58:41.532990+0000","last_clean":"2024-05-10T09:58:41.532990+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:41.532990+0000","last_undegraded":"2024-05-10T09:58:41.532990+0000","last_fullsized":"2024-05-10T09:58:41.532990+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:41.532788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:41.532788+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.532788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:50:36.865661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.496484+0000","last_change":"2024-05-10T09:58:34.496484+0000","last_active":"2024-05-10T09:58:34.496484+0000","last_peered":"2024-05-10T09:58:34.496484+0000","last_clean":"2024-05-10T09:58:34.496484+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:34.496484+0000","last_undegraded":"2024-05-10T09:58:34.496484+0000","last_fullsized":"2024-05-10T09:58:34.496484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:34.496200+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:34.496200+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.496200+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:47.885674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.476315+0000","last_change":"2024-05-10T09:58:28.476375+0000","last_active":"2024-05-10T09:58:28.476315+0000","last_peered":"2024-05-10T09:58:28.476315+0000","last_clean":"2024-05-10T09:58:28.476315+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:28.476315+0000","last_undegraded":"2024-05-10T09:58:28.476315+0000","last_fullsized":"2024-05-10T09:58:28.476315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'34","last_scrub_stamp":"2024-05-10T09:58:28.476111+0000","last_deep_scrub":"89'34","last_deep_scrub_stamp":"2024-05-10T09:58:28.476111+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.476111+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:17.045359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'12","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.578951+0000","last_change":"2024-05-10T09:58:50.579124+0000","last_active":"2024-05-10T09:58:50.578951+0000","last_peered":"2024-05-10T09:58:50.578951+0000","last_clean":"2024-05-10T09:58:50.578951+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:50.578951+0000","last_undegraded":"2024-05-10T09:58:50.578951+0000","last_fullsized":"2024-05-10T09:58:50.578951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:50.578711+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:50.578711+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.578711+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:40.994433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.720812+0000","last_change":"2024-05-10T09:58:27.720873+0000","last_active":"2024-05-10T09:58:27.720812+0000","last_peered":"2024-05-10T09:58:27.720812+0000","last_clean":"2024-05-10T09:58:27.720812+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:27.720812+0000","last_undegraded":"2024-05-10T09:58:27.720812+0000","last_fullsized":"2024-05-10T09:58:27.720812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.720599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.720599+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.720599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:05.163347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'38","reported_seq":251,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.170829+0000","last_change":"2024-05-10T09:58:43.170829+0000","last_active":"2024-05-10T09:58:43.170829+0000","last_peered":"2024-05-10T09:58:43.170829+0000","last_clean":"2024-05-10T09:58:43.170829+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:43.170829+0000","last_undegraded":"2024-05-10T09:58:43.170829+0000","last_fullsized":"2024-05-10T09:58:43.170829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'38","last_scrub_stamp":"2024-05-10T09:58:43.170697+0000","last_deep_scrub":"110'38","last_deep_scrub_stamp":"2024-05-10T09:58:43.170697+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.170697+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":71692,"num_write":58,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.638091+0000","last_change":"2024-05-10T09:58:42.638091+0000","last_active":"2024-05-10T09:58:42.638091+0000","last_peered":"2024-05-10T09:58:42.638091+0000","last_clean":"2024-05-10T09:58:42.638091+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:42.638091+0000","last_undegraded":"2024-05-10T09:58:42.638091+0000","last_fullsized":"2024-05-10T09:58:42.638091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'12","last_scrub_stamp":"2024-05-10T09:58:42.637726+0000","last_deep_scrub":"75'12","last_deep_scrub_stamp":"2024-05-10T09:58:42.637726+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.637726+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:01.472964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'8","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.450455+0000","last_change":"2024-05-10T09:57:11.244937+0000","last_active":"2024-05-10T09:58:20.450455+0000","last_peered":"2024-05-10T09:58:20.450455+0000","last_clean":"2024-05-10T09:58:20.450455+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:58:20.450455+0000","last_undegraded":"2024-05-10T09:58:20.450455+0000","last_fullsized":"2024-05-10T09:58:20.450455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14342,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.028954+0000","last_change":"2024-05-10T09:58:24.029008+0000","last_active":"2024-05-10T09:58:24.028954+0000","last_peered":"2024-05-10T09:58:24.028954+0000","last_clean":"2024-05-10T09:58:24.028954+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:24.028954+0000","last_undegraded":"2024-05-10T09:58:24.028954+0000","last_fullsized":"2024-05-10T09:58:24.028954+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.028735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.028735+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.028735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:30:00.155236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'16","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.639083+0000","last_change":"2024-05-10T09:58:37.639083+0000","last_active":"2024-05-10T09:58:37.639083+0000","last_peered":"2024-05-10T09:58:37.639083+0000","last_clean":"2024-05-10T09:58:37.639083+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:37.639083+0000","last_undegraded":"2024-05-10T09:58:37.639083+0000","last_fullsized":"2024-05-10T09:58:37.639083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:37.638729+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:37.638729+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.638729+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:44.710395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":30720,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":154,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.476011+0000","last_change":"2024-05-10T09:58:33.476072+0000","last_active":"2024-05-10T09:58:33.476011+0000","last_peered":"2024-05-10T09:58:33.476011+0000","last_clean":"2024-05-10T09:58:33.476011+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:33.476011+0000","last_undegraded":"2024-05-10T09:58:33.476011+0000","last_fullsized":"2024-05-10T09:58:33.476011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.475811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.475811+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.475811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:31.453235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"110'10","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.572560+0000","last_change":"2024-05-10T09:58:32.572560+0000","last_active":"2024-05-10T09:58:32.572560+0000","last_peered":"2024-05-10T09:58:32.572560+0000","last_clean":"2024-05-10T09:58:32.572560+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:32.572560+0000","last_undegraded":"2024-05-10T09:58:32.572560+0000","last_fullsized":"2024-05-10T09:58:32.572560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-05-10T09:58:32.572302+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-05-10T09:58:32.572302+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.572302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:30.894984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.587318+0000","last_change":"2024-05-10T09:58:37.587318+0000","last_active":"2024-05-10T09:58:37.587318+0000","last_peered":"2024-05-10T09:58:37.587318+0000","last_clean":"2024-05-10T09:58:37.587318+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:37.587318+0000","last_undegraded":"2024-05-10T09:58:37.587318+0000","last_fullsized":"2024-05-10T09:58:37.587318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.587062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.587062+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.587062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:10.819139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'20","reported_seq":249,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:59.638284+0000","last_change":"2024-05-10T09:58:59.638284+0000","last_active":"2024-05-10T09:58:59.638284+0000","last_peered":"2024-05-10T09:58:59.638284+0000","last_clean":"2024-05-10T09:58:59.638284+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:59.638284+0000","last_undegraded":"2024-05-10T09:58:59.638284+0000","last_fullsized":"2024-05-10T09:58:59.638284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:59.638025+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:59.638025+0000","last_clean_scrub_stamp":"2024-05-10T09:58:59.638025+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:15.106007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36870,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.123041+0000","last_change":"2024-05-10T09:58:42.123110+0000","last_active":"2024-05-10T09:58:42.123041+0000","last_peered":"2024-05-10T09:58:42.123041+0000","last_clean":"2024-05-10T09:58:42.123041+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:42.123041+0000","last_undegraded":"2024-05-10T09:58:42.123041+0000","last_fullsized":"2024-05-10T09:58:42.123041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:42.122829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:42.122829+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.122829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:47:50.219194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'18","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.535577+0000","last_change":"2024-05-10T09:58:47.535577+0000","last_active":"2024-05-10T09:58:47.535577+0000","last_peered":"2024-05-10T09:58:47.535577+0000","last_clean":"2024-05-10T09:58:47.535577+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:47.535577+0000","last_undegraded":"2024-05-10T09:58:47.535577+0000","last_fullsized":"2024-05-10T09:58:47.535577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:47.535285+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:47.535285+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.535285+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:17.013192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":36870,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.993944+0000","last_change":"2024-05-10T09:58:25.994051+0000","last_active":"2024-05-10T09:58:25.993944+0000","last_peered":"2024-05-10T09:58:25.993944+0000","last_clean":"2024-05-10T09:58:25.993944+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:25.993944+0000","last_undegraded":"2024-05-10T09:58:25.993944+0000","last_fullsized":"2024-05-10T09:58:25.993944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.993717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.993717+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.993717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:27.219541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'24","reported_seq":252,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:15.850900+0000","last_change":"2024-05-10T09:57:10.632367+0000","last_active":"2024-05-10T09:58:15.850900+0000","last_peered":"2024-05-10T09:58:15.850900+0000","last_clean":"2024-05-10T09:58:15.850900+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:58:15.850900+0000","last_undegraded":"2024-05-10T09:58:15.850900+0000","last_fullsized":"2024-05-10T09:58:15.850900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:54:38.590749+0000","last_clean_scrub_stamp":"2024-05-10T09:54:38.590749+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":45080,"num_write":64,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.496560+0000","last_change":"2024-05-10T09:58:27.496620+0000","last_active":"2024-05-10T09:58:27.496560+0000","last_peered":"2024-05-10T09:58:27.496560+0000","last_clean":"2024-05-10T09:58:27.496560+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:27.496560+0000","last_undegraded":"2024-05-10T09:58:27.496560+0000","last_fullsized":"2024-05-10T09:58:27.496560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.496364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.496364+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.496364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:42.146854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'16","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.439190+0000","last_change":"2024-05-10T09:58:41.439256+0000","last_active":"2024-05-10T09:58:41.439190+0000","last_peered":"2024-05-10T09:58:41.439190+0000","last_clean":"2024-05-10T09:58:41.439190+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:41.439190+0000","last_undegraded":"2024-05-10T09:58:41.439190+0000","last_fullsized":"2024-05-10T09:58:41.439190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:41.438979+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:41.438979+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.438979+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:59.818896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.088448+0000","last_change":"2024-05-10T09:58:34.088518+0000","last_active":"2024-05-10T09:58:34.088448+0000","last_peered":"2024-05-10T09:58:34.088448+0000","last_clean":"2024-05-10T09:58:34.088448+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:34.088448+0000","last_undegraded":"2024-05-10T09:58:34.088448+0000","last_fullsized":"2024-05-10T09:58:34.088448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.088162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.088162+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.088162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:44.874236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'16","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.167049+0000","last_change":"2024-05-10T09:58:48.167115+0000","last_active":"2024-05-10T09:58:48.167049+0000","last_peered":"2024-05-10T09:58:48.167049+0000","last_clean":"2024-05-10T09:58:48.167049+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:48.167049+0000","last_undegraded":"2024-05-10T09:58:48.167049+0000","last_fullsized":"2024-05-10T09:58:48.167049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:48.166818+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:48.166818+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.166818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:19.554420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.788251+0000","last_change":"2024-05-10T09:58:37.788309+0000","last_active":"2024-05-10T09:58:37.788251+0000","last_peered":"2024-05-10T09:58:37.788251+0000","last_clean":"2024-05-10T09:58:37.788251+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:37.788251+0000","last_undegraded":"2024-05-10T09:58:37.788251+0000","last_fullsized":"2024-05-10T09:58:37.788251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.788055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.788055+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.788055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:19.954023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'22","reported_seq":253,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.494233+0000","last_change":"2024-05-10T09:58:45.494296+0000","last_active":"2024-05-10T09:58:45.494233+0000","last_peered":"2024-05-10T09:58:45.494233+0000","last_clean":"2024-05-10T09:58:45.494233+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:45.494233+0000","last_undegraded":"2024-05-10T09:58:45.494233+0000","last_fullsized":"2024-05-10T09:58:45.494233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:45.494047+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:45.494047+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.494047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:50.590433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":36880,"num_write":52,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.025637+0000","last_change":"2024-05-10T09:58:27.025701+0000","last_active":"2024-05-10T09:58:27.025637+0000","last_peered":"2024-05-10T09:58:27.025637+0000","last_clean":"2024-05-10T09:58:27.025637+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:27.025637+0000","last_undegraded":"2024-05-10T09:58:27.025637+0000","last_fullsized":"2024-05-10T09:58:27.025637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-05-10T09:58:27.025433+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-05-10T09:58:27.025433+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.025433+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:13.163122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"110'20","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.685383+0000","last_change":"2024-05-10T09:58:44.685446+0000","last_active":"2024-05-10T09:58:44.685383+0000","last_peered":"2024-05-10T09:58:44.685383+0000","last_clean":"2024-05-10T09:58:44.685383+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:44.685383+0000","last_undegraded":"2024-05-10T09:58:44.685383+0000","last_fullsized":"2024-05-10T09:58:44.685383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:44.685186+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:44.685186+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.685186+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:54.649061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":34834,"num_write":50,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.580891+0000","last_change":"2024-05-10T09:58:44.580951+0000","last_active":"2024-05-10T09:58:44.580891+0000","last_peered":"2024-05-10T09:58:44.580891+0000","last_clean":"2024-05-10T09:58:44.580891+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:44.580891+0000","last_undegraded":"2024-05-10T09:58:44.580891+0000","last_fullsized":"2024-05-10T09:58:44.580891+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:44.580684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:44.580684+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.580684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:26.783285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'18","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.501496+0000","last_change":"2024-05-10T09:58:24.501561+0000","last_active":"2024-05-10T09:58:24.501496+0000","last_peered":"2024-05-10T09:58:24.501496+0000","last_clean":"2024-05-10T09:58:24.501496+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:24.501496+0000","last_undegraded":"2024-05-10T09:58:24.501496+0000","last_fullsized":"2024-05-10T09:58:24.501496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.501285+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.501285+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.501285+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:14.059384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36864,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.753115+0000","last_change":"2024-05-10T09:58:35.753173+0000","last_active":"2024-05-10T09:58:35.753115+0000","last_peered":"2024-05-10T09:58:35.753115+0000","last_clean":"2024-05-10T09:58:35.753115+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:35.753115+0000","last_undegraded":"2024-05-10T09:58:35.753115+0000","last_fullsized":"2024-05-10T09:58:35.753115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.752877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.752877+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.752877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:36.113270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'22","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.578018+0000","last_change":"2024-05-10T09:58:48.578097+0000","last_active":"2024-05-10T09:58:48.578018+0000","last_peered":"2024-05-10T09:58:48.578018+0000","last_clean":"2024-05-10T09:58:48.578018+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:48.578018+0000","last_undegraded":"2024-05-10T09:58:48.578018+0000","last_fullsized":"2024-05-10T09:58:48.578018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:48.577773+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:48.577773+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.577773+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:43.845703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":36882,"num_write":52,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"110'16","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.551046+0000","last_change":"2024-05-10T09:58:49.551105+0000","last_active":"2024-05-10T09:58:49.551046+0000","last_peered":"2024-05-10T09:58:49.551046+0000","last_clean":"2024-05-10T09:58:49.551046+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:49.551046+0000","last_undegraded":"2024-05-10T09:58:49.551046+0000","last_fullsized":"2024-05-10T09:58:49.551046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:49.550848+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:49.550848+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.550848+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:20.938450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.125433+0000","last_change":"2024-05-10T09:58:40.125488+0000","last_active":"2024-05-10T09:58:40.125433+0000","last_peered":"2024-05-10T09:58:40.125433+0000","last_clean":"2024-05-10T09:58:40.125433+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:40.125433+0000","last_undegraded":"2024-05-10T09:58:40.125433+0000","last_fullsized":"2024-05-10T09:58:40.125433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.125229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.125229+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.125229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.505146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'16","reported_seq":240,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.431130+0000","last_change":"2024-05-10T09:58:49.431201+0000","last_active":"2024-05-10T09:58:49.431130+0000","last_peered":"2024-05-10T09:58:49.431130+0000","last_clean":"2024-05-10T09:58:49.431130+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:49.431130+0000","last_undegraded":"2024-05-10T09:58:49.431130+0000","last_fullsized":"2024-05-10T09:58:49.431130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:49.430903+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:49.430903+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.430903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:03:42.449981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24582,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.378615+0000","last_change":"2024-05-10T09:58:33.378667+0000","last_active":"2024-05-10T09:58:33.378615+0000","last_peered":"2024-05-10T09:58:33.378615+0000","last_clean":"2024-05-10T09:58:33.378615+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:33.378615+0000","last_undegraded":"2024-05-10T09:58:33.378615+0000","last_fullsized":"2024-05-10T09:58:33.378615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.378427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.378427+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.378427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:07.970531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1213,"num_read_kb":1594,"num_write":779,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":858,"ondisk_log_size":858,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1522,"num_read_kb":2003600,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1949696,"data_stored":1353311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1339392,"data_stored":763712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1376256,"data_stored":763111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285592,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1292,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1323008,"data_stored":762774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1347584,"data_stored":762679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509499,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1318912,"data_stored":761845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37224,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1933312,"data_stored":1353153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542204,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1347584,"data_stored":762533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:59:03.623 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-10T09:54:46.655823+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:59:03.624 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:59:03.624 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-10T09:54:38.590749+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=54, tm_sec=38, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=9, tm_min=58, tm_sec=17, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T09:59:03.625 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T09:59:23.626 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T09:59:23.988 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-10T09:59:23.994 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-10T09:59:24.012 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-05-10T09:59:22.306178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723235,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":4543,"num_read_kb":2006570,"num_write":3838,"num_write_kb":2050326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":478162101,"num_keys_recovered":46,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2700,"ondisk_log_size":2700,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282440,"kb_used_data":11656,"kb_used_omap":16,"kb_used_meta":270703,"kb_avail":754692280,"statfs":{"total":773094113280,"available":772804894720,"internally_reserved":0,"allocated":11935744,"data_stored":7283118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17138,"internal_metadata":277200142},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006840"},"pg_stats":[{"pgid":"3.3f","version":"110'20","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.649888+0000","last_change":"2024-05-10T09:58:46.649888+0000","last_active":"2024-05-10T09:58:46.649888+0000","last_peered":"2024-05-10T09:58:46.649888+0000","last_clean":"2024-05-10T09:58:46.649888+0000","last_became_active":"2024-05-10T09:54:39.653609+0000","last_became_peered":"2024-05-10T09:54:39.653609+0000","last_unstale":"2024-05-10T09:58:46.649888+0000","last_undegraded":"2024-05-10T09:58:46.649888+0000","last_fullsized":"2024-05-10T09:58:46.649888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:46.649632+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:46.649632+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.649632+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:51.167238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":40,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:55.646806+0000","last_change":"2024-05-10T09:58:55.646867+0000","last_active":"2024-05-10T09:58:55.646806+0000","last_peered":"2024-05-10T09:58:55.646806+0000","last_clean":"2024-05-10T09:58:55.646806+0000","last_became_active":"2024-05-10T09:57:09.650318+0000","last_became_peered":"2024-05-10T09:57:09.650318+0000","last_unstale":"2024-05-10T09:58:55.646806+0000","last_undegraded":"2024-05-10T09:58:55.646806+0000","last_fullsized":"2024-05-10T09:58:55.646806+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:55.646589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:55.646589+0000","last_clean_scrub_stamp":"2024-05-10T09:58:55.646589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:19.231627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"110'16","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.559145+0000","last_change":"2024-05-10T09:58:39.559145+0000","last_active":"2024-05-10T09:58:39.559145+0000","last_peered":"2024-05-10T09:58:39.559145+0000","last_clean":"2024-05-10T09:58:39.559145+0000","last_became_active":"2024-05-10T09:54:39.635640+0000","last_became_peered":"2024-05-10T09:54:39.635640+0000","last_unstale":"2024-05-10T09:58:39.559145+0000","last_undegraded":"2024-05-10T09:58:39.559145+0000","last_fullsized":"2024-05-10T09:58:39.559145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:39.558841+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:39.558841+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.558841+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:43.069821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"89'32","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.737000+0000","last_change":"2024-05-10T09:58:33.737064+0000","last_active":"2024-05-10T09:58:33.737000+0000","last_peered":"2024-05-10T09:58:33.737000+0000","last_clean":"2024-05-10T09:58:33.737000+0000","last_became_active":"2024-05-10T09:54:41.678837+0000","last_became_peered":"2024-05-10T09:54:41.678837+0000","last_unstale":"2024-05-10T09:58:33.737000+0000","last_undegraded":"2024-05-10T09:58:33.737000+0000","last_fullsized":"2024-05-10T09:58:33.737000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'32","last_scrub_stamp":"2024-05-10T09:58:33.736797+0000","last_deep_scrub":"89'32","last_deep_scrub_stamp":"2024-05-10T09:58:33.736797+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.736797+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:05.981545+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":81,"num_write":46,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"110'14","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.145725+0000","last_change":"2024-05-10T09:58:44.145725+0000","last_active":"2024-05-10T09:58:44.145725+0000","last_peered":"2024-05-10T09:58:44.145725+0000","last_clean":"2024-05-10T09:58:44.145725+0000","last_became_active":"2024-05-10T09:54:39.627703+0000","last_became_peered":"2024-05-10T09:54:39.627703+0000","last_unstale":"2024-05-10T09:58:44.145725+0000","last_undegraded":"2024-05-10T09:58:44.145725+0000","last_fullsized":"2024-05-10T09:58:44.145725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:44.145467+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:44.145467+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.145467+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:54.582468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":28690,"num_write":44,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.060961+0000","last_change":"2024-05-10T09:58:40.061013+0000","last_active":"2024-05-10T09:58:40.060961+0000","last_peered":"2024-05-10T09:58:40.060961+0000","last_clean":"2024-05-10T09:58:40.060961+0000","last_became_active":"2024-05-10T09:57:09.631591+0000","last_became_peered":"2024-05-10T09:57:09.631591+0000","last_unstale":"2024-05-10T09:58:40.060961+0000","last_undegraded":"2024-05-10T09:58:40.060961+0000","last_fullsized":"2024-05-10T09:58:40.060961+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.060758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.060758+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.060758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:42:43.844732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"110'16","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.440609+0000","last_change":"2024-05-10T09:58:43.440671+0000","last_active":"2024-05-10T09:58:43.440609+0000","last_peered":"2024-05-10T09:58:43.440609+0000","last_clean":"2024-05-10T09:58:43.440609+0000","last_became_active":"2024-05-10T09:54:39.664794+0000","last_became_peered":"2024-05-10T09:54:39.664794+0000","last_unstale":"2024-05-10T09:58:43.440609+0000","last_undegraded":"2024-05-10T09:58:43.440609+0000","last_fullsized":"2024-05-10T09:58:43.440609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:43.440411+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:43.440411+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.440411+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:53.984112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32792,"num_write":56,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.106220+0000","last_change":"2024-05-10T09:58:36.106341+0000","last_active":"2024-05-10T09:58:36.106220+0000","last_peered":"2024-05-10T09:58:36.106220+0000","last_clean":"2024-05-10T09:58:36.106220+0000","last_became_active":"2024-05-10T09:54:41.657047+0000","last_became_peered":"2024-05-10T09:54:41.657047+0000","last_unstale":"2024-05-10T09:58:36.106220+0000","last_undegraded":"2024-05-10T09:58:36.106220+0000","last_fullsized":"2024-05-10T09:58:36.106220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.105962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.105962+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.105962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:28.047939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"110'24","reported_seq":232,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.691228+0000","last_change":"2024-05-10T09:58:43.691290+0000","last_active":"2024-05-10T09:58:43.691228+0000","last_peered":"2024-05-10T09:58:43.691228+0000","last_clean":"2024-05-10T09:58:43.691228+0000","last_became_active":"2024-05-10T09:54:39.635959+0000","last_became_peered":"2024-05-10T09:54:39.635959+0000","last_unstale":"2024-05-10T09:58:43.691228+0000","last_undegraded":"2024-05-10T09:58:43.691228+0000","last_fullsized":"2024-05-10T09:58:43.691228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:43.691041+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:43.691041+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.691041+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:14.082962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":43032,"num_write":64,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.544696+0000","last_change":"2024-05-10T09:58:36.544696+0000","last_active":"2024-05-10T09:58:36.544696+0000","last_peered":"2024-05-10T09:58:36.544696+0000","last_clean":"2024-05-10T09:58:36.544696+0000","last_became_active":"2024-05-10T09:54:41.654915+0000","last_became_peered":"2024-05-10T09:54:41.654915+0000","last_unstale":"2024-05-10T09:58:36.544696+0000","last_undegraded":"2024-05-10T09:58:36.544696+0000","last_fullsized":"2024-05-10T09:58:36.544696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.544306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.544306+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.544306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:08.789054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"110'18","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.397600+0000","last_change":"2024-05-10T09:58:39.397763+0000","last_active":"2024-05-10T09:58:39.397600+0000","last_peered":"2024-05-10T09:58:39.397600+0000","last_clean":"2024-05-10T09:58:39.397600+0000","last_became_active":"2024-05-10T09:54:39.665288+0000","last_became_peered":"2024-05-10T09:54:39.665288+0000","last_unstale":"2024-05-10T09:58:39.397600+0000","last_undegraded":"2024-05-10T09:58:39.397600+0000","last_fullsized":"2024-05-10T09:58:39.397600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:39.397381+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:39.397381+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.397381+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:23:14.181483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":36876,"num_write":38,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"75'6","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.985922+0000","last_change":"2024-05-10T09:58:47.985922+0000","last_active":"2024-05-10T09:58:47.985922+0000","last_peered":"2024-05-10T09:58:47.985922+0000","last_clean":"2024-05-10T09:58:47.985922+0000","last_became_active":"2024-05-10T09:57:09.640245+0000","last_became_peered":"2024-05-10T09:57:09.640245+0000","last_unstale":"2024-05-10T09:58:47.985922+0000","last_undegraded":"2024-05-10T09:58:47.985922+0000","last_fullsized":"2024-05-10T09:58:47.985922+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:47.985655+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:47.985655+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.985655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:20.951714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"110'8","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.488851+0000","last_change":"2024-05-10T09:58:35.488913+0000","last_active":"2024-05-10T09:58:35.488851+0000","last_peered":"2024-05-10T09:58:35.488851+0000","last_clean":"2024-05-10T09:58:35.488851+0000","last_became_active":"2024-05-10T09:55:19.415632+0000","last_became_peered":"2024-05-10T09:55:19.415632+0000","last_unstale":"2024-05-10T09:58:35.488851+0000","last_undegraded":"2024-05-10T09:58:35.488851+0000","last_fullsized":"2024-05-10T09:58:35.488851+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'8","last_scrub_stamp":"2024-05-10T09:58:35.488651+0000","last_deep_scrub":"110'8","last_deep_scrub_stamp":"2024-05-10T09:58:35.488651+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.488651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:50.432986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.418697+0000","last_change":"2024-05-10T09:58:31.418697+0000","last_active":"2024-05-10T09:58:31.418697+0000","last_peered":"2024-05-10T09:58:31.418697+0000","last_clean":"2024-05-10T09:58:31.418697+0000","last_became_active":"2024-05-10T09:56:20.303502+0000","last_became_peered":"2024-05-10T09:56:20.303502+0000","last_unstale":"2024-05-10T09:58:31.418697+0000","last_undegraded":"2024-05-10T09:58:31.418697+0000","last_fullsized":"2024-05-10T09:58:31.418697+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.418452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.418452+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.418452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:23:54.823224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"110'12","reported_seq":209,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.631816+0000","last_change":"2024-05-10T09:58:53.631977+0000","last_active":"2024-05-10T09:58:53.631816+0000","last_peered":"2024-05-10T09:58:53.631816+0000","last_clean":"2024-05-10T09:58:53.631816+0000","last_became_active":"2024-05-10T09:54:39.663677+0000","last_became_peered":"2024-05-10T09:54:39.663677+0000","last_unstale":"2024-05-10T09:58:53.631816+0000","last_undegraded":"2024-05-10T09:58:53.631816+0000","last_fullsized":"2024-05-10T09:58:53.631816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:53.631517+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:53.631517+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.631517+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:40:35.129145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.454471+0000","last_change":"2024-05-10T09:58:25.454471+0000","last_active":"2024-05-10T09:58:25.454471+0000","last_peered":"2024-05-10T09:58:25.454471+0000","last_clean":"2024-05-10T09:58:25.454471+0000","last_became_active":"2024-05-10T09:54:41.642113+0000","last_became_peered":"2024-05-10T09:54:41.642113+0000","last_unstale":"2024-05-10T09:58:25.454471+0000","last_undegraded":"2024-05-10T09:58:25.454471+0000","last_fullsized":"2024-05-10T09:58:25.454471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.454208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.454208+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.454208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:38.690662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.006325+0000","last_change":"2024-05-10T09:58:45.006424+0000","last_active":"2024-05-10T09:58:45.006325+0000","last_peered":"2024-05-10T09:58:45.006325+0000","last_clean":"2024-05-10T09:58:45.006325+0000","last_became_active":"2024-05-10T09:57:09.641252+0000","last_became_peered":"2024-05-10T09:57:09.641252+0000","last_unstale":"2024-05-10T09:58:45.006325+0000","last_undegraded":"2024-05-10T09:58:45.006325+0000","last_fullsized":"2024-05-10T09:58:45.006325+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:45.005979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:45.005979+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.005979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:29.330451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"110'12","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.731448+0000","last_change":"2024-05-10T09:58:39.731579+0000","last_active":"2024-05-10T09:58:39.731448+0000","last_peered":"2024-05-10T09:58:39.731448+0000","last_clean":"2024-05-10T09:58:39.731448+0000","last_became_active":"2024-05-10T09:54:39.665992+0000","last_became_peered":"2024-05-10T09:54:39.665992+0000","last_unstale":"2024-05-10T09:58:39.731448+0000","last_undegraded":"2024-05-10T09:58:39.731448+0000","last_fullsized":"2024-05-10T09:58:39.731448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:39.731164+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:39.731164+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.731164+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:29.497714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.746367+0000","last_change":"2024-05-10T09:58:31.746420+0000","last_active":"2024-05-10T09:58:31.746367+0000","last_peered":"2024-05-10T09:58:31.746367+0000","last_clean":"2024-05-10T09:58:31.746367+0000","last_became_active":"2024-05-10T09:54:41.679634+0000","last_became_peered":"2024-05-10T09:54:41.679634+0000","last_unstale":"2024-05-10T09:58:31.746367+0000","last_undegraded":"2024-05-10T09:58:31.746367+0000","last_fullsized":"2024-05-10T09:58:31.746367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.746174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.746174+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.746174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:02.939549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"110'12","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.524565+0000","last_change":"2024-05-10T09:58:39.524692+0000","last_active":"2024-05-10T09:58:39.524565+0000","last_peered":"2024-05-10T09:58:39.524565+0000","last_clean":"2024-05-10T09:58:39.524565+0000","last_became_active":"2024-05-10T09:55:19.367877+0000","last_became_peered":"2024-05-10T09:55:19.367877+0000","last_unstale":"2024-05-10T09:58:39.524565+0000","last_undegraded":"2024-05-10T09:58:39.524565+0000","last_fullsized":"2024-05-10T09:58:39.524565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:39.524324+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:39.524324+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.524324+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:18.460188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"89'34","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.370826+0000","last_change":"2024-05-10T09:58:35.370887+0000","last_active":"2024-05-10T09:58:35.370826+0000","last_peered":"2024-05-10T09:58:35.370826+0000","last_clean":"2024-05-10T09:58:35.370826+0000","last_became_active":"2024-05-10T09:54:41.657934+0000","last_became_peered":"2024-05-10T09:54:41.657934+0000","last_unstale":"2024-05-10T09:58:35.370826+0000","last_undegraded":"2024-05-10T09:58:35.370826+0000","last_fullsized":"2024-05-10T09:58:35.370826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'34","last_scrub_stamp":"2024-05-10T09:58:35.370626+0000","last_deep_scrub":"89'34","last_deep_scrub_stamp":"2024-05-10T09:58:35.370626+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.370626+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:38.035607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"110'10","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.548047+0000","last_change":"2024-05-10T09:58:35.548111+0000","last_active":"2024-05-10T09:58:35.548047+0000","last_peered":"2024-05-10T09:58:35.548047+0000","last_clean":"2024-05-10T09:58:35.548047+0000","last_became_active":"2024-05-10T09:54:39.665965+0000","last_became_peered":"2024-05-10T09:54:39.665965+0000","last_unstale":"2024-05-10T09:58:35.548047+0000","last_undegraded":"2024-05-10T09:58:35.548047+0000","last_fullsized":"2024-05-10T09:58:35.548047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-05-10T09:58:35.547851+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-05-10T09:58:35.547851+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.547851+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:21.685540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.500980+0000","last_change":"2024-05-10T09:58:26.501035+0000","last_active":"2024-05-10T09:58:26.500980+0000","last_peered":"2024-05-10T09:58:26.500980+0000","last_clean":"2024-05-10T09:58:26.500980+0000","last_became_active":"2024-05-10T09:54:41.643874+0000","last_became_peered":"2024-05-10T09:54:41.643874+0000","last_unstale":"2024-05-10T09:58:26.500980+0000","last_undegraded":"2024-05-10T09:58:26.500980+0000","last_fullsized":"2024-05-10T09:58:26.500980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.500752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.500752+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.500752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:44:14.199743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"110'34","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.983537+0000","last_change":"2024-05-10T09:58:52.983601+0000","last_active":"2024-05-10T09:58:52.983537+0000","last_peered":"2024-05-10T09:58:52.983537+0000","last_clean":"2024-05-10T09:58:52.983537+0000","last_became_active":"2024-05-10T09:57:09.654981+0000","last_became_peered":"2024-05-10T09:57:09.654981+0000","last_unstale":"2024-05-10T09:58:52.983537+0000","last_undegraded":"2024-05-10T09:58:52.983537+0000","last_fullsized":"2024-05-10T09:58:52.983537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'34","last_scrub_stamp":"2024-05-10T09:58:52.983318+0000","last_deep_scrub":"110'34","last_deep_scrub_stamp":"2024-05-10T09:58:52.983318+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.983318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:32:49.685708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":61452,"num_write":54,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"89'38","reported_seq":240,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.440776+0000","last_change":"2024-05-10T09:58:38.440840+0000","last_active":"2024-05-10T09:58:38.440776+0000","last_peered":"2024-05-10T09:58:38.440776+0000","last_clean":"2024-05-10T09:58:38.440776+0000","last_became_active":"2024-05-10T09:57:09.634767+0000","last_became_peered":"2024-05-10T09:57:09.634767+0000","last_unstale":"2024-05-10T09:58:38.440776+0000","last_undegraded":"2024-05-10T09:58:38.440776+0000","last_fullsized":"2024-05-10T09:58:38.440776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:38.440564+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:38.440564+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.440564+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:26:05.058211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"110'8","reported_seq":205,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.637556+0000","last_change":"2024-05-10T09:58:50.637621+0000","last_active":"2024-05-10T09:58:50.637556+0000","last_peered":"2024-05-10T09:58:50.637556+0000","last_clean":"2024-05-10T09:58:50.637556+0000","last_became_active":"2024-05-10T09:54:39.629642+0000","last_became_peered":"2024-05-10T09:54:39.629642+0000","last_unstale":"2024-05-10T09:58:50.637556+0000","last_undegraded":"2024-05-10T09:58:50.637556+0000","last_fullsized":"2024-05-10T09:58:50.637556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'8","last_scrub_stamp":"2024-05-10T09:58:50.637360+0000","last_deep_scrub":"110'8","last_deep_scrub_stamp":"2024-05-10T09:58:50.637360+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.637360+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:38.370801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16396,"num_write":28,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.084199+0000","last_change":"2024-05-10T09:58:43.084254+0000","last_active":"2024-05-10T09:58:43.084199+0000","last_peered":"2024-05-10T09:58:43.084199+0000","last_clean":"2024-05-10T09:58:43.084199+0000","last_became_active":"2024-05-10T09:57:09.643160+0000","last_became_peered":"2024-05-10T09:57:09.643160+0000","last_unstale":"2024-05-10T09:58:43.084199+0000","last_undegraded":"2024-05-10T09:58:43.084199+0000","last_fullsized":"2024-05-10T09:58:43.084199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:43.083992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:43.083992+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.083992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:05:34.681583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"110'18","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.175280+0000","last_change":"2024-05-10T09:58:46.175280+0000","last_active":"2024-05-10T09:58:46.175280+0000","last_peered":"2024-05-10T09:58:46.175280+0000","last_clean":"2024-05-10T09:58:46.175280+0000","last_became_active":"2024-05-10T09:54:39.635752+0000","last_became_peered":"2024-05-10T09:54:39.635752+0000","last_unstale":"2024-05-10T09:58:46.175280+0000","last_undegraded":"2024-05-10T09:58:46.175280+0000","last_fullsized":"2024-05-10T09:58:46.175280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:46.174985+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:46.174985+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.174985+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:15.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":30720,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.998074+0000","last_change":"2024-05-10T09:58:46.998163+0000","last_active":"2024-05-10T09:58:46.998074+0000","last_peered":"2024-05-10T09:58:46.998074+0000","last_clean":"2024-05-10T09:58:46.998074+0000","last_became_active":"2024-05-10T09:57:09.642732+0000","last_became_peered":"2024-05-10T09:57:09.642732+0000","last_unstale":"2024-05-10T09:58:46.998074+0000","last_undegraded":"2024-05-10T09:58:46.998074+0000","last_fullsized":"2024-05-10T09:58:46.998074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:46.997843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:46.997843+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.997843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:16:05.647702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.688936+0000","last_change":"2024-05-10T09:58:32.688993+0000","last_active":"2024-05-10T09:58:32.688936+0000","last_peered":"2024-05-10T09:58:32.688936+0000","last_clean":"2024-05-10T09:58:32.688936+0000","last_became_active":"2024-05-10T09:54:41.676041+0000","last_became_peered":"2024-05-10T09:54:41.676041+0000","last_unstale":"2024-05-10T09:58:32.688936+0000","last_undegraded":"2024-05-10T09:58:32.688936+0000","last_fullsized":"2024-05-10T09:58:32.688936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.688703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.688703+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.688703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:51.398393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"110'16","reported_seq":244,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.739796+0000","last_change":"2024-05-10T09:58:52.739796+0000","last_active":"2024-05-10T09:58:52.739796+0000","last_peered":"2024-05-10T09:58:52.739796+0000","last_clean":"2024-05-10T09:58:52.739796+0000","last_became_active":"2024-05-10T09:57:09.644405+0000","last_became_peered":"2024-05-10T09:57:09.644405+0000","last_unstale":"2024-05-10T09:58:52.739796+0000","last_undegraded":"2024-05-10T09:58:52.739796+0000","last_fullsized":"2024-05-10T09:58:52.739796+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:52.739538+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:52.739538+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.739538+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:34.942139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":18442,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.421152+0000","last_change":"2024-05-10T09:58:36.421282+0000","last_active":"2024-05-10T09:58:36.421152+0000","last_peered":"2024-05-10T09:58:36.421152+0000","last_clean":"2024-05-10T09:58:36.421152+0000","last_became_active":"2024-05-10T09:54:43.669056+0000","last_became_peered":"2024-05-10T09:54:43.669056+0000","last_unstale":"2024-05-10T09:58:36.421152+0000","last_undegraded":"2024-05-10T09:58:36.421152+0000","last_fullsized":"2024-05-10T09:58:36.421152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.420867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.420867+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.420867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:25.605867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"110'21","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.169722+0000","last_change":"2024-05-10T09:58:41.169894+0000","last_active":"2024-05-10T09:58:41.169722+0000","last_peered":"2024-05-10T09:58:41.169722+0000","last_clean":"2024-05-10T09:58:41.169722+0000","last_became_active":"2024-05-10T09:54:45.686822+0000","last_became_peered":"2024-05-10T09:54:45.686822+0000","last_unstale":"2024-05-10T09:58:41.169722+0000","last_undegraded":"2024-05-10T09:58:41.169722+0000","last_fullsized":"2024-05-10T09:58:41.169722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'21","last_scrub_stamp":"2024-05-10T09:58:41.169482+0000","last_deep_scrub":"110'21","last_deep_scrub_stamp":"2024-05-10T09:58:41.169482+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.169482+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:45.687088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":20,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.705012+0000","last_change":"2024-05-10T09:58:34.705073+0000","last_active":"2024-05-10T09:58:34.705012+0000","last_peered":"2024-05-10T09:58:34.705012+0000","last_clean":"2024-05-10T09:58:34.705012+0000","last_became_active":"2024-05-10T09:54:47.702435+0000","last_became_peered":"2024-05-10T09:54:47.702435+0000","last_unstale":"2024-05-10T09:58:34.705012+0000","last_undegraded":"2024-05-10T09:58:34.705012+0000","last_fullsized":"2024-05-10T09:58:34.705012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.704808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.704808+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.704808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:07.936885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:56.630199+0000","last_change":"2024-05-10T09:58:56.630259+0000","last_active":"2024-05-10T09:58:56.630199+0000","last_peered":"2024-05-10T09:58:56.630199+0000","last_clean":"2024-05-10T09:58:56.630199+0000","last_became_active":"2024-05-10T09:57:09.650725+0000","last_became_peered":"2024-05-10T09:57:09.650725+0000","last_unstale":"2024-05-10T09:58:56.630199+0000","last_undegraded":"2024-05-10T09:58:56.630199+0000","last_fullsized":"2024-05-10T09:58:56.630199+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:56.629992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:56.629992+0000","last_clean_scrub_stamp":"2024-05-10T09:58:56.629992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:28.311396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.439959+0000","last_change":"2024-05-10T09:58:29.440013+0000","last_active":"2024-05-10T09:58:29.439959+0000","last_peered":"2024-05-10T09:58:29.439959+0000","last_clean":"2024-05-10T09:58:29.439959+0000","last_became_active":"2024-05-10T09:54:41.672911+0000","last_became_peered":"2024-05-10T09:54:41.672911+0000","last_unstale":"2024-05-10T09:58:29.439959+0000","last_undegraded":"2024-05-10T09:58:29.439959+0000","last_fullsized":"2024-05-10T09:58:29.439959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.439758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.439758+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.439758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:15.577447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"110'18","reported_seq":221,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.178476+0000","last_change":"2024-05-10T09:58:45.178476+0000","last_active":"2024-05-10T09:58:45.178476+0000","last_peered":"2024-05-10T09:58:45.178476+0000","last_clean":"2024-05-10T09:58:45.178476+0000","last_became_active":"2024-05-10T09:54:39.629871+0000","last_became_peered":"2024-05-10T09:54:39.629871+0000","last_unstale":"2024-05-10T09:58:45.178476+0000","last_undegraded":"2024-05-10T09:58:45.178476+0000","last_fullsized":"2024-05-10T09:58:45.178476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:45.178217+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:45.178217+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.178217+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:03.395783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.689999+0000","last_change":"2024-05-10T09:58:33.690132+0000","last_active":"2024-05-10T09:58:33.689999+0000","last_peered":"2024-05-10T09:58:33.689999+0000","last_clean":"2024-05-10T09:58:33.689999+0000","last_became_active":"2024-05-10T09:54:43.653562+0000","last_became_peered":"2024-05-10T09:54:43.653562+0000","last_unstale":"2024-05-10T09:58:33.689999+0000","last_undegraded":"2024-05-10T09:58:33.689999+0000","last_fullsized":"2024-05-10T09:58:33.689999+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.689780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.689780+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.689780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:25.631757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"110'9","reported_seq":105,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.053551+0000","last_change":"2024-05-10T09:58:44.053620+0000","last_active":"2024-05-10T09:58:44.053551+0000","last_peered":"2024-05-10T09:58:44.053551+0000","last_clean":"2024-05-10T09:58:44.053551+0000","last_became_active":"2024-05-10T09:57:09.643244+0000","last_became_peered":"2024-05-10T09:57:09.643244+0000","last_unstale":"2024-05-10T09:58:44.053551+0000","last_undegraded":"2024-05-10T09:58:44.053551+0000","last_fullsized":"2024-05-10T09:58:44.053551+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'9","last_scrub_stamp":"2024-05-10T09:58:44.053347+0000","last_deep_scrub":"110'9","last_deep_scrub_stamp":"2024-05-10T09:58:44.053347+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.053347+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:19:14.172812+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.997826+0000","last_change":"2024-05-10T09:58:28.997883+0000","last_active":"2024-05-10T09:58:28.997826+0000","last_peered":"2024-05-10T09:58:28.997826+0000","last_clean":"2024-05-10T09:58:28.997826+0000","last_became_active":"2024-05-10T09:57:09.644815+0000","last_became_peered":"2024-05-10T09:57:09.644815+0000","last_unstale":"2024-05-10T09:58:28.997826+0000","last_undegraded":"2024-05-10T09:58:28.997826+0000","last_fullsized":"2024-05-10T09:58:28.997826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.997630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.997630+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.997630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:58.539156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.129836+0000","last_change":"2024-05-10T09:58:54.129911+0000","last_active":"2024-05-10T09:58:54.129836+0000","last_peered":"2024-05-10T09:58:54.129836+0000","last_clean":"2024-05-10T09:58:54.129836+0000","last_became_active":"2024-05-10T09:54:49.725845+0000","last_became_peered":"2024-05-10T09:54:49.725845+0000","last_unstale":"2024-05-10T09:58:54.129836+0000","last_undegraded":"2024-05-10T09:58:54.129836+0000","last_fullsized":"2024-05-10T09:58:54.129836+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:54.129628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:54.129628+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.129628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:35:32.639658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"75'2","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.119463+0000","last_change":"2024-05-10T09:58:38.119530+0000","last_active":"2024-05-10T09:58:38.119463+0000","last_peered":"2024-05-10T09:58:38.119463+0000","last_clean":"2024-05-10T09:58:38.119463+0000","last_became_active":"2024-05-10T09:54:41.656285+0000","last_became_peered":"2024-05-10T09:54:41.656285+0000","last_unstale":"2024-05-10T09:58:38.119463+0000","last_undegraded":"2024-05-10T09:58:38.119463+0000","last_fullsized":"2024-05-10T09:58:38.119463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:38.119215+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:38.119215+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.119215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:08.511135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"110'20","reported_seq":254,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:55.740990+0000","last_change":"2024-05-10T09:58:55.740990+0000","last_active":"2024-05-10T09:58:55.740990+0000","last_peered":"2024-05-10T09:58:55.740990+0000","last_clean":"2024-05-10T09:58:55.740990+0000","last_became_active":"2024-05-10T09:57:09.666039+0000","last_became_peered":"2024-05-10T09:57:09.666039+0000","last_unstale":"2024-05-10T09:58:55.740990+0000","last_undegraded":"2024-05-10T09:58:55.740990+0000","last_fullsized":"2024-05-10T09:58:55.740990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:55.740745+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:55.740745+0000","last_clean_scrub_stamp":"2024-05-10T09:58:55.740745+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:05:18.225706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":34834,"num_write":50,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.654992+0000","last_change":"2024-05-10T09:58:37.655086+0000","last_active":"2024-05-10T09:58:37.654992+0000","last_peered":"2024-05-10T09:58:37.654992+0000","last_clean":"2024-05-10T09:58:37.654992+0000","last_became_active":"2024-05-10T09:54:43.664154+0000","last_became_peered":"2024-05-10T09:54:43.664154+0000","last_unstale":"2024-05-10T09:58:37.654992+0000","last_undegraded":"2024-05-10T09:58:37.654992+0000","last_fullsized":"2024-05-10T09:58:37.654992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.654760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.654760+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.654760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:56.034677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"110'15","reported_seq":207,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.488930+0000","last_change":"2024-05-10T09:58:37.489092+0000","last_active":"2024-05-10T09:58:37.488930+0000","last_peered":"2024-05-10T09:58:37.488930+0000","last_clean":"2024-05-10T09:58:37.488930+0000","last_became_active":"2024-05-10T09:57:09.634744+0000","last_became_peered":"2024-05-10T09:57:09.634744+0000","last_unstale":"2024-05-10T09:58:37.488930+0000","last_undegraded":"2024-05-10T09:58:37.488930+0000","last_fullsized":"2024-05-10T09:58:37.488930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:37.488682+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:37.488682+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.488682+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:28.648725+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"110'19","reported_seq":248,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.720913+0000","last_change":"2024-05-10T09:58:48.720980+0000","last_active":"2024-05-10T09:58:48.720913+0000","last_peered":"2024-05-10T09:58:48.720913+0000","last_clean":"2024-05-10T09:58:48.720913+0000","last_became_active":"2024-05-10T09:54:47.711093+0000","last_became_peered":"2024-05-10T09:54:47.711093+0000","last_unstale":"2024-05-10T09:58:48.720913+0000","last_undegraded":"2024-05-10T09:58:48.720913+0000","last_fullsized":"2024-05-10T09:58:48.720913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'19","last_scrub_stamp":"2024-05-10T09:58:48.720726+0000","last_deep_scrub":"110'19","last_deep_scrub_stamp":"2024-05-10T09:58:48.720726+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.720726+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:20.221864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.068352+0000","last_change":"2024-05-10T09:58:39.068409+0000","last_active":"2024-05-10T09:58:39.068352+0000","last_peered":"2024-05-10T09:58:39.068352+0000","last_clean":"2024-05-10T09:58:39.068352+0000","last_became_active":"2024-05-10T09:57:09.643190+0000","last_became_peered":"2024-05-10T09:57:09.643190+0000","last_unstale":"2024-05-10T09:58:39.068352+0000","last_undegraded":"2024-05-10T09:58:39.068352+0000","last_fullsized":"2024-05-10T09:58:39.068352+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:39.068154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:39.068154+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.068154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:10:30.638064+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.613907+0000","last_change":"2024-05-10T09:58:38.613964+0000","last_active":"2024-05-10T09:58:38.613907+0000","last_peered":"2024-05-10T09:58:38.613907+0000","last_clean":"2024-05-10T09:58:38.613907+0000","last_became_active":"2024-05-10T09:54:41.663910+0000","last_became_peered":"2024-05-10T09:54:41.663910+0000","last_unstale":"2024-05-10T09:58:38.613907+0000","last_undegraded":"2024-05-10T09:58:38.613907+0000","last_fullsized":"2024-05-10T09:58:38.613907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.613707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.613707+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.613707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:43.131314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"110'18","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.586500+0000","last_change":"2024-05-10T09:58:33.586500+0000","last_active":"2024-05-10T09:58:33.586500+0000","last_peered":"2024-05-10T09:58:33.586500+0000","last_clean":"2024-05-10T09:58:33.586500+0000","last_became_active":"2024-05-10T09:54:39.632656+0000","last_became_peered":"2024-05-10T09:54:39.632656+0000","last_unstale":"2024-05-10T09:58:33.586500+0000","last_undegraded":"2024-05-10T09:58:33.586500+0000","last_fullsized":"2024-05-10T09:58:33.586500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:33.586099+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:33.586099+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.586099+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:08.765872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.393466+0000","last_change":"2024-05-10T09:58:32.393522+0000","last_active":"2024-05-10T09:58:32.393466+0000","last_peered":"2024-05-10T09:58:32.393466+0000","last_clean":"2024-05-10T09:58:32.393466+0000","last_became_active":"2024-05-10T09:54:43.665110+0000","last_became_peered":"2024-05-10T09:54:43.665110+0000","last_unstale":"2024-05-10T09:58:32.393466+0000","last_undegraded":"2024-05-10T09:58:32.393466+0000","last_fullsized":"2024-05-10T09:58:32.393466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.393279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.393279+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.393279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:25:32.242983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"110'20","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.728239+0000","last_change":"2024-05-10T09:58:32.728406+0000","last_active":"2024-05-10T09:58:32.728239+0000","last_peered":"2024-05-10T09:58:32.728239+0000","last_clean":"2024-05-10T09:58:32.728239+0000","last_became_active":"2024-05-10T09:54:46.140042+0000","last_became_peered":"2024-05-10T09:54:46.140042+0000","last_unstale":"2024-05-10T09:58:32.728239+0000","last_undegraded":"2024-05-10T09:58:32.728239+0000","last_fullsized":"2024-05-10T09:58:32.728239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:32.727966+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:32.727966+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.727966+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:18.865655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"110'18","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.618816+0000","last_change":"2024-05-10T09:58:23.618883+0000","last_active":"2024-05-10T09:58:23.618816+0000","last_peered":"2024-05-10T09:58:23.618816+0000","last_clean":"2024-05-10T09:58:23.618816+0000","last_became_active":"2024-05-10T09:54:47.717069+0000","last_became_peered":"2024-05-10T09:54:47.717069+0000","last_unstale":"2024-05-10T09:58:23.618816+0000","last_undegraded":"2024-05-10T09:58:23.618816+0000","last_fullsized":"2024-05-10T09:58:23.618816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:23.618614+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:23.618614+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.618614+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:54.811989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.418905+0000","last_change":"2024-05-10T09:58:30.418905+0000","last_active":"2024-05-10T09:58:30.418905+0000","last_peered":"2024-05-10T09:58:30.418905+0000","last_clean":"2024-05-10T09:58:30.418905+0000","last_became_active":"2024-05-10T09:54:41.676222+0000","last_became_peered":"2024-05-10T09:54:41.676222+0000","last_unstale":"2024-05-10T09:58:30.418905+0000","last_undegraded":"2024-05-10T09:58:30.418905+0000","last_fullsized":"2024-05-10T09:58:30.418905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.418650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.418650+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.418650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:38:28.888661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"110'12","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.732361+0000","last_change":"2024-05-10T09:58:53.732361+0000","last_active":"2024-05-10T09:58:53.732361+0000","last_peered":"2024-05-10T09:58:53.732361+0000","last_clean":"2024-05-10T09:58:53.732361+0000","last_became_active":"2024-05-10T09:57:09.644377+0000","last_became_peered":"2024-05-10T09:57:09.644377+0000","last_unstale":"2024-05-10T09:58:53.732361+0000","last_undegraded":"2024-05-10T09:58:53.732361+0000","last_fullsized":"2024-05-10T09:58:53.732361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:53.732081+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:53.732081+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.732081+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:25.119682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":18444,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.731914+0000","last_change":"2024-05-10T09:58:29.731914+0000","last_active":"2024-05-10T09:58:29.731914+0000","last_peered":"2024-05-10T09:58:29.731914+0000","last_clean":"2024-05-10T09:58:29.731914+0000","last_became_active":"2024-05-10T09:54:43.660475+0000","last_became_peered":"2024-05-10T09:54:43.660475+0000","last_unstale":"2024-05-10T09:58:29.731914+0000","last_undegraded":"2024-05-10T09:58:29.731914+0000","last_fullsized":"2024-05-10T09:58:29.731914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.731667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.731667+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.731667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:28.054350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"110'35","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.520851+0000","last_change":"2024-05-10T09:58:27.520851+0000","last_active":"2024-05-10T09:58:27.520851+0000","last_peered":"2024-05-10T09:58:27.520851+0000","last_clean":"2024-05-10T09:58:27.520851+0000","last_became_active":"2024-05-10T09:54:46.136284+0000","last_became_peered":"2024-05-10T09:54:46.136284+0000","last_unstale":"2024-05-10T09:58:27.520851+0000","last_undegraded":"2024-05-10T09:58:27.520851+0000","last_fullsized":"2024-05-10T09:58:27.520851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'35","last_scrub_stamp":"2024-05-10T09:58:27.520581+0000","last_deep_scrub":"110'35","last_deep_scrub_stamp":"2024-05-10T09:58:27.520581+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.520581+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:26:51.985220+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.735956+0000","last_change":"2024-05-10T09:58:26.735956+0000","last_active":"2024-05-10T09:58:26.735956+0000","last_peered":"2024-05-10T09:58:26.735956+0000","last_clean":"2024-05-10T09:58:26.735956+0000","last_became_active":"2024-05-10T09:54:47.698243+0000","last_became_peered":"2024-05-10T09:54:47.698243+0000","last_unstale":"2024-05-10T09:58:26.735956+0000","last_undegraded":"2024-05-10T09:58:26.735956+0000","last_fullsized":"2024-05-10T09:58:26.735956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.735648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.735648+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.735648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:39.607212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:57.677547+0000","last_change":"2024-05-10T09:58:57.677547+0000","last_active":"2024-05-10T09:58:57.677547+0000","last_peered":"2024-05-10T09:58:57.677547+0000","last_clean":"2024-05-10T09:58:57.677547+0000","last_became_active":"2024-05-10T09:57:09.662756+0000","last_became_peered":"2024-05-10T09:57:09.662756+0000","last_unstale":"2024-05-10T09:58:57.677547+0000","last_undegraded":"2024-05-10T09:58:57.677547+0000","last_fullsized":"2024-05-10T09:58:57.677547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:57.677268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:57.677268+0000","last_clean_scrub_stamp":"2024-05-10T09:58:57.677268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:44:00.859809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'6","reported_seq":178,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.113416+0000","last_change":"2024-05-10T09:58:36.113416+0000","last_active":"2024-05-10T09:58:36.113416+0000","last_peered":"2024-05-10T09:58:36.113416+0000","last_clean":"2024-05-10T09:58:36.113416+0000","last_became_active":"2024-05-10T09:57:09.637535+0000","last_became_peered":"2024-05-10T09:57:09.637535+0000","last_unstale":"2024-05-10T09:58:36.113416+0000","last_undegraded":"2024-05-10T09:58:36.113416+0000","last_fullsized":"2024-05-10T09:58:36.113416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:36.113103+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:36.113103+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.113103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:20.605682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"110'20","reported_seq":252,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.707169+0000","last_change":"2024-05-10T09:58:54.707169+0000","last_active":"2024-05-10T09:58:54.707169+0000","last_peered":"2024-05-10T09:58:54.707169+0000","last_clean":"2024-05-10T09:58:54.707169+0000","last_became_active":"2024-05-10T09:57:09.652632+0000","last_became_peered":"2024-05-10T09:57:09.652632+0000","last_unstale":"2024-05-10T09:58:54.707169+0000","last_undegraded":"2024-05-10T09:58:54.707169+0000","last_fullsized":"2024-05-10T09:58:54.707169+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:54.706916+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:54.706916+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.706916+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:18.036494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38930,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":23068672,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.562854+0000","last_change":"2024-05-10T09:58:22.562854+0000","last_active":"2024-05-10T09:58:22.562854+0000","last_peered":"2024-05-10T09:58:22.562854+0000","last_clean":"2024-05-10T09:58:22.562854+0000","last_became_active":"2024-05-10T09:54:43.659584+0000","last_became_peered":"2024-05-10T09:54:43.659584+0000","last_unstale":"2024-05-10T09:58:22.562854+0000","last_undegraded":"2024-05-10T09:58:22.562854+0000","last_fullsized":"2024-05-10T09:58:22.562854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.562754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.562754+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.562754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:35:32.614610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"110'22","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.603303+0000","last_change":"2024-05-10T09:58:45.603303+0000","last_active":"2024-05-10T09:58:45.603303+0000","last_peered":"2024-05-10T09:58:45.603303+0000","last_clean":"2024-05-10T09:58:45.603303+0000","last_became_active":"2024-05-10T09:54:45.686073+0000","last_became_peered":"2024-05-10T09:54:45.686073+0000","last_unstale":"2024-05-10T09:58:45.603303+0000","last_undegraded":"2024-05-10T09:58:45.603303+0000","last_fullsized":"2024-05-10T09:58:45.603303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:45.603028+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:45.603028+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.603028+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:16.990629+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.580404+0000","last_change":"2024-05-10T09:58:22.580404+0000","last_active":"2024-05-10T09:58:22.580404+0000","last_peered":"2024-05-10T09:58:22.580404+0000","last_clean":"2024-05-10T09:58:22.580404+0000","last_became_active":"2024-05-10T09:54:47.718095+0000","last_became_peered":"2024-05-10T09:54:47.718095+0000","last_unstale":"2024-05-10T09:58:22.580404+0000","last_undegraded":"2024-05-10T09:58:22.580404+0000","last_fullsized":"2024-05-10T09:58:22.580404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.580217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.580217+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.580217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:31:57.759990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"89'2","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.524497+0000","last_change":"2024-05-10T09:58:42.524497+0000","last_active":"2024-05-10T09:58:42.524497+0000","last_peered":"2024-05-10T09:58:42.524497+0000","last_clean":"2024-05-10T09:58:42.524497+0000","last_became_active":"2024-05-10T09:57:09.659787+0000","last_became_peered":"2024-05-10T09:57:09.659787+0000","last_unstale":"2024-05-10T09:58:42.524497+0000","last_undegraded":"2024-05-10T09:58:42.524497+0000","last_fullsized":"2024-05-10T09:58:42.524497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-05-10T09:58:42.524211+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-05-10T09:58:42.524211+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.524211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:32.290761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.559000+0000","last_change":"2024-05-10T09:58:30.559000+0000","last_active":"2024-05-10T09:58:30.559000+0000","last_peered":"2024-05-10T09:58:30.559000+0000","last_clean":"2024-05-10T09:58:30.559000+0000","last_became_active":"2024-05-10T09:54:41.681295+0000","last_became_peered":"2024-05-10T09:54:41.681295+0000","last_unstale":"2024-05-10T09:58:30.559000+0000","last_undegraded":"2024-05-10T09:58:30.559000+0000","last_fullsized":"2024-05-10T09:58:30.559000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.558746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.558746+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.558746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:11.963440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"110'16","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.674615+0000","last_change":"2024-05-10T09:58:47.674615+0000","last_active":"2024-05-10T09:58:47.674615+0000","last_peered":"2024-05-10T09:58:47.674615+0000","last_clean":"2024-05-10T09:58:47.674615+0000","last_became_active":"2024-05-10T09:54:39.664755+0000","last_became_peered":"2024-05-10T09:54:39.664755+0000","last_unstale":"2024-05-10T09:58:47.674615+0000","last_undegraded":"2024-05-10T09:58:47.674615+0000","last_fullsized":"2024-05-10T09:58:47.674615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:47.674315+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:47.674315+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.674315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:50.661933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.439613+0000","last_change":"2024-05-10T09:58:29.439613+0000","last_active":"2024-05-10T09:58:29.439613+0000","last_peered":"2024-05-10T09:58:29.439613+0000","last_clean":"2024-05-10T09:58:29.439613+0000","last_became_active":"2024-05-10T09:54:43.659849+0000","last_became_peered":"2024-05-10T09:54:43.659849+0000","last_unstale":"2024-05-10T09:58:29.439613+0000","last_undegraded":"2024-05-10T09:58:29.439613+0000","last_fullsized":"2024-05-10T09:58:29.439613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.439219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.439219+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.439219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:09:31.720031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"110'29","reported_seq":224,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.686292+0000","last_change":"2024-05-10T09:58:25.686292+0000","last_active":"2024-05-10T09:58:25.686292+0000","last_peered":"2024-05-10T09:58:25.686292+0000","last_clean":"2024-05-10T09:58:25.686292+0000","last_became_active":"2024-05-10T09:54:45.682099+0000","last_became_peered":"2024-05-10T09:54:45.682099+0000","last_unstale":"2024-05-10T09:58:25.686292+0000","last_undegraded":"2024-05-10T09:58:25.686292+0000","last_fullsized":"2024-05-10T09:58:25.686292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'29","last_scrub_stamp":"2024-05-10T09:58:25.685859+0000","last_deep_scrub":"110'29","last_deep_scrub_stamp":"2024-05-10T09:58:25.685859+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.685859+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:46.184892+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"110'18","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.085550+0000","last_change":"2024-05-10T09:58:24.085550+0000","last_active":"2024-05-10T09:58:24.085550+0000","last_peered":"2024-05-10T09:58:24.085550+0000","last_clean":"2024-05-10T09:58:24.085550+0000","last_became_active":"2024-05-10T09:54:47.692819+0000","last_became_peered":"2024-05-10T09:54:47.692819+0000","last_unstale":"2024-05-10T09:58:24.085550+0000","last_undegraded":"2024-05-10T09:58:24.085550+0000","last_fullsized":"2024-05-10T09:58:24.085550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.085290+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.085290+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.085290+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:22.407972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"75'2","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.124415+0000","last_change":"2024-05-10T09:58:53.124415+0000","last_active":"2024-05-10T09:58:53.124415+0000","last_peered":"2024-05-10T09:58:53.124415+0000","last_clean":"2024-05-10T09:58:53.124415+0000","last_became_active":"2024-05-10T09:54:49.724908+0000","last_became_peered":"2024-05-10T09:54:49.724908+0000","last_unstale":"2024-05-10T09:58:53.124415+0000","last_undegraded":"2024-05-10T09:58:53.124415+0000","last_fullsized":"2024-05-10T09:58:53.124415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:53.124129+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:53.124129+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.124129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:47.964582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"89'42","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.049267+0000","last_change":"2024-05-10T09:58:30.049267+0000","last_active":"2024-05-10T09:58:30.049267+0000","last_peered":"2024-05-10T09:58:30.049267+0000","last_clean":"2024-05-10T09:58:30.049267+0000","last_became_active":"2024-05-10T09:54:41.666826+0000","last_became_peered":"2024-05-10T09:54:41.666826+0000","last_unstale":"2024-05-10T09:58:30.049267+0000","last_undegraded":"2024-05-10T09:58:30.049267+0000","last_fullsized":"2024-05-10T09:58:30.049267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'42","last_scrub_stamp":"2024-05-10T09:58:30.049003+0000","last_deep_scrub":"89'42","last_deep_scrub_stamp":"2024-05-10T09:58:30.049003+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.049003+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:30.409395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"110'24","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.599571+0000","last_change":"2024-05-10T09:58:51.599571+0000","last_active":"2024-05-10T09:58:51.599571+0000","last_peered":"2024-05-10T09:58:51.599571+0000","last_clean":"2024-05-10T09:58:51.599571+0000","last_became_active":"2024-05-10T09:54:39.663496+0000","last_became_peered":"2024-05-10T09:54:39.663496+0000","last_unstale":"2024-05-10T09:58:51.599571+0000","last_undegraded":"2024-05-10T09:58:51.599571+0000","last_fullsized":"2024-05-10T09:58:51.599571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:51.599284+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:51.599284+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.599284+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:05:14.084244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":49170,"num_write":54,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.473998+0000","last_change":"2024-05-10T09:58:36.473998+0000","last_active":"2024-05-10T09:58:36.473998+0000","last_peered":"2024-05-10T09:58:36.473998+0000","last_clean":"2024-05-10T09:58:36.473998+0000","last_became_active":"2024-05-10T09:57:09.625923+0000","last_became_peered":"2024-05-10T09:57:09.625923+0000","last_unstale":"2024-05-10T09:58:36.473998+0000","last_undegraded":"2024-05-10T09:58:36.473998+0000","last_fullsized":"2024-05-10T09:58:36.473998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.473749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.473749+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.473749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:27.723420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"110'35","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.142110+0000","last_change":"2024-05-10T09:58:39.142110+0000","last_active":"2024-05-10T09:58:39.142110+0000","last_peered":"2024-05-10T09:58:39.142110+0000","last_clean":"2024-05-10T09:58:39.142110+0000","last_became_active":"2024-05-10T09:54:45.686429+0000","last_became_peered":"2024-05-10T09:54:45.686429+0000","last_unstale":"2024-05-10T09:58:39.142110+0000","last_undegraded":"2024-05-10T09:58:39.142110+0000","last_fullsized":"2024-05-10T09:58:39.142110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'35","last_scrub_stamp":"2024-05-10T09:58:39.141835+0000","last_deep_scrub":"110'35","last_deep_scrub_stamp":"2024-05-10T09:58:39.141835+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.141835+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:49.105710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":59,"num_read_kb":98,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.489127+0000","last_change":"2024-05-10T09:58:32.489127+0000","last_active":"2024-05-10T09:58:32.489127+0000","last_peered":"2024-05-10T09:58:32.489127+0000","last_clean":"2024-05-10T09:58:32.489127+0000","last_became_active":"2024-05-10T09:54:47.701815+0000","last_became_peered":"2024-05-10T09:54:47.701815+0000","last_unstale":"2024-05-10T09:58:32.489127+0000","last_undegraded":"2024-05-10T09:58:32.489127+0000","last_fullsized":"2024-05-10T09:58:32.489127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.488872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.488872+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.488872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:07:29.913561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.509117+0000","last_change":"2024-05-10T09:58:43.509117+0000","last_active":"2024-05-10T09:58:43.509117+0000","last_peered":"2024-05-10T09:58:43.509117+0000","last_clean":"2024-05-10T09:58:43.509117+0000","last_became_active":"2024-05-10T09:54:49.722553+0000","last_became_peered":"2024-05-10T09:54:49.722553+0000","last_unstale":"2024-05-10T09:58:43.509117+0000","last_undegraded":"2024-05-10T09:58:43.509117+0000","last_fullsized":"2024-05-10T09:58:43.509117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:43.508733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:43.508733+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.508733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:17:50.855174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.034595+0000","last_change":"2024-05-10T09:58:28.034649+0000","last_active":"2024-05-10T09:58:28.034595+0000","last_peered":"2024-05-10T09:58:28.034595+0000","last_clean":"2024-05-10T09:58:28.034595+0000","last_became_active":"2024-05-10T09:57:09.654854+0000","last_became_peered":"2024-05-10T09:57:09.654854+0000","last_unstale":"2024-05-10T09:58:28.034595+0000","last_undegraded":"2024-05-10T09:58:28.034595+0000","last_fullsized":"2024-05-10T09:58:28.034595+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.034404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.034404+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.034404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:09:35.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"110'14","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.617201+0000","last_change":"2024-05-10T09:58:47.617201+0000","last_active":"2024-05-10T09:58:47.617201+0000","last_peered":"2024-05-10T09:58:47.617201+0000","last_clean":"2024-05-10T09:58:47.617201+0000","last_became_active":"2024-05-10T09:54:39.621386+0000","last_became_peered":"2024-05-10T09:54:39.621386+0000","last_unstale":"2024-05-10T09:58:47.617201+0000","last_undegraded":"2024-05-10T09:58:47.617201+0000","last_fullsized":"2024-05-10T09:58:47.617201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:47.616927+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:47.616927+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.616927+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:05:10.101888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28696,"num_write":54,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.404259+0000","last_change":"2024-05-10T09:58:30.404259+0000","last_active":"2024-05-10T09:58:30.404259+0000","last_peered":"2024-05-10T09:58:30.404259+0000","last_clean":"2024-05-10T09:58:30.404259+0000","last_became_active":"2024-05-10T09:54:43.659428+0000","last_became_peered":"2024-05-10T09:54:43.659428+0000","last_unstale":"2024-05-10T09:58:30.404259+0000","last_undegraded":"2024-05-10T09:58:30.404259+0000","last_fullsized":"2024-05-10T09:58:30.404259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.404013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.404013+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.404013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:53.231386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"110'29","reported_seq":137,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.951204+0000","last_change":"2024-05-10T09:58:50.951287+0000","last_active":"2024-05-10T09:58:50.951204+0000","last_peered":"2024-05-10T09:58:50.951204+0000","last_clean":"2024-05-10T09:58:50.951204+0000","last_became_active":"2024-05-10T09:57:09.651926+0000","last_became_peered":"2024-05-10T09:57:09.651926+0000","last_unstale":"2024-05-10T09:58:50.951204+0000","last_undegraded":"2024-05-10T09:58:50.951204+0000","last_fullsized":"2024-05-10T09:58:50.951204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'29","last_scrub_stamp":"2024-05-10T09:58:50.951018+0000","last_deep_scrub":"110'29","last_deep_scrub_stamp":"2024-05-10T09:58:50.951018+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.951018+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:39:48.112574+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":62,"num_write":32,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5712,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":858,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:19.097693+0000","last_change":"2024-05-10T09:58:19.097693+0000","last_active":"2024-05-10T09:58:19.097693+0000","last_peered":"2024-05-10T09:58:19.097693+0000","last_clean":"2024-05-10T09:58:19.097693+0000","last_became_active":"2024-05-10T09:54:47.719859+0000","last_became_peered":"2024-05-10T09:54:47.719859+0000","last_unstale":"2024-05-10T09:58:19.097693+0000","last_undegraded":"2024-05-10T09:58:19.097693+0000","last_fullsized":"2024-05-10T09:58:19.097693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:19.097509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:19.097509+0000","last_clean_scrub_stamp":"2024-05-10T09:58:19.097509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:17:14.252931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.686138+0000","last_change":"2024-05-10T09:58:25.686138+0000","last_active":"2024-05-10T09:58:25.686138+0000","last_peered":"2024-05-10T09:58:25.686138+0000","last_clean":"2024-05-10T09:58:25.686138+0000","last_became_active":"2024-05-10T09:54:49.730725+0000","last_became_peered":"2024-05-10T09:54:49.730725+0000","last_unstale":"2024-05-10T09:58:25.686138+0000","last_undegraded":"2024-05-10T09:58:25.686138+0000","last_fullsized":"2024-05-10T09:58:25.686138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.685801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.685801+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.685801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:25:57.930550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.103814+0000","last_change":"2024-05-10T09:58:33.103870+0000","last_active":"2024-05-10T09:58:33.103814+0000","last_peered":"2024-05-10T09:58:33.103814+0000","last_clean":"2024-05-10T09:58:33.103814+0000","last_became_active":"2024-05-10T09:57:09.648069+0000","last_became_peered":"2024-05-10T09:57:09.648069+0000","last_unstale":"2024-05-10T09:58:33.103814+0000","last_undegraded":"2024-05-10T09:58:33.103814+0000","last_fullsized":"2024-05-10T09:58:33.103814+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.103627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.103627+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.103627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:27:21.064029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"110'12","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.512999+0000","last_change":"2024-05-10T09:58:43.512999+0000","last_active":"2024-05-10T09:58:43.512999+0000","last_peered":"2024-05-10T09:58:43.512999+0000","last_clean":"2024-05-10T09:58:43.512999+0000","last_became_active":"2024-05-10T09:57:09.661891+0000","last_became_peered":"2024-05-10T09:57:09.661891+0000","last_unstale":"2024-05-10T09:58:43.512999+0000","last_undegraded":"2024-05-10T09:58:43.512999+0000","last_fullsized":"2024-05-10T09:58:43.512999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:43.512550+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:43.512550+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.512550+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:08:02.222240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.392405+0000","last_change":"2024-05-10T09:58:48.392405+0000","last_active":"2024-05-10T09:58:48.392405+0000","last_peered":"2024-05-10T09:58:48.392405+0000","last_clean":"2024-05-10T09:58:48.392405+0000","last_became_active":"2024-05-10T09:57:09.662494+0000","last_became_peered":"2024-05-10T09:57:09.662494+0000","last_unstale":"2024-05-10T09:58:48.392405+0000","last_undegraded":"2024-05-10T09:58:48.392405+0000","last_fullsized":"2024-05-10T09:58:48.392405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:48.392147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:48.392147+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.392147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:22.771321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"110'32","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.560479+0000","last_change":"2024-05-10T09:58:21.560479+0000","last_active":"2024-05-10T09:58:21.560479+0000","last_peered":"2024-05-10T09:58:21.560479+0000","last_clean":"2024-05-10T09:58:21.560479+0000","last_became_active":"2024-05-10T09:54:45.672418+0000","last_became_peered":"2024-05-10T09:54:45.672418+0000","last_unstale":"2024-05-10T09:58:21.560479+0000","last_undegraded":"2024-05-10T09:58:21.560479+0000","last_fullsized":"2024-05-10T09:58:21.560479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'32","last_scrub_stamp":"2024-05-10T09:58:21.560361+0000","last_deep_scrub":"110'32","last_deep_scrub_stamp":"2024-05-10T09:58:21.560361+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.560361+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:36.972412+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":68,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"110'18","reported_seq":264,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.440554+0000","last_change":"2024-05-10T09:58:31.440554+0000","last_active":"2024-05-10T09:58:31.440554+0000","last_peered":"2024-05-10T09:58:31.440554+0000","last_clean":"2024-05-10T09:58:31.440554+0000","last_became_active":"2024-05-10T09:54:47.696308+0000","last_became_peered":"2024-05-10T09:54:47.696308+0000","last_unstale":"2024-05-10T09:58:31.440554+0000","last_undegraded":"2024-05-10T09:58:31.440554+0000","last_fullsized":"2024-05-10T09:58:31.440554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:31.440173+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:31.440173+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.440173+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:47:41.837626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"89'2","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.511283+0000","last_change":"2024-05-10T09:58:42.511283+0000","last_active":"2024-05-10T09:58:42.511283+0000","last_peered":"2024-05-10T09:58:42.511283+0000","last_clean":"2024-05-10T09:58:42.511283+0000","last_became_active":"2024-05-10T09:54:49.721048+0000","last_became_peered":"2024-05-10T09:54:49.721048+0000","last_unstale":"2024-05-10T09:58:42.511283+0000","last_undegraded":"2024-05-10T09:58:42.511283+0000","last_fullsized":"2024-05-10T09:58:42.511283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'2","last_scrub_stamp":"2024-05-10T09:58:42.511010+0000","last_deep_scrub":"89'2","last_deep_scrub_stamp":"2024-05-10T09:58:42.511010+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.511010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:27.177849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.983470+0000","last_change":"2024-05-10T09:58:24.983604+0000","last_active":"2024-05-10T09:58:24.983470+0000","last_peered":"2024-05-10T09:58:24.983470+0000","last_clean":"2024-05-10T09:58:24.983470+0000","last_became_active":"2024-05-10T09:57:09.641915+0000","last_became_peered":"2024-05-10T09:57:09.641915+0000","last_unstale":"2024-05-10T09:58:24.983470+0000","last_undegraded":"2024-05-10T09:58:24.983470+0000","last_fullsized":"2024-05-10T09:58:24.983470+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.983218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.983218+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.983218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:03.586274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"110'6","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.018176+0000","last_change":"2024-05-10T09:58:22.018176+0000","last_active":"2024-05-10T09:58:22.018176+0000","last_peered":"2024-05-10T09:58:22.018176+0000","last_clean":"2024-05-10T09:58:22.018176+0000","last_became_active":"2024-05-10T09:57:09.648043+0000","last_became_peered":"2024-05-10T09:57:09.648043+0000","last_unstale":"2024-05-10T09:58:22.018176+0000","last_undegraded":"2024-05-10T09:58:22.018176+0000","last_fullsized":"2024-05-10T09:58:22.018176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-05-10T09:58:22.017751+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-05-10T09:58:22.017751+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.017751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:48:36.819356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"110'4","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.668688+0000","last_change":"2024-05-10T09:58:54.668688+0000","last_active":"2024-05-10T09:58:54.668688+0000","last_peered":"2024-05-10T09:58:54.668688+0000","last_clean":"2024-05-10T09:58:54.668688+0000","last_became_active":"2024-05-10T09:57:09.641251+0000","last_became_peered":"2024-05-10T09:57:09.641251+0000","last_unstale":"2024-05-10T09:58:54.668688+0000","last_undegraded":"2024-05-10T09:58:54.668688+0000","last_fullsized":"2024-05-10T09:58:54.668688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'4","last_scrub_stamp":"2024-05-10T09:58:54.668402+0000","last_deep_scrub":"110'4","last_deep_scrub_stamp":"2024-05-10T09:58:54.668402+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.668402+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:28.660826+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"110'15","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.697133+0000","last_change":"2024-05-10T09:58:30.697133+0000","last_active":"2024-05-10T09:58:30.697133+0000","last_peered":"2024-05-10T09:58:30.697133+0000","last_clean":"2024-05-10T09:58:30.697133+0000","last_became_active":"2024-05-10T09:54:46.136144+0000","last_became_peered":"2024-05-10T09:54:46.136144+0000","last_unstale":"2024-05-10T09:58:30.697133+0000","last_undegraded":"2024-05-10T09:58:30.697133+0000","last_fullsized":"2024-05-10T09:58:30.697133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:30.696850+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:30.696850+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.696850+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:54.681885+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"110'18","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.504000+0000","last_change":"2024-05-10T09:58:26.504000+0000","last_active":"2024-05-10T09:58:26.504000+0000","last_peered":"2024-05-10T09:58:26.504000+0000","last_clean":"2024-05-10T09:58:26.504000+0000","last_became_active":"2024-05-10T09:54:47.702113+0000","last_became_peered":"2024-05-10T09:54:47.702113+0000","last_unstale":"2024-05-10T09:58:26.504000+0000","last_undegraded":"2024-05-10T09:58:26.504000+0000","last_fullsized":"2024-05-10T09:58:26.504000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:26.503736+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:26.503736+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.503736+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:36:41.630591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":82,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.097728+0000","last_change":"2024-05-10T09:58:41.097728+0000","last_active":"2024-05-10T09:58:41.097728+0000","last_peered":"2024-05-10T09:58:41.097728+0000","last_clean":"2024-05-10T09:58:41.097728+0000","last_became_active":"2024-05-10T09:57:09.637263+0000","last_became_peered":"2024-05-10T09:57:09.637263+0000","last_unstale":"2024-05-10T09:58:41.097728+0000","last_undegraded":"2024-05-10T09:58:41.097728+0000","last_fullsized":"2024-05-10T09:58:41.097728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:41.097472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:41.097472+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.097472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:52.314872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"89'46","reported_seq":236,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.648667+0000","last_change":"2024-05-10T09:58:31.648667+0000","last_active":"2024-05-10T09:58:31.648667+0000","last_peered":"2024-05-10T09:58:31.648667+0000","last_clean":"2024-05-10T09:58:31.648667+0000","last_became_active":"2024-05-10T09:54:41.672464+0000","last_became_peered":"2024-05-10T09:54:41.672464+0000","last_unstale":"2024-05-10T09:58:31.648667+0000","last_undegraded":"2024-05-10T09:58:31.648667+0000","last_fullsized":"2024-05-10T09:58:31.648667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'46","last_scrub_stamp":"2024-05-10T09:58:31.648362+0000","last_deep_scrub":"89'46","last_deep_scrub_stamp":"2024-05-10T09:58:31.648362+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.648362+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:32:49.521946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"110'22","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.644836+0000","last_change":"2024-05-10T09:58:49.644836+0000","last_active":"2024-05-10T09:58:49.644836+0000","last_peered":"2024-05-10T09:58:49.644836+0000","last_clean":"2024-05-10T09:58:49.644836+0000","last_became_active":"2024-05-10T09:54:39.627825+0000","last_became_peered":"2024-05-10T09:54:39.627825+0000","last_unstale":"2024-05-10T09:58:49.644836+0000","last_undegraded":"2024-05-10T09:58:49.644836+0000","last_fullsized":"2024-05-10T09:58:49.644836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:49.644586+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:49.644586+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.644586+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:05.257093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.073784+0000","last_change":"2024-05-10T09:58:35.073842+0000","last_active":"2024-05-10T09:58:35.073784+0000","last_peered":"2024-05-10T09:58:35.073784+0000","last_clean":"2024-05-10T09:58:35.073784+0000","last_became_active":"2024-05-10T09:57:09.641314+0000","last_became_peered":"2024-05-10T09:57:09.641314+0000","last_unstale":"2024-05-10T09:58:35.073784+0000","last_undegraded":"2024-05-10T09:58:35.073784+0000","last_fullsized":"2024-05-10T09:58:35.073784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.073567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.073567+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.073567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:37:45.269434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"110'35","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.426504+0000","last_change":"2024-05-10T09:58:42.426504+0000","last_active":"2024-05-10T09:58:42.426504+0000","last_peered":"2024-05-10T09:58:42.426504+0000","last_clean":"2024-05-10T09:58:42.426504+0000","last_became_active":"2024-05-10T09:54:45.679264+0000","last_became_peered":"2024-05-10T09:54:45.679264+0000","last_unstale":"2024-05-10T09:58:42.426504+0000","last_undegraded":"2024-05-10T09:58:42.426504+0000","last_fullsized":"2024-05-10T09:58:42.426504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'35","last_scrub_stamp":"2024-05-10T09:58:42.426118+0000","last_deep_scrub":"110'35","last_deep_scrub_stamp":"2024-05-10T09:58:42.426118+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.426118+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:20:18.277735+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":60,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.473352+0000","last_change":"2024-05-10T09:58:25.473352+0000","last_active":"2024-05-10T09:58:25.473352+0000","last_peered":"2024-05-10T09:58:25.473352+0000","last_clean":"2024-05-10T09:58:25.473352+0000","last_became_active":"2024-05-10T09:54:47.717707+0000","last_became_peered":"2024-05-10T09:54:47.717707+0000","last_unstale":"2024-05-10T09:58:25.473352+0000","last_undegraded":"2024-05-10T09:58:25.473352+0000","last_fullsized":"2024-05-10T09:58:25.473352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.473104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.473104+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.473104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:25:52.090751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.474417+0000","last_change":"2024-05-10T09:58:44.474417+0000","last_active":"2024-05-10T09:58:44.474417+0000","last_peered":"2024-05-10T09:58:44.474417+0000","last_clean":"2024-05-10T09:58:44.474417+0000","last_became_active":"2024-05-10T09:54:49.724686+0000","last_became_peered":"2024-05-10T09:54:49.724686+0000","last_unstale":"2024-05-10T09:58:44.474417+0000","last_undegraded":"2024-05-10T09:58:44.474417+0000","last_fullsized":"2024-05-10T09:58:44.474417+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:44.474053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:44.474053+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.474053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:32:55.343037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"89'46","reported_seq":248,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.525360+0000","last_change":"2024-05-10T09:58:44.525360+0000","last_active":"2024-05-10T09:58:44.525360+0000","last_peered":"2024-05-10T09:58:44.525360+0000","last_clean":"2024-05-10T09:58:44.525360+0000","last_became_active":"2024-05-10T09:57:09.664747+0000","last_became_peered":"2024-05-10T09:57:09.664747+0000","last_unstale":"2024-05-10T09:58:44.525360+0000","last_undegraded":"2024-05-10T09:58:44.525360+0000","last_fullsized":"2024-05-10T09:58:44.525360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'46","last_scrub_stamp":"2024-05-10T09:58:44.525111+0000","last_deep_scrub":"89'46","last_deep_scrub_stamp":"2024-05-10T09:58:44.525111+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.525111+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:36.467088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"110'74","reported_seq":297,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.706920+0000","last_change":"2024-05-10T09:58:40.707080+0000","last_active":"2024-05-10T09:58:40.706920+0000","last_peered":"2024-05-10T09:58:40.706920+0000","last_clean":"2024-05-10T09:58:40.706920+0000","last_became_active":"2024-05-10T09:54:28.304137+0000","last_became_peered":"2024-05-10T09:54:28.304137+0000","last_unstale":"2024-05-10T09:58:40.706920+0000","last_undegraded":"2024-05-10T09:58:40.706920+0000","last_fullsized":"2024-05-10T09:58:40.706920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'74","last_scrub_stamp":"2024-05-10T09:58:40.706652+0000","last_deep_scrub":"110'74","last_deep_scrub_stamp":"2024-05-10T09:58:40.706652+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.706652+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:59.416342+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.525443+0000","last_change":"2024-05-10T09:58:45.525502+0000","last_active":"2024-05-10T09:58:45.525443+0000","last_peered":"2024-05-10T09:58:45.525443+0000","last_clean":"2024-05-10T09:58:45.525443+0000","last_became_active":"2024-05-10T09:54:33.579716+0000","last_became_peered":"2024-05-10T09:54:33.579716+0000","last_unstale":"2024-05-10T09:58:45.525443+0000","last_undegraded":"2024-05-10T09:58:45.525443+0000","last_fullsized":"2024-05-10T09:58:45.525443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:45.525234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:45.525234+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.525234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:29.150695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"110'20","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.594035+0000","last_change":"2024-05-10T09:58:54.594095+0000","last_active":"2024-05-10T09:58:54.594035+0000","last_peered":"2024-05-10T09:58:54.594035+0000","last_clean":"2024-05-10T09:58:54.594035+0000","last_became_active":"2024-05-10T09:54:39.668503+0000","last_became_peered":"2024-05-10T09:54:39.668503+0000","last_unstale":"2024-05-10T09:58:54.594035+0000","last_undegraded":"2024-05-10T09:58:54.594035+0000","last_fullsized":"2024-05-10T09:58:54.594035+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:54.593842+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:54.593842+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.593842+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:39.439459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.760251+0000","last_change":"2024-05-10T09:58:27.760251+0000","last_active":"2024-05-10T09:58:27.760251+0000","last_peered":"2024-05-10T09:58:27.760251+0000","last_clean":"2024-05-10T09:58:27.760251+0000","last_became_active":"2024-05-10T09:54:43.672080+0000","last_became_peered":"2024-05-10T09:54:43.672080+0000","last_unstale":"2024-05-10T09:58:27.760251+0000","last_undegraded":"2024-05-10T09:58:27.760251+0000","last_fullsized":"2024-05-10T09:58:27.760251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.760005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.760005+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.760005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:09.164699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"110'45","reported_seq":249,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.404617+0000","last_change":"2024-05-10T09:58:40.404617+0000","last_active":"2024-05-10T09:58:40.404617+0000","last_peered":"2024-05-10T09:58:40.404617+0000","last_clean":"2024-05-10T09:58:40.404617+0000","last_became_active":"2024-05-10T09:54:45.679117+0000","last_became_peered":"2024-05-10T09:54:45.679117+0000","last_unstale":"2024-05-10T09:58:40.404617+0000","last_undegraded":"2024-05-10T09:58:40.404617+0000","last_fullsized":"2024-05-10T09:58:40.404617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'45","last_scrub_stamp":"2024-05-10T09:58:40.404348+0000","last_deep_scrub":"110'45","last_deep_scrub_stamp":"2024-05-10T09:58:40.404348+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.404348+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:50.368223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":125,"num_write":52,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.070219+0000","last_change":"2024-05-10T09:58:23.070219+0000","last_active":"2024-05-10T09:58:23.070219+0000","last_peered":"2024-05-10T09:58:23.070219+0000","last_clean":"2024-05-10T09:58:23.070219+0000","last_became_active":"2024-05-10T09:54:47.701965+0000","last_became_peered":"2024-05-10T09:54:47.701965+0000","last_unstale":"2024-05-10T09:58:23.070219+0000","last_undegraded":"2024-05-10T09:58:23.070219+0000","last_fullsized":"2024-05-10T09:58:23.070219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.069925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.069925+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.069925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:23.967919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.545484+0000","last_change":"2024-05-10T09:58:27.545484+0000","last_active":"2024-05-10T09:58:27.545484+0000","last_peered":"2024-05-10T09:58:27.545484+0000","last_clean":"2024-05-10T09:58:27.545484+0000","last_became_active":"2024-05-10T09:54:49.716158+0000","last_became_peered":"2024-05-10T09:54:49.716158+0000","last_unstale":"2024-05-10T09:58:27.545484+0000","last_undegraded":"2024-05-10T09:58:27.545484+0000","last_fullsized":"2024-05-10T09:58:27.545484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.545228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.545228+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.545228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:30.775332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.017154+0000","last_change":"2024-05-10T09:58:28.017154+0000","last_active":"2024-05-10T09:58:28.017154+0000","last_peered":"2024-05-10T09:58:28.017154+0000","last_clean":"2024-05-10T09:58:28.017154+0000","last_became_active":"2024-05-10T09:54:41.667988+0000","last_became_peered":"2024-05-10T09:54:41.667988+0000","last_unstale":"2024-05-10T09:58:28.017154+0000","last_undegraded":"2024-05-10T09:58:28.017154+0000","last_fullsized":"2024-05-10T09:58:28.017154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.016873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.016873+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.016873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:26:00.261622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.716040+0000","last_change":"2024-05-10T09:58:41.716099+0000","last_active":"2024-05-10T09:58:41.716040+0000","last_peered":"2024-05-10T09:58:41.716040+0000","last_clean":"2024-05-10T09:58:41.716040+0000","last_became_active":"2024-05-10T09:54:33.577717+0000","last_became_peered":"2024-05-10T09:54:33.577717+0000","last_unstale":"2024-05-10T09:58:41.716040+0000","last_undegraded":"2024-05-10T09:58:41.716040+0000","last_fullsized":"2024-05-10T09:58:41.716040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:41.715853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:41.715853+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.715853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:15:33.657830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"110'24","reported_seq":259,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:58.095323+0000","last_change":"2024-05-10T09:58:58.095394+0000","last_active":"2024-05-10T09:58:58.095323+0000","last_peered":"2024-05-10T09:58:58.095323+0000","last_clean":"2024-05-10T09:58:58.095323+0000","last_became_active":"2024-05-10T09:57:09.655381+0000","last_became_peered":"2024-05-10T09:57:09.655381+0000","last_unstale":"2024-05-10T09:58:58.095323+0000","last_undegraded":"2024-05-10T09:58:58.095323+0000","last_fullsized":"2024-05-10T09:58:58.095323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:58.095120+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:58.095120+0000","last_clean_scrub_stamp":"2024-05-10T09:58:58.095120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:01.775995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":45056,"num_write":24,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.398324+0000","last_change":"2024-05-10T09:58:34.398324+0000","last_active":"2024-05-10T09:58:34.398324+0000","last_peered":"2024-05-10T09:58:34.398324+0000","last_clean":"2024-05-10T09:58:34.398324+0000","last_became_active":"2024-05-10T09:54:43.667175+0000","last_became_peered":"2024-05-10T09:54:43.667175+0000","last_unstale":"2024-05-10T09:58:34.398324+0000","last_undegraded":"2024-05-10T09:58:34.398324+0000","last_fullsized":"2024-05-10T09:58:34.398324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.398073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.398073+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.398073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:45.040743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"110'72","reported_seq":327,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.724586+0000","last_change":"2024-05-10T09:58:20.724586+0000","last_active":"2024-05-10T09:58:20.724586+0000","last_peered":"2024-05-10T09:58:20.724586+0000","last_clean":"2024-05-10T09:58:20.724586+0000","last_became_active":"2024-05-10T09:54:45.683369+0000","last_became_peered":"2024-05-10T09:54:45.683369+0000","last_unstale":"2024-05-10T09:58:20.724586+0000","last_undegraded":"2024-05-10T09:58:20.724586+0000","last_fullsized":"2024-05-10T09:58:20.724586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'72","last_scrub_stamp":"2024-05-10T09:58:20.724440+0000","last_deep_scrub":"110'72","last_deep_scrub_stamp":"2024-05-10T09:58:20.724440+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.724440+0000","objects_scrubbed":10,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:04:52.798878+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":112,"num_read_kb":160,"num_write":66,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":177,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.745796+0000","last_change":"2024-05-10T09:58:36.745796+0000","last_active":"2024-05-10T09:58:36.745796+0000","last_peered":"2024-05-10T09:58:36.745796+0000","last_clean":"2024-05-10T09:58:36.745796+0000","last_became_active":"2024-05-10T09:54:47.704507+0000","last_became_peered":"2024-05-10T09:54:47.704507+0000","last_unstale":"2024-05-10T09:58:36.745796+0000","last_undegraded":"2024-05-10T09:58:36.745796+0000","last_fullsized":"2024-05-10T09:58:36.745796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.745543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.745543+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.745543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:15.681407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.616587+0000","last_change":"2024-05-10T09:58:32.616587+0000","last_active":"2024-05-10T09:58:32.616587+0000","last_peered":"2024-05-10T09:58:32.616587+0000","last_clean":"2024-05-10T09:58:32.616587+0000","last_became_active":"2024-05-10T09:54:49.720330+0000","last_became_peered":"2024-05-10T09:54:49.720330+0000","last_unstale":"2024-05-10T09:58:32.616587+0000","last_undegraded":"2024-05-10T09:58:32.616587+0000","last_fullsized":"2024-05-10T09:58:32.616587+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.616326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.616326+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.616326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:52:39.907022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.643943+0000","last_change":"2024-05-10T09:58:33.643943+0000","last_active":"2024-05-10T09:58:33.643943+0000","last_peered":"2024-05-10T09:58:33.643943+0000","last_clean":"2024-05-10T09:58:33.643943+0000","last_became_active":"2024-05-10T09:54:41.665731+0000","last_became_peered":"2024-05-10T09:54:41.665731+0000","last_unstale":"2024-05-10T09:58:33.643943+0000","last_undegraded":"2024-05-10T09:58:33.643943+0000","last_fullsized":"2024-05-10T09:58:33.643943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.643517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.643517+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.643517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:27:52.512387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.521576+0000","last_change":"2024-05-10T09:58:23.521576+0000","last_active":"2024-05-10T09:58:23.521576+0000","last_peered":"2024-05-10T09:58:23.521576+0000","last_clean":"2024-05-10T09:58:23.521576+0000","last_became_active":"2024-05-10T09:54:34.044138+0000","last_became_peered":"2024-05-10T09:54:34.044138+0000","last_unstale":"2024-05-10T09:58:23.521576+0000","last_undegraded":"2024-05-10T09:58:23.521576+0000","last_fullsized":"2024-05-10T09:58:23.521576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.521285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.521285+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.521285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:43:20.909272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"110'16","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.635575+0000","last_change":"2024-05-10T09:58:36.635575+0000","last_active":"2024-05-10T09:58:36.635575+0000","last_peered":"2024-05-10T09:58:36.635575+0000","last_clean":"2024-05-10T09:58:36.635575+0000","last_became_active":"2024-05-10T09:54:39.626977+0000","last_became_peered":"2024-05-10T09:54:39.626977+0000","last_unstale":"2024-05-10T09:58:36.635575+0000","last_undegraded":"2024-05-10T09:58:36.635575+0000","last_fullsized":"2024-05-10T09:58:36.635575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:36.635200+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:36.635200+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.635200+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:21:13.825864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":26636,"num_write":36,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"110'2","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.599358+0000","last_change":"2024-05-10T09:58:20.599358+0000","last_active":"2024-05-10T09:58:20.599358+0000","last_peered":"2024-05-10T09:58:20.599358+0000","last_clean":"2024-05-10T09:58:20.599358+0000","last_became_active":"2024-05-10T09:54:43.669692+0000","last_became_peered":"2024-05-10T09:54:43.669692+0000","last_unstale":"2024-05-10T09:58:20.599358+0000","last_undegraded":"2024-05-10T09:58:20.599358+0000","last_fullsized":"2024-05-10T09:58:20.599358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:20.599197+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:20.599197+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.599197+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:44:49.316485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"110'23","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.747116+0000","last_change":"2024-05-10T09:58:28.747116+0000","last_active":"2024-05-10T09:58:28.747116+0000","last_peered":"2024-05-10T09:58:28.747116+0000","last_clean":"2024-05-10T09:58:28.747116+0000","last_became_active":"2024-05-10T09:54:46.136188+0000","last_became_peered":"2024-05-10T09:54:46.136188+0000","last_unstale":"2024-05-10T09:58:28.747116+0000","last_undegraded":"2024-05-10T09:58:28.747116+0000","last_fullsized":"2024-05-10T09:58:28.747116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'23","last_scrub_stamp":"2024-05-10T09:58:28.746825+0000","last_deep_scrub":"110'23","last_deep_scrub_stamp":"2024-05-10T09:58:28.746825+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.746825+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:29.644819+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:56.129968+0000","last_change":"2024-05-10T09:58:56.129968+0000","last_active":"2024-05-10T09:58:56.129968+0000","last_peered":"2024-05-10T09:58:56.129968+0000","last_clean":"2024-05-10T09:58:56.129968+0000","last_became_active":"2024-05-10T09:57:09.658692+0000","last_became_peered":"2024-05-10T09:57:09.658692+0000","last_unstale":"2024-05-10T09:58:56.129968+0000","last_undegraded":"2024-05-10T09:58:56.129968+0000","last_fullsized":"2024-05-10T09:58:56.129968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:56.129704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:56.129704+0000","last_clean_scrub_stamp":"2024-05-10T09:58:56.129704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:20:45.289616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":179,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:57.640238+0000","last_change":"2024-05-10T09:58:57.640238+0000","last_active":"2024-05-10T09:58:57.640238+0000","last_peered":"2024-05-10T09:58:57.640238+0000","last_clean":"2024-05-10T09:58:57.640238+0000","last_became_active":"2024-05-10T09:57:09.639866+0000","last_became_peered":"2024-05-10T09:57:09.639866+0000","last_unstale":"2024-05-10T09:58:57.640238+0000","last_undegraded":"2024-05-10T09:58:57.640238+0000","last_fullsized":"2024-05-10T09:58:57.640238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:57.639975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:57.639975+0000","last_clean_scrub_stamp":"2024-05-10T09:58:57.639975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:09:30.798737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.680174+0000","last_change":"2024-05-10T09:58:29.680174+0000","last_active":"2024-05-10T09:58:29.680174+0000","last_peered":"2024-05-10T09:58:29.680174+0000","last_clean":"2024-05-10T09:58:29.680174+0000","last_became_active":"2024-05-10T09:54:41.675051+0000","last_became_peered":"2024-05-10T09:54:41.675051+0000","last_unstale":"2024-05-10T09:58:29.680174+0000","last_undegraded":"2024-05-10T09:58:29.680174+0000","last_fullsized":"2024-05-10T09:58:29.680174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.679760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.679760+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.679760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:50.969118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.476257+0000","last_change":"2024-05-10T09:58:44.476257+0000","last_active":"2024-05-10T09:58:44.476257+0000","last_peered":"2024-05-10T09:58:44.476257+0000","last_clean":"2024-05-10T09:58:44.476257+0000","last_became_active":"2024-05-10T09:54:33.578648+0000","last_became_peered":"2024-05-10T09:54:33.578648+0000","last_unstale":"2024-05-10T09:58:44.476257+0000","last_undegraded":"2024-05-10T09:58:44.476257+0000","last_fullsized":"2024-05-10T09:58:44.476257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:44.476009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:44.476009+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.476009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:20:28.251767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"110'16","reported_seq":196,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.103446+0000","last_change":"2024-05-10T09:58:38.103446+0000","last_active":"2024-05-10T09:58:38.103446+0000","last_peered":"2024-05-10T09:58:38.103446+0000","last_clean":"2024-05-10T09:58:38.103446+0000","last_became_active":"2024-05-10T09:57:09.640253+0000","last_became_peered":"2024-05-10T09:57:09.640253+0000","last_unstale":"2024-05-10T09:58:38.103446+0000","last_undegraded":"2024-05-10T09:58:38.103446+0000","last_fullsized":"2024-05-10T09:58:38.103446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:38.103113+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:38.103113+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.103113+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:33:49.490393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24588,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.044073+0000","last_change":"2024-05-10T09:58:33.044073+0000","last_active":"2024-05-10T09:58:33.044073+0000","last_peered":"2024-05-10T09:58:33.044073+0000","last_clean":"2024-05-10T09:58:33.044073+0000","last_became_active":"2024-05-10T09:54:43.666975+0000","last_became_peered":"2024-05-10T09:54:43.666975+0000","last_unstale":"2024-05-10T09:58:33.044073+0000","last_undegraded":"2024-05-10T09:58:33.044073+0000","last_fullsized":"2024-05-10T09:58:33.044073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.043821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.043821+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.043821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:25:57.028856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"110'18","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:58.684694+0000","last_change":"2024-05-10T09:58:58.684694+0000","last_active":"2024-05-10T09:58:58.684694+0000","last_peered":"2024-05-10T09:58:58.684694+0000","last_clean":"2024-05-10T09:58:58.684694+0000","last_became_active":"2024-05-10T09:57:09.648402+0000","last_became_peered":"2024-05-10T09:57:09.648402+0000","last_unstale":"2024-05-10T09:58:58.684694+0000","last_undegraded":"2024-05-10T09:58:58.684694+0000","last_fullsized":"2024-05-10T09:58:58.684694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:58.684402+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:58.684402+0000","last_clean_scrub_stamp":"2024-05-10T09:58:58.684402+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:30:00.174784+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.503767+0000","last_change":"2024-05-10T09:58:23.503767+0000","last_active":"2024-05-10T09:58:23.503767+0000","last_peered":"2024-05-10T09:58:23.503767+0000","last_clean":"2024-05-10T09:58:23.503767+0000","last_became_active":"2024-05-10T09:54:47.712702+0000","last_became_peered":"2024-05-10T09:54:47.712702+0000","last_unstale":"2024-05-10T09:58:23.503767+0000","last_undegraded":"2024-05-10T09:58:23.503767+0000","last_fullsized":"2024-05-10T09:58:23.503767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.503406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.503406+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.503406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:25:14.753078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.410155+0000","last_change":"2024-05-10T09:58:23.410155+0000","last_active":"2024-05-10T09:58:23.410155+0000","last_peered":"2024-05-10T09:58:23.410155+0000","last_clean":"2024-05-10T09:58:23.410155+0000","last_became_active":"2024-05-10T09:54:49.721054+0000","last_became_peered":"2024-05-10T09:54:49.721054+0000","last_unstale":"2024-05-10T09:58:23.410155+0000","last_undegraded":"2024-05-10T09:58:23.410155+0000","last_fullsized":"2024-05-10T09:58:23.410155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.409763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.409763+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.409763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:04.814457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.558647+0000","last_change":"2024-05-10T09:58:40.558647+0000","last_active":"2024-05-10T09:58:40.558647+0000","last_peered":"2024-05-10T09:58:40.558647+0000","last_clean":"2024-05-10T09:58:40.558647+0000","last_became_active":"2024-05-10T09:54:41.665145+0000","last_became_peered":"2024-05-10T09:54:41.665145+0000","last_unstale":"2024-05-10T09:58:40.558647+0000","last_undegraded":"2024-05-10T09:58:40.558647+0000","last_fullsized":"2024-05-10T09:58:40.558647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.558384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.558384+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.558384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:11:39.137697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"110'24","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.471738+0000","last_change":"2024-05-10T09:58:37.471738+0000","last_active":"2024-05-10T09:58:37.471738+0000","last_peered":"2024-05-10T09:58:37.471738+0000","last_clean":"2024-05-10T09:58:37.471738+0000","last_became_active":"2024-05-10T09:54:39.660918+0000","last_became_peered":"2024-05-10T09:54:39.660918+0000","last_unstale":"2024-05-10T09:58:37.471738+0000","last_undegraded":"2024-05-10T09:58:37.471738+0000","last_fullsized":"2024-05-10T09:58:37.471738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:37.471473+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:37.471473+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.471473+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:08.642738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45068,"num_write":44,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.626764+0000","last_change":"2024-05-10T09:58:35.626764+0000","last_active":"2024-05-10T09:58:35.626764+0000","last_peered":"2024-05-10T09:58:35.626764+0000","last_clean":"2024-05-10T09:58:35.626764+0000","last_became_active":"2024-05-10T09:54:34.044153+0000","last_became_peered":"2024-05-10T09:54:34.044153+0000","last_unstale":"2024-05-10T09:58:35.626764+0000","last_undegraded":"2024-05-10T09:58:35.626764+0000","last_fullsized":"2024-05-10T09:58:35.626764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.626500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.626500+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.626500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:27:29.673295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.014960+0000","last_change":"2024-05-10T09:58:29.014960+0000","last_active":"2024-05-10T09:58:29.014960+0000","last_peered":"2024-05-10T09:58:29.014960+0000","last_clean":"2024-05-10T09:58:29.014960+0000","last_became_active":"2024-05-10T09:54:43.655935+0000","last_became_peered":"2024-05-10T09:54:43.655935+0000","last_unstale":"2024-05-10T09:58:29.014960+0000","last_undegraded":"2024-05-10T09:58:29.014960+0000","last_fullsized":"2024-05-10T09:58:29.014960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.014717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.014717+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.014717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:02.246794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"110'42","reported_seq":244,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.137352+0000","last_change":"2024-05-10T09:58:35.137352+0000","last_active":"2024-05-10T09:58:35.137352+0000","last_peered":"2024-05-10T09:58:35.137352+0000","last_clean":"2024-05-10T09:58:35.137352+0000","last_became_active":"2024-05-10T09:54:45.680860+0000","last_became_peered":"2024-05-10T09:54:45.680860+0000","last_unstale":"2024-05-10T09:58:35.137352+0000","last_undegraded":"2024-05-10T09:58:35.137352+0000","last_fullsized":"2024-05-10T09:58:35.137352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'42","last_scrub_stamp":"2024-05-10T09:58:35.137041+0000","last_deep_scrub":"110'42","last_deep_scrub_stamp":"2024-05-10T09:58:35.137041+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.137041+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:07:53.846732+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":82,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:59:02.671570+0000","last_change":"2024-05-10T09:59:02.671632+0000","last_active":"2024-05-10T09:59:02.671570+0000","last_peered":"2024-05-10T09:59:02.671570+0000","last_clean":"2024-05-10T09:59:02.671570+0000","last_became_active":"2024-05-10T09:57:19.675422+0000","last_became_peered":"2024-05-10T09:57:19.675422+0000","last_unstale":"2024-05-10T09:59:02.671570+0000","last_undegraded":"2024-05-10T09:59:02.671570+0000","last_fullsized":"2024-05-10T09:59:02.671570+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:59:02.671375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:59:02.671375+0000","last_clean_scrub_stamp":"2024-05-10T09:59:02.671375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:10:16.042205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.077905+0000","last_change":"2024-05-10T09:58:21.077905+0000","last_active":"2024-05-10T09:58:21.077905+0000","last_peered":"2024-05-10T09:58:21.077905+0000","last_clean":"2024-05-10T09:58:21.077905+0000","last_became_active":"2024-05-10T09:54:49.701045+0000","last_became_peered":"2024-05-10T09:54:49.701045+0000","last_unstale":"2024-05-10T09:58:21.077905+0000","last_undegraded":"2024-05-10T09:58:21.077905+0000","last_fullsized":"2024-05-10T09:58:21.077905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:21.077818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:21.077818+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.077818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:14:37.122527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"89'38","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.085123+0000","last_change":"2024-05-10T09:58:34.085123+0000","last_active":"2024-05-10T09:58:34.085123+0000","last_peered":"2024-05-10T09:58:34.085123+0000","last_clean":"2024-05-10T09:58:34.085123+0000","last_became_active":"2024-05-10T09:54:41.660530+0000","last_became_peered":"2024-05-10T09:54:41.660530+0000","last_unstale":"2024-05-10T09:58:34.085123+0000","last_undegraded":"2024-05-10T09:58:34.085123+0000","last_fullsized":"2024-05-10T09:58:34.085123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:34.084795+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:34.084795+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.084795+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:23.851346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"110'6","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.589873+0000","last_change":"2024-05-10T09:58:38.589873+0000","last_active":"2024-05-10T09:58:38.589873+0000","last_peered":"2024-05-10T09:58:38.589873+0000","last_clean":"2024-05-10T09:58:38.589873+0000","last_became_active":"2024-05-10T09:54:39.632538+0000","last_became_peered":"2024-05-10T09:54:39.632538+0000","last_unstale":"2024-05-10T09:58:38.589873+0000","last_undegraded":"2024-05-10T09:58:38.589873+0000","last_fullsized":"2024-05-10T09:58:38.589873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'6","last_scrub_stamp":"2024-05-10T09:58:38.589615+0000","last_deep_scrub":"110'6","last_deep_scrub_stamp":"2024-05-10T09:58:38.589615+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.589615+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:01:52.298107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":199,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.693571+0000","last_change":"2024-05-10T09:58:42.693571+0000","last_active":"2024-05-10T09:58:42.693571+0000","last_peered":"2024-05-10T09:58:42.693571+0000","last_clean":"2024-05-10T09:58:42.693571+0000","last_became_active":"2024-05-10T09:54:34.044486+0000","last_became_peered":"2024-05-10T09:54:34.044486+0000","last_unstale":"2024-05-10T09:58:42.693571+0000","last_undegraded":"2024-05-10T09:58:42.693571+0000","last_fullsized":"2024-05-10T09:58:42.693571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:42.693198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:42.693198+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.693198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:47.789584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"110'2","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.529614+0000","last_change":"2024-05-10T09:58:28.529614+0000","last_active":"2024-05-10T09:58:28.529614+0000","last_peered":"2024-05-10T09:58:28.529614+0000","last_clean":"2024-05-10T09:58:28.529614+0000","last_became_active":"2024-05-10T09:54:43.656947+0000","last_became_peered":"2024-05-10T09:54:43.656947+0000","last_unstale":"2024-05-10T09:58:28.529614+0000","last_undegraded":"2024-05-10T09:58:28.529614+0000","last_fullsized":"2024-05-10T09:58:28.529614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:28.529340+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:28.529340+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.529340+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:05:49.028373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"110'22","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.705964+0000","last_change":"2024-05-10T09:58:24.705964+0000","last_active":"2024-05-10T09:58:24.705964+0000","last_peered":"2024-05-10T09:58:24.705964+0000","last_clean":"2024-05-10T09:58:24.705964+0000","last_became_active":"2024-05-10T09:54:46.136298+0000","last_became_peered":"2024-05-10T09:54:46.136298+0000","last_unstale":"2024-05-10T09:58:24.705964+0000","last_undegraded":"2024-05-10T09:58:24.705964+0000","last_fullsized":"2024-05-10T09:58:24.705964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:24.705658+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:24.705658+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.705658+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:13:15.819312+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"110'18","reported_seq":233,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.411966+0000","last_change":"2024-05-10T09:58:25.411966+0000","last_active":"2024-05-10T09:58:25.411966+0000","last_peered":"2024-05-10T09:58:25.411966+0000","last_clean":"2024-05-10T09:58:25.411966+0000","last_became_active":"2024-05-10T09:54:47.710135+0000","last_became_peered":"2024-05-10T09:54:47.710135+0000","last_unstale":"2024-05-10T09:58:25.411966+0000","last_undegraded":"2024-05-10T09:58:25.411966+0000","last_fullsized":"2024-05-10T09:58:25.411966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:25.411703+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:25.411703+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.411703+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:38.566132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:56.607266+0000","last_change":"2024-05-10T09:58:56.607266+0000","last_active":"2024-05-10T09:58:56.607266+0000","last_peered":"2024-05-10T09:58:56.607266+0000","last_clean":"2024-05-10T09:58:56.607266+0000","last_became_active":"2024-05-10T09:54:49.735001+0000","last_became_peered":"2024-05-10T09:54:49.735001+0000","last_unstale":"2024-05-10T09:58:56.607266+0000","last_undegraded":"2024-05-10T09:58:56.607266+0000","last_fullsized":"2024-05-10T09:58:56.607266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:56.606852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:56.606852+0000","last_clean_scrub_stamp":"2024-05-10T09:58:56.606852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:59:47.609750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.614034+0000","last_change":"2024-05-10T09:58:40.614034+0000","last_active":"2024-05-10T09:58:40.614034+0000","last_peered":"2024-05-10T09:58:40.614034+0000","last_clean":"2024-05-10T09:58:40.614034+0000","last_became_active":"2024-05-10T09:54:41.661978+0000","last_became_peered":"2024-05-10T09:54:41.661978+0000","last_unstale":"2024-05-10T09:58:40.614034+0000","last_undegraded":"2024-05-10T09:58:40.614034+0000","last_fullsized":"2024-05-10T09:58:40.614034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.613635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.613635+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.613635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:12.114773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"110'20","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.681180+0000","last_change":"2024-05-10T09:58:51.681180+0000","last_active":"2024-05-10T09:58:51.681180+0000","last_peered":"2024-05-10T09:58:51.681180+0000","last_clean":"2024-05-10T09:58:51.681180+0000","last_became_active":"2024-05-10T09:54:39.638551+0000","last_became_peered":"2024-05-10T09:54:39.638551+0000","last_unstale":"2024-05-10T09:58:51.681180+0000","last_undegraded":"2024-05-10T09:58:51.681180+0000","last_fullsized":"2024-05-10T09:58:51.681180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:51.680915+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:51.680915+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.680915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:36:46.521369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.609389+0000","last_change":"2024-05-10T09:58:34.609389+0000","last_active":"2024-05-10T09:58:34.609389+0000","last_peered":"2024-05-10T09:58:34.609389+0000","last_clean":"2024-05-10T09:58:34.609389+0000","last_became_active":"2024-05-10T09:54:33.576998+0000","last_became_peered":"2024-05-10T09:54:33.576998+0000","last_unstale":"2024-05-10T09:58:34.609389+0000","last_undegraded":"2024-05-10T09:58:34.609389+0000","last_fullsized":"2024-05-10T09:58:34.609389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.609126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.609126+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.609126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:34:25.552434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.000271+0000","last_change":"2024-05-10T09:58:27.000271+0000","last_active":"2024-05-10T09:58:27.000271+0000","last_peered":"2024-05-10T09:58:27.000271+0000","last_clean":"2024-05-10T09:58:27.000271+0000","last_became_active":"2024-05-10T09:57:09.649206+0000","last_became_peered":"2024-05-10T09:57:09.649206+0000","last_unstale":"2024-05-10T09:58:27.000271+0000","last_undegraded":"2024-05-10T09:58:27.000271+0000","last_fullsized":"2024-05-10T09:58:27.000271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.000007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.000007+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.000007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:26:25.604303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"110'15","reported_seq":114,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.043029+0000","last_change":"2024-05-10T09:58:30.043029+0000","last_active":"2024-05-10T09:58:30.043029+0000","last_peered":"2024-05-10T09:58:30.043029+0000","last_clean":"2024-05-10T09:58:30.043029+0000","last_became_active":"2024-05-10T09:57:09.655075+0000","last_became_peered":"2024-05-10T09:57:09.655075+0000","last_unstale":"2024-05-10T09:58:30.043029+0000","last_undegraded":"2024-05-10T09:58:30.043029+0000","last_fullsized":"2024-05-10T09:58:30.043029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'15","last_scrub_stamp":"2024-05-10T09:58:30.042782+0000","last_deep_scrub":"110'15","last_deep_scrub_stamp":"2024-05-10T09:58:30.042782+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.042782+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:46:56.239837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"110'18","reported_seq":235,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.661351+0000","last_change":"2024-05-10T09:58:24.661351+0000","last_active":"2024-05-10T09:58:24.661351+0000","last_peered":"2024-05-10T09:58:24.661351+0000","last_clean":"2024-05-10T09:58:24.661351+0000","last_became_active":"2024-05-10T09:54:47.713733+0000","last_became_peered":"2024-05-10T09:54:47.713733+0000","last_unstale":"2024-05-10T09:58:24.661351+0000","last_undegraded":"2024-05-10T09:58:24.661351+0000","last_fullsized":"2024-05-10T09:58:24.661351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.661080+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.661080+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.661080+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:10.798769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"89'8","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.054976+0000","last_change":"2024-05-10T09:58:25.054976+0000","last_active":"2024-05-10T09:58:25.054976+0000","last_peered":"2024-05-10T09:58:25.054976+0000","last_clean":"2024-05-10T09:58:25.054976+0000","last_became_active":"2024-05-10T09:54:49.716736+0000","last_became_peered":"2024-05-10T09:54:49.716736+0000","last_unstale":"2024-05-10T09:58:25.054976+0000","last_undegraded":"2024-05-10T09:58:25.054976+0000","last_fullsized":"2024-05-10T09:58:25.054976+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'8","last_scrub_stamp":"2024-05-10T09:58:25.054516+0000","last_deep_scrub":"89'8","last_deep_scrub_stamp":"2024-05-10T09:58:25.054516+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.054516+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:00.234290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"89'76","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.009453+0000","last_change":"2024-05-10T09:58:23.009453+0000","last_active":"2024-05-10T09:58:23.009453+0000","last_peered":"2024-05-10T09:58:23.009453+0000","last_clean":"2024-05-10T09:58:23.009453+0000","last_became_active":"2024-05-10T09:57:09.640597+0000","last_became_peered":"2024-05-10T09:57:09.640597+0000","last_unstale":"2024-05-10T09:58:23.009453+0000","last_undegraded":"2024-05-10T09:58:23.009453+0000","last_fullsized":"2024-05-10T09:58:23.009453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'76","last_scrub_stamp":"2024-05-10T09:58:23.009098+0000","last_deep_scrub":"89'76","last_deep_scrub_stamp":"2024-05-10T09:58:23.009098+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.009098+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:11:41.058451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":262,"num_read_kb":194,"num_write":112,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":18,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"110'32","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.145555+0000","last_change":"2024-05-10T09:58:47.145555+0000","last_active":"2024-05-10T09:58:47.145555+0000","last_peered":"2024-05-10T09:58:47.145555+0000","last_clean":"2024-05-10T09:58:47.145555+0000","last_became_active":"2024-05-10T09:54:39.636107+0000","last_became_peered":"2024-05-10T09:54:39.636107+0000","last_unstale":"2024-05-10T09:58:47.145555+0000","last_undegraded":"2024-05-10T09:58:47.145555+0000","last_fullsized":"2024-05-10T09:58:47.145555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'32","last_scrub_stamp":"2024-05-10T09:58:47.145102+0000","last_deep_scrub":"110'32","last_deep_scrub_stamp":"2024-05-10T09:58:47.145102+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.145102+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:42.413032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":59422,"num_write":82,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":198,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.607958+0000","last_change":"2024-05-10T09:58:31.607958+0000","last_active":"2024-05-10T09:58:31.607958+0000","last_peered":"2024-05-10T09:58:31.607958+0000","last_clean":"2024-05-10T09:58:31.607958+0000","last_became_active":"2024-05-10T09:54:33.582862+0000","last_became_peered":"2024-05-10T09:54:33.582862+0000","last_unstale":"2024-05-10T09:58:31.607958+0000","last_undegraded":"2024-05-10T09:58:31.607958+0000","last_fullsized":"2024-05-10T09:58:31.607958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.607683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.607683+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.607683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:22:32.505677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:39.594114+0000","last_change":"2024-05-10T09:58:39.594114+0000","last_active":"2024-05-10T09:58:39.594114+0000","last_peered":"2024-05-10T09:58:39.594114+0000","last_clean":"2024-05-10T09:58:39.594114+0000","last_became_active":"2024-05-10T09:54:43.663874+0000","last_became_peered":"2024-05-10T09:54:43.663874+0000","last_unstale":"2024-05-10T09:58:39.594114+0000","last_undegraded":"2024-05-10T09:58:39.594114+0000","last_fullsized":"2024-05-10T09:58:39.594114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:39.593867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:39.593867+0000","last_clean_scrub_stamp":"2024-05-10T09:58:39.593867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:03:42.581485+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"110'52","reported_seq":262,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.745985+0000","last_change":"2024-05-10T09:58:30.745985+0000","last_active":"2024-05-10T09:58:30.745985+0000","last_peered":"2024-05-10T09:58:30.745985+0000","last_clean":"2024-05-10T09:58:30.745985+0000","last_became_active":"2024-05-10T09:54:46.136353+0000","last_became_peered":"2024-05-10T09:54:46.136353+0000","last_unstale":"2024-05-10T09:58:30.745985+0000","last_undegraded":"2024-05-10T09:58:30.745985+0000","last_fullsized":"2024-05-10T09:58:30.745985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'52","last_scrub_stamp":"2024-05-10T09:58:30.745724+0000","last_deep_scrub":"110'52","last_deep_scrub_stamp":"2024-05-10T09:58:30.745724+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.745724+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:32:05.925497+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":86,"num_read_kb":121,"num_write":54,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.674126+0000","last_change":"2024-05-10T09:58:27.674126+0000","last_active":"2024-05-10T09:58:27.674126+0000","last_peered":"2024-05-10T09:58:27.674126+0000","last_clean":"2024-05-10T09:58:27.674126+0000","last_became_active":"2024-05-10T09:54:47.713000+0000","last_became_peered":"2024-05-10T09:54:47.713000+0000","last_unstale":"2024-05-10T09:58:27.674126+0000","last_undegraded":"2024-05-10T09:58:27.674126+0000","last_fullsized":"2024-05-10T09:58:27.674126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.673776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.673776+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.673776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:28.034168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":170,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.650009+0000","last_change":"2024-05-10T09:58:53.650009+0000","last_active":"2024-05-10T09:58:53.650009+0000","last_peered":"2024-05-10T09:58:53.650009+0000","last_clean":"2024-05-10T09:58:53.650009+0000","last_became_active":"2024-05-10T09:54:49.727190+0000","last_became_peered":"2024-05-10T09:54:49.727190+0000","last_unstale":"2024-05-10T09:58:53.650009+0000","last_undegraded":"2024-05-10T09:58:53.650009+0000","last_fullsized":"2024-05-10T09:58:53.650009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:53.649617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:53.649617+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.649617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:49.956967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:55.091205+0000","last_change":"2024-05-10T09:58:55.091205+0000","last_active":"2024-05-10T09:58:55.091205+0000","last_peered":"2024-05-10T09:58:55.091205+0000","last_clean":"2024-05-10T09:58:55.091205+0000","last_became_active":"2024-05-10T09:54:49.728027+0000","last_became_peered":"2024-05-10T09:54:49.728027+0000","last_unstale":"2024-05-10T09:58:55.091205+0000","last_undegraded":"2024-05-10T09:58:55.091205+0000","last_fullsized":"2024-05-10T09:58:55.091205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:55.090945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:55.090945+0000","last_clean_scrub_stamp":"2024-05-10T09:58:55.090945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:29:26.772349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'6","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.988357+0000","last_change":"2024-05-10T09:58:20.988539+0000","last_active":"2024-05-10T09:58:20.988357+0000","last_peered":"2024-05-10T09:58:20.988357+0000","last_clean":"2024-05-10T09:58:20.988357+0000","last_became_active":"2024-05-10T09:57:09.648233+0000","last_became_peered":"2024-05-10T09:57:09.648233+0000","last_unstale":"2024-05-10T09:58:20.988357+0000","last_undegraded":"2024-05-10T09:58:20.988357+0000","last_fullsized":"2024-05-10T09:58:20.988357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:20.988131+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:20.988131+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.988131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:49:29.354050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"110'14","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.968273+0000","last_change":"2024-05-10T09:58:49.968333+0000","last_active":"2024-05-10T09:58:49.968273+0000","last_peered":"2024-05-10T09:58:49.968273+0000","last_clean":"2024-05-10T09:58:49.968273+0000","last_became_active":"2024-05-10T09:57:09.653026+0000","last_became_peered":"2024-05-10T09:57:09.653026+0000","last_unstale":"2024-05-10T09:58:49.968273+0000","last_undegraded":"2024-05-10T09:58:49.968273+0000","last_fullsized":"2024-05-10T09:58:49.968273+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:49.968088+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:49.968088+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.968088+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:10.191282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":182,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:19.706450+0000","last_change":"2024-05-10T09:58:19.706490+0000","last_active":"2024-05-10T09:58:19.706450+0000","last_peered":"2024-05-10T09:58:19.706450+0000","last_clean":"2024-05-10T09:58:19.706450+0000","last_became_active":"2024-05-10T09:54:43.669076+0000","last_became_peered":"2024-05-10T09:54:43.669076+0000","last_unstale":"2024-05-10T09:58:19.706450+0000","last_undegraded":"2024-05-10T09:58:19.706450+0000","last_fullsized":"2024-05-10T09:58:19.706450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:19.706342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:19.706342+0000","last_clean_scrub_stamp":"2024-05-10T09:58:19.706342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:09.648820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"110'25","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.602396+0000","last_change":"2024-05-10T09:58:41.602477+0000","last_active":"2024-05-10T09:58:41.602396+0000","last_peered":"2024-05-10T09:58:41.602396+0000","last_clean":"2024-05-10T09:58:41.602396+0000","last_became_active":"2024-05-10T09:54:45.681383+0000","last_became_peered":"2024-05-10T09:54:45.681383+0000","last_unstale":"2024-05-10T09:58:41.602396+0000","last_undegraded":"2024-05-10T09:58:41.602396+0000","last_fullsized":"2024-05-10T09:58:41.602396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'25","last_scrub_stamp":"2024-05-10T09:58:41.602189+0000","last_deep_scrub":"110'25","last_deep_scrub_stamp":"2024-05-10T09:58:41.602189+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.602189+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:25.227651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":59,"num_write":24,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.640995+0000","last_change":"2024-05-10T09:58:26.641053+0000","last_active":"2024-05-10T09:58:26.640995+0000","last_peered":"2024-05-10T09:58:26.640995+0000","last_clean":"2024-05-10T09:58:26.640995+0000","last_became_active":"2024-05-10T09:54:47.713193+0000","last_became_peered":"2024-05-10T09:54:47.713193+0000","last_unstale":"2024-05-10T09:58:26.640995+0000","last_undegraded":"2024-05-10T09:58:26.640995+0000","last_fullsized":"2024-05-10T09:58:26.640995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.640791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.640791+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.640791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:57:59.872868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"89'6","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.732171+0000","last_change":"2024-05-10T09:58:29.732171+0000","last_active":"2024-05-10T09:58:29.732171+0000","last_peered":"2024-05-10T09:58:29.732171+0000","last_clean":"2024-05-10T09:58:29.732171+0000","last_became_active":"2024-05-10T09:54:49.734549+0000","last_became_peered":"2024-05-10T09:54:49.734549+0000","last_unstale":"2024-05-10T09:58:29.732171+0000","last_undegraded":"2024-05-10T09:58:29.732171+0000","last_fullsized":"2024-05-10T09:58:29.732171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'6","last_scrub_stamp":"2024-05-10T09:58:29.731904+0000","last_deep_scrub":"89'6","last_deep_scrub_stamp":"2024-05-10T09:58:29.731904+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.731904+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:11.897873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":186,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.689257+0000","last_change":"2024-05-10T09:58:23.689402+0000","last_active":"2024-05-10T09:58:23.689257+0000","last_peered":"2024-05-10T09:58:23.689257+0000","last_clean":"2024-05-10T09:58:23.689257+0000","last_became_active":"2024-05-10T09:54:41.683962+0000","last_became_peered":"2024-05-10T09:54:41.683962+0000","last_unstale":"2024-05-10T09:58:23.689257+0000","last_undegraded":"2024-05-10T09:58:23.689257+0000","last_fullsized":"2024-05-10T09:58:23.689257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.688993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.688993+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.688993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:42.872307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"110'18","reported_seq":222,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.647411+0000","last_change":"2024-05-10T09:58:45.647565+0000","last_active":"2024-05-10T09:58:45.647411+0000","last_peered":"2024-05-10T09:58:45.647411+0000","last_clean":"2024-05-10T09:58:45.647411+0000","last_became_active":"2024-05-10T09:54:39.650310+0000","last_became_peered":"2024-05-10T09:54:39.650310+0000","last_unstale":"2024-05-10T09:58:45.647411+0000","last_undegraded":"2024-05-10T09:58:45.647411+0000","last_fullsized":"2024-05-10T09:58:45.647411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:45.647185+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:45.647185+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.647185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:46:04.027102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30738,"num_write":48,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":183,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.701282+0000","last_change":"2024-05-10T09:58:35.701337+0000","last_active":"2024-05-10T09:58:35.701282+0000","last_peered":"2024-05-10T09:58:35.701282+0000","last_clean":"2024-05-10T09:58:35.701282+0000","last_became_active":"2024-05-10T09:54:43.660158+0000","last_became_peered":"2024-05-10T09:54:43.660158+0000","last_unstale":"2024-05-10T09:58:35.701282+0000","last_undegraded":"2024-05-10T09:58:35.701282+0000","last_fullsized":"2024-05-10T09:58:35.701282+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.701084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.701084+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.701084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:06.093005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"110'8","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.121495+0000","last_change":"2024-05-10T09:58:51.121588+0000","last_active":"2024-05-10T09:58:51.121495+0000","last_peered":"2024-05-10T09:58:51.121495+0000","last_clean":"2024-05-10T09:58:51.121495+0000","last_became_active":"2024-05-10T09:54:45.689277+0000","last_became_peered":"2024-05-10T09:54:45.689277+0000","last_unstale":"2024-05-10T09:58:51.121495+0000","last_undegraded":"2024-05-10T09:58:51.121495+0000","last_fullsized":"2024-05-10T09:58:51.121495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'8","last_scrub_stamp":"2024-05-10T09:58:51.121305+0000","last_deep_scrub":"110'8","last_deep_scrub_stamp":"2024-05-10T09:58:51.121305+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.121305+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:37.464780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":176,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.779870+0000","last_change":"2024-05-10T09:58:38.779932+0000","last_active":"2024-05-10T09:58:38.779870+0000","last_peered":"2024-05-10T09:58:38.779870+0000","last_clean":"2024-05-10T09:58:38.779870+0000","last_became_active":"2024-05-10T09:54:47.707124+0000","last_became_peered":"2024-05-10T09:54:47.707124+0000","last_unstale":"2024-05-10T09:58:38.779870+0000","last_undegraded":"2024-05-10T09:58:38.779870+0000","last_fullsized":"2024-05-10T09:58:38.779870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.779652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.779652+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.779652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:02.764687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.141988+0000","last_change":"2024-05-10T09:58:52.142048+0000","last_active":"2024-05-10T09:58:52.141988+0000","last_peered":"2024-05-10T09:58:52.141988+0000","last_clean":"2024-05-10T09:58:52.141988+0000","last_became_active":"2024-05-10T09:54:49.718397+0000","last_became_peered":"2024-05-10T09:54:49.718397+0000","last_unstale":"2024-05-10T09:58:52.141988+0000","last_undegraded":"2024-05-10T09:58:52.141988+0000","last_fullsized":"2024-05-10T09:58:52.141988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:52.141780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:52.141780+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.141780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:07.754287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"75'2","reported_seq":192,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.650996+0000","last_change":"2024-05-10T09:58:34.651060+0000","last_active":"2024-05-10T09:58:34.650996+0000","last_peered":"2024-05-10T09:58:34.650996+0000","last_clean":"2024-05-10T09:58:34.650996+0000","last_became_active":"2024-05-10T09:54:41.671646+0000","last_became_peered":"2024-05-10T09:54:41.671646+0000","last_unstale":"2024-05-10T09:58:34.650996+0000","last_undegraded":"2024-05-10T09:58:34.650996+0000","last_fullsized":"2024-05-10T09:58:34.650996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:34.650791+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:34.650791+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.650791+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:39.747177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"110'14","reported_seq":212,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.564700+0000","last_change":"2024-05-10T09:58:46.564770+0000","last_active":"2024-05-10T09:58:46.564700+0000","last_peered":"2024-05-10T09:58:46.564700+0000","last_clean":"2024-05-10T09:58:46.564700+0000","last_became_active":"2024-05-10T09:54:39.652727+0000","last_became_peered":"2024-05-10T09:54:39.652727+0000","last_unstale":"2024-05-10T09:58:46.564700+0000","last_undegraded":"2024-05-10T09:58:46.564700+0000","last_fullsized":"2024-05-10T09:58:46.564700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:46.564513+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:46.564513+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.564513+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:49:04.782078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.748488+0000","last_change":"2024-05-10T09:58:50.748540+0000","last_active":"2024-05-10T09:58:50.748488+0000","last_peered":"2024-05-10T09:58:50.748488+0000","last_clean":"2024-05-10T09:58:50.748488+0000","last_became_active":"2024-05-10T09:57:09.645852+0000","last_became_peered":"2024-05-10T09:57:09.645852+0000","last_unstale":"2024-05-10T09:58:50.748488+0000","last_undegraded":"2024-05-10T09:58:50.748488+0000","last_fullsized":"2024-05-10T09:58:50.748488+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:50.748291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:50.748291+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.748291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:09.583528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"110'26","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.632786+0000","last_change":"2024-05-10T09:58:43.632862+0000","last_active":"2024-05-10T09:58:43.632786+0000","last_peered":"2024-05-10T09:58:43.632786+0000","last_clean":"2024-05-10T09:58:43.632786+0000","last_became_active":"2024-05-10T09:54:45.681151+0000","last_became_peered":"2024-05-10T09:54:45.681151+0000","last_unstale":"2024-05-10T09:58:43.632786+0000","last_undegraded":"2024-05-10T09:58:43.632786+0000","last_fullsized":"2024-05-10T09:58:43.632786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'26","last_scrub_stamp":"2024-05-10T09:58:43.632592+0000","last_deep_scrub":"110'26","last_deep_scrub_stamp":"2024-05-10T09:58:43.632592+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.632592+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:36.235541+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":64,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.476233+0000","last_change":"2024-05-10T09:58:22.476288+0000","last_active":"2024-05-10T09:58:22.476233+0000","last_peered":"2024-05-10T09:58:22.476233+0000","last_clean":"2024-05-10T09:58:22.476233+0000","last_became_active":"2024-05-10T09:54:47.712400+0000","last_became_peered":"2024-05-10T09:54:47.712400+0000","last_unstale":"2024-05-10T09:58:22.476233+0000","last_undegraded":"2024-05-10T09:58:22.476233+0000","last_fullsized":"2024-05-10T09:58:22.476233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.476038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.476038+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.476038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:15:37.420373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.421141+0000","last_change":"2024-05-10T09:58:22.421194+0000","last_active":"2024-05-10T09:58:22.421141+0000","last_peered":"2024-05-10T09:58:22.421141+0000","last_clean":"2024-05-10T09:58:22.421141+0000","last_became_active":"2024-05-10T09:54:49.725559+0000","last_became_peered":"2024-05-10T09:54:49.725559+0000","last_unstale":"2024-05-10T09:58:22.421141+0000","last_undegraded":"2024-05-10T09:58:22.421141+0000","last_fullsized":"2024-05-10T09:58:22.421141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.420950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.420950+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.420950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:01.544851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:36.670336+0000","last_change":"2024-05-10T09:58:36.670390+0000","last_active":"2024-05-10T09:58:36.670336+0000","last_peered":"2024-05-10T09:58:36.670336+0000","last_clean":"2024-05-10T09:58:36.670336+0000","last_became_active":"2024-05-10T09:54:41.665699+0000","last_became_peered":"2024-05-10T09:54:41.665699+0000","last_unstale":"2024-05-10T09:58:36.670336+0000","last_undegraded":"2024-05-10T09:58:36.670336+0000","last_fullsized":"2024-05-10T09:58:36.670336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:36.670113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:36.670113+0000","last_clean_scrub_stamp":"2024-05-10T09:58:36.670113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:46.633988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"110'22","reported_seq":227,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.128670+0000","last_change":"2024-05-10T09:58:49.128849+0000","last_active":"2024-05-10T09:58:49.128670+0000","last_peered":"2024-05-10T09:58:49.128670+0000","last_clean":"2024-05-10T09:58:49.128670+0000","last_became_active":"2024-05-10T09:54:39.664023+0000","last_became_peered":"2024-05-10T09:54:39.664023+0000","last_unstale":"2024-05-10T09:58:49.128670+0000","last_undegraded":"2024-05-10T09:58:49.128670+0000","last_fullsized":"2024-05-10T09:58:49.128670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:49.128399+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:49.128399+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.128399+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:39.544121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40978,"num_write":52,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":190,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.554527+0000","last_change":"2024-05-10T09:58:41.554674+0000","last_active":"2024-05-10T09:58:41.554527+0000","last_peered":"2024-05-10T09:58:41.554527+0000","last_clean":"2024-05-10T09:58:41.554527+0000","last_became_active":"2024-05-10T09:57:09.666940+0000","last_became_peered":"2024-05-10T09:57:09.666940+0000","last_unstale":"2024-05-10T09:58:41.554527+0000","last_undegraded":"2024-05-10T09:58:41.554527+0000","last_fullsized":"2024-05-10T09:58:41.554527+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:41.554296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:41.554296+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.554296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:26:05.539331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"110'22","reported_seq":213,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.728359+0000","last_change":"2024-05-10T09:58:26.728434+0000","last_active":"2024-05-10T09:58:26.728359+0000","last_peered":"2024-05-10T09:58:26.728359+0000","last_clean":"2024-05-10T09:58:26.728359+0000","last_became_active":"2024-05-10T09:54:45.683655+0000","last_became_peered":"2024-05-10T09:54:45.683655+0000","last_unstale":"2024-05-10T09:58:26.728359+0000","last_undegraded":"2024-05-10T09:58:26.728359+0000","last_fullsized":"2024-05-10T09:58:26.728359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:26.728132+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:26.728132+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.728132+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:51.928098+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.105498+0000","last_change":"2024-05-10T09:58:20.105557+0000","last_active":"2024-05-10T09:58:20.105498+0000","last_peered":"2024-05-10T09:58:20.105498+0000","last_clean":"2024-05-10T09:58:20.105498+0000","last_became_active":"2024-05-10T09:54:47.703566+0000","last_became_peered":"2024-05-10T09:54:47.703566+0000","last_unstale":"2024-05-10T09:58:20.105498+0000","last_undegraded":"2024-05-10T09:58:20.105498+0000","last_fullsized":"2024-05-10T09:58:20.105498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:20.105310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:20.105310+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.105310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:31:59.229211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.552151+0000","last_change":"2024-05-10T09:58:38.552151+0000","last_active":"2024-05-10T09:58:38.552151+0000","last_peered":"2024-05-10T09:58:38.552151+0000","last_clean":"2024-05-10T09:58:38.552151+0000","last_became_active":"2024-05-10T09:54:41.667788+0000","last_became_peered":"2024-05-10T09:54:41.667788+0000","last_unstale":"2024-05-10T09:58:38.552151+0000","last_undegraded":"2024-05-10T09:58:38.552151+0000","last_fullsized":"2024-05-10T09:58:38.552151+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.551899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.551899+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.551899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:38.912291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"110'10","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.611974+0000","last_change":"2024-05-10T09:58:48.612048+0000","last_active":"2024-05-10T09:58:48.611974+0000","last_peered":"2024-05-10T09:58:48.611974+0000","last_clean":"2024-05-10T09:58:48.611974+0000","last_became_active":"2024-05-10T09:54:39.625531+0000","last_became_peered":"2024-05-10T09:54:39.625531+0000","last_unstale":"2024-05-10T09:58:48.611974+0000","last_undegraded":"2024-05-10T09:58:48.611974+0000","last_fullsized":"2024-05-10T09:58:48.611974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-05-10T09:58:48.611766+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-05-10T09:58:48.611766+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.611766+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:34.955241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18444,"num_write":30,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.071356+0000","last_change":"2024-05-10T09:58:31.071356+0000","last_active":"2024-05-10T09:58:31.071356+0000","last_peered":"2024-05-10T09:58:31.071356+0000","last_clean":"2024-05-10T09:58:31.071356+0000","last_became_active":"2024-05-10T09:54:43.660914+0000","last_became_peered":"2024-05-10T09:54:43.660914+0000","last_unstale":"2024-05-10T09:58:31.071356+0000","last_undegraded":"2024-05-10T09:58:31.071356+0000","last_fullsized":"2024-05-10T09:58:31.071356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.071107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.071107+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.071107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:10.006971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"110'32","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.716239+0000","last_change":"2024-05-10T09:58:22.716326+0000","last_active":"2024-05-10T09:58:22.716239+0000","last_peered":"2024-05-10T09:58:22.716239+0000","last_clean":"2024-05-10T09:58:22.716239+0000","last_became_active":"2024-05-10T09:54:45.686365+0000","last_became_peered":"2024-05-10T09:54:45.686365+0000","last_unstale":"2024-05-10T09:58:22.716239+0000","last_undegraded":"2024-05-10T09:58:22.716239+0000","last_fullsized":"2024-05-10T09:58:22.716239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'32","last_scrub_stamp":"2024-05-10T09:58:22.716035+0000","last_deep_scrub":"110'32","last_deep_scrub_stamp":"2024-05-10T09:58:22.716035+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.716035+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:00:50.706433+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":69,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":173,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.390291+0000","last_change":"2024-05-10T09:58:24.390348+0000","last_active":"2024-05-10T09:58:24.390291+0000","last_peered":"2024-05-10T09:58:24.390291+0000","last_clean":"2024-05-10T09:58:24.390291+0000","last_became_active":"2024-05-10T09:54:47.719334+0000","last_became_peered":"2024-05-10T09:54:47.719334+0000","last_unstale":"2024-05-10T09:58:24.390291+0000","last_undegraded":"2024-05-10T09:58:24.390291+0000","last_fullsized":"2024-05-10T09:58:24.390291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.390096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.390096+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.390096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:03.262178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"75'2","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.608033+0000","last_change":"2024-05-10T09:58:21.608055+0000","last_active":"2024-05-10T09:58:21.608033+0000","last_peered":"2024-05-10T09:58:21.608033+0000","last_clean":"2024-05-10T09:58:21.608033+0000","last_became_active":"2024-05-10T09:54:49.720736+0000","last_became_peered":"2024-05-10T09:54:49.720736+0000","last_unstale":"2024-05-10T09:58:21.608033+0000","last_undegraded":"2024-05-10T09:58:21.608033+0000","last_fullsized":"2024-05-10T09:58:21.608033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:21.607964+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:21.607964+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.607964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:19.930647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.079643+0000","last_change":"2024-05-10T09:58:32.079643+0000","last_active":"2024-05-10T09:58:32.079643+0000","last_peered":"2024-05-10T09:58:32.079643+0000","last_clean":"2024-05-10T09:58:32.079643+0000","last_became_active":"2024-05-10T09:54:41.664157+0000","last_became_peered":"2024-05-10T09:54:41.664157+0000","last_unstale":"2024-05-10T09:58:32.079643+0000","last_undegraded":"2024-05-10T09:58:32.079643+0000","last_fullsized":"2024-05-10T09:58:32.079643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.079384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.079384+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.079384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:14.245352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"110'20","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.456529+0000","last_change":"2024-05-10T09:58:45.456594+0000","last_active":"2024-05-10T09:58:45.456529+0000","last_peered":"2024-05-10T09:58:45.456529+0000","last_clean":"2024-05-10T09:58:45.456529+0000","last_became_active":"2024-05-10T09:55:19.367256+0000","last_became_peered":"2024-05-10T09:55:19.367256+0000","last_unstale":"2024-05-10T09:58:45.456529+0000","last_undegraded":"2024-05-10T09:58:45.456529+0000","last_fullsized":"2024-05-10T09:58:45.456529+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:45.456329+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:45.456329+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.456329+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:55:25.251726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30726,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"110'2","reported_seq":204,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.557292+0000","last_change":"2024-05-10T09:58:40.557292+0000","last_active":"2024-05-10T09:58:40.557292+0000","last_peered":"2024-05-10T09:58:40.557292+0000","last_clean":"2024-05-10T09:58:40.557292+0000","last_became_active":"2024-05-10T09:57:09.664748+0000","last_became_peered":"2024-05-10T09:57:09.664748+0000","last_unstale":"2024-05-10T09:58:40.557292+0000","last_undegraded":"2024-05-10T09:58:40.557292+0000","last_fullsized":"2024-05-10T09:58:40.557292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:40.557001+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:40.557001+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.557001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:22.722969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"110'31","reported_seq":225,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.675531+0000","last_change":"2024-05-10T09:58:24.675582+0000","last_active":"2024-05-10T09:58:24.675531+0000","last_peered":"2024-05-10T09:58:24.675531+0000","last_clean":"2024-05-10T09:58:24.675531+0000","last_became_active":"2024-05-10T09:54:45.682134+0000","last_became_peered":"2024-05-10T09:54:45.682134+0000","last_unstale":"2024-05-10T09:58:24.675531+0000","last_undegraded":"2024-05-10T09:58:24.675531+0000","last_fullsized":"2024-05-10T09:58:24.675531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'31","last_scrub_stamp":"2024-05-10T09:58:24.675424+0000","last_deep_scrub":"110'31","last_deep_scrub_stamp":"2024-05-10T09:58:24.675424+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.675424+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:31:27.905528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":63,"num_write":28,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":174,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.713237+0000","last_change":"2024-05-10T09:58:28.713292+0000","last_active":"2024-05-10T09:58:28.713237+0000","last_peered":"2024-05-10T09:58:28.713237+0000","last_clean":"2024-05-10T09:58:28.713237+0000","last_became_active":"2024-05-10T09:54:47.708474+0000","last_became_peered":"2024-05-10T09:54:47.708474+0000","last_unstale":"2024-05-10T09:58:28.713237+0000","last_undegraded":"2024-05-10T09:58:28.713237+0000","last_fullsized":"2024-05-10T09:58:28.713237+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:28.713029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:28.713029+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.713029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:53.020340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:29.528431+0000","last_change":"2024-05-10T09:58:29.528483+0000","last_active":"2024-05-10T09:58:29.528431+0000","last_peered":"2024-05-10T09:58:29.528431+0000","last_clean":"2024-05-10T09:58:29.528431+0000","last_became_active":"2024-05-10T09:54:49.725813+0000","last_became_peered":"2024-05-10T09:54:49.725813+0000","last_unstale":"2024-05-10T09:58:29.528431+0000","last_undegraded":"2024-05-10T09:58:29.528431+0000","last_fullsized":"2024-05-10T09:58:29.528431+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:29.528245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:29.528245+0000","last_clean_scrub_stamp":"2024-05-10T09:58:29.528245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:07:54.728210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"75'10","reported_seq":200,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.735264+0000","last_change":"2024-05-10T09:58:31.735333+0000","last_active":"2024-05-10T09:58:31.735264+0000","last_peered":"2024-05-10T09:58:31.735264+0000","last_clean":"2024-05-10T09:58:31.735264+0000","last_became_active":"2024-05-10T09:54:41.677466+0000","last_became_peered":"2024-05-10T09:54:41.677466+0000","last_unstale":"2024-05-10T09:58:31.735264+0000","last_undegraded":"2024-05-10T09:58:31.735264+0000","last_fullsized":"2024-05-10T09:58:31.735264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-05-10T09:58:31.735058+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-05-10T09:58:31.735058+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.735058+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:09:21.501609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"110'12","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:53.942997+0000","last_change":"2024-05-10T09:58:53.943157+0000","last_active":"2024-05-10T09:58:53.942997+0000","last_peered":"2024-05-10T09:58:53.942997+0000","last_clean":"2024-05-10T09:58:53.942997+0000","last_became_active":"2024-05-10T09:57:09.652551+0000","last_became_peered":"2024-05-10T09:57:09.652551+0000","last_unstale":"2024-05-10T09:58:53.942997+0000","last_undegraded":"2024-05-10T09:58:53.942997+0000","last_fullsized":"2024-05-10T09:58:53.942997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:53.942741+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:53.942741+0000","last_clean_scrub_stamp":"2024-05-10T09:58:53.942741+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:40:11.550170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18438,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.973297+0000","last_change":"2024-05-10T09:58:45.973401+0000","last_active":"2024-05-10T09:58:45.973297+0000","last_peered":"2024-05-10T09:58:45.973297+0000","last_clean":"2024-05-10T09:58:45.973297+0000","last_became_active":"2024-05-10T09:57:09.636787+0000","last_became_peered":"2024-05-10T09:57:09.636787+0000","last_unstale":"2024-05-10T09:58:45.973297+0000","last_undegraded":"2024-05-10T09:58:45.973297+0000","last_fullsized":"2024-05-10T09:58:45.973297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:45.973061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:45.973061+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.973061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:32:22.508700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"110'24","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.723424+0000","last_change":"2024-05-10T09:58:28.723424+0000","last_active":"2024-05-10T09:58:28.723424+0000","last_peered":"2024-05-10T09:58:28.723424+0000","last_clean":"2024-05-10T09:58:28.723424+0000","last_became_active":"2024-05-10T09:54:46.136121+0000","last_became_peered":"2024-05-10T09:54:46.136121+0000","last_unstale":"2024-05-10T09:58:28.723424+0000","last_undegraded":"2024-05-10T09:58:28.723424+0000","last_fullsized":"2024-05-10T09:58:28.723424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:58:28.723147+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:58:28.723147+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.723147+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:11:07.659011+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":62,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:30.630755+0000","last_change":"2024-05-10T09:58:30.630755+0000","last_active":"2024-05-10T09:58:30.630755+0000","last_peered":"2024-05-10T09:58:30.630755+0000","last_clean":"2024-05-10T09:58:30.630755+0000","last_became_active":"2024-05-10T09:54:47.714536+0000","last_became_peered":"2024-05-10T09:54:47.714536+0000","last_unstale":"2024-05-10T09:58:30.630755+0000","last_undegraded":"2024-05-10T09:58:30.630755+0000","last_fullsized":"2024-05-10T09:58:30.630755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:30.630484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:30.630484+0000","last_clean_scrub_stamp":"2024-05-10T09:58:30.630484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:54:23.219778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":169,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.459856+0000","last_change":"2024-05-10T09:58:26.459909+0000","last_active":"2024-05-10T09:58:26.459856+0000","last_peered":"2024-05-10T09:58:26.459856+0000","last_clean":"2024-05-10T09:58:26.459856+0000","last_became_active":"2024-05-10T09:54:49.725593+0000","last_became_peered":"2024-05-10T09:54:49.725593+0000","last_unstale":"2024-05-10T09:58:26.459856+0000","last_undegraded":"2024-05-10T09:58:26.459856+0000","last_fullsized":"2024-05-10T09:58:26.459856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.459654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.459654+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.459654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:24.782336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"89'38","reported_seq":229,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.470197+0000","last_change":"2024-05-10T09:58:28.470258+0000","last_active":"2024-05-10T09:58:28.470197+0000","last_peered":"2024-05-10T09:58:28.470197+0000","last_clean":"2024-05-10T09:58:28.470197+0000","last_became_active":"2024-05-10T09:54:41.680849+0000","last_became_peered":"2024-05-10T09:54:41.680849+0000","last_unstale":"2024-05-10T09:58:28.470197+0000","last_undegraded":"2024-05-10T09:58:28.470197+0000","last_fullsized":"2024-05-10T09:58:28.470197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'38","last_scrub_stamp":"2024-05-10T09:58:28.469996+0000","last_deep_scrub":"89'38","last_deep_scrub_stamp":"2024-05-10T09:58:28.469996+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.469996+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:13:12.438475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"110'20","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:57.140988+0000","last_change":"2024-05-10T09:58:57.141056+0000","last_active":"2024-05-10T09:58:57.140988+0000","last_peered":"2024-05-10T09:58:57.140988+0000","last_clean":"2024-05-10T09:58:57.140988+0000","last_became_active":"2024-05-10T09:57:09.640285+0000","last_became_peered":"2024-05-10T09:57:09.640285+0000","last_unstale":"2024-05-10T09:58:57.140988+0000","last_undegraded":"2024-05-10T09:58:57.140988+0000","last_fullsized":"2024-05-10T09:58:57.140988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:57.140745+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:57.140745+0000","last_clean_scrub_stamp":"2024-05-10T09:58:57.140745+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:29.926098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.370050+0000","last_change":"2024-05-10T09:58:47.370108+0000","last_active":"2024-05-10T09:58:47.370050+0000","last_peered":"2024-05-10T09:58:47.370050+0000","last_clean":"2024-05-10T09:58:47.370050+0000","last_became_active":"2024-05-10T09:57:09.650776+0000","last_became_peered":"2024-05-10T09:57:09.650776+0000","last_unstale":"2024-05-10T09:58:47.370050+0000","last_undegraded":"2024-05-10T09:58:47.370050+0000","last_fullsized":"2024-05-10T09:58:47.370050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:47.369840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:47.369840+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.369840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:01:54.339387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"110'17","reported_seq":119,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.962213+0000","last_change":"2024-05-10T09:58:48.962213+0000","last_active":"2024-05-10T09:58:48.962213+0000","last_peered":"2024-05-10T09:58:48.962213+0000","last_clean":"2024-05-10T09:58:48.962213+0000","last_became_active":"2024-05-10T09:57:09.641134+0000","last_became_peered":"2024-05-10T09:57:09.641134+0000","last_unstale":"2024-05-10T09:58:48.962213+0000","last_undegraded":"2024-05-10T09:58:48.962213+0000","last_fullsized":"2024-05-10T09:58:48.962213+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'17","last_scrub_stamp":"2024-05-10T09:58:48.961943+0000","last_deep_scrub":"110'17","last_deep_scrub_stamp":"2024-05-10T09:58:48.961943+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.961943+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:42:32.123870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":16,"num_read_kb":11,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":858,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"110'21","reported_seq":250,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.474153+0000","last_change":"2024-05-10T09:58:46.474153+0000","last_active":"2024-05-10T09:58:46.474153+0000","last_peered":"2024-05-10T09:58:46.474153+0000","last_clean":"2024-05-10T09:58:46.474153+0000","last_became_active":"2024-05-10T09:57:09.667983+0000","last_became_peered":"2024-05-10T09:57:09.667983+0000","last_unstale":"2024-05-10T09:58:46.474153+0000","last_undegraded":"2024-05-10T09:58:46.474153+0000","last_fullsized":"2024-05-10T09:58:46.474153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'21","last_scrub_stamp":"2024-05-10T09:58:46.473899+0000","last_deep_scrub":"110'21","last_deep_scrub_stamp":"2024-05-10T09:58:46.473899+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.473899+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:51:16.865819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:23.683081+0000","last_change":"2024-05-10T09:58:23.683137+0000","last_active":"2024-05-10T09:58:23.683081+0000","last_peered":"2024-05-10T09:58:23.683081+0000","last_clean":"2024-05-10T09:58:23.683081+0000","last_became_active":"2024-05-10T09:54:49.723080+0000","last_became_peered":"2024-05-10T09:54:49.723080+0000","last_unstale":"2024-05-10T09:58:23.683081+0000","last_undegraded":"2024-05-10T09:58:23.683081+0000","last_fullsized":"2024-05-10T09:58:23.683081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:23.682883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:23.682883+0000","last_clean_scrub_stamp":"2024-05-10T09:58:23.682883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:45:39.213976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":140,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.412673+0000","last_change":"2024-05-10T09:58:46.412731+0000","last_active":"2024-05-10T09:58:46.412673+0000","last_peered":"2024-05-10T09:58:46.412673+0000","last_clean":"2024-05-10T09:58:46.412673+0000","last_became_active":"2024-05-10T09:55:33.433580+0000","last_became_peered":"2024-05-10T09:55:33.433580+0000","last_unstale":"2024-05-10T09:58:46.412673+0000","last_undegraded":"2024-05-10T09:58:46.412673+0000","last_fullsized":"2024-05-10T09:58:46.412673+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:46.412476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:46.412476+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.412476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:24:45.076722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"110'12","reported_seq":230,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:59.624188+0000","last_change":"2024-05-10T09:58:59.624254+0000","last_active":"2024-05-10T09:58:59.624188+0000","last_peered":"2024-05-10T09:58:59.624188+0000","last_clean":"2024-05-10T09:58:59.624188+0000","last_became_active":"2024-05-10T09:57:09.666579+0000","last_became_peered":"2024-05-10T09:57:09.666579+0000","last_unstale":"2024-05-10T09:58:59.624188+0000","last_undegraded":"2024-05-10T09:58:59.624188+0000","last_fullsized":"2024-05-10T09:58:59.624188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:59.623976+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:59.623976+0000","last_clean_scrub_stamp":"2024-05-10T09:58:59.623976+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:29:03.304851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":18450,"num_write":42,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":191,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.717888+0000","last_change":"2024-05-10T09:58:51.717997+0000","last_active":"2024-05-10T09:58:51.717888+0000","last_peered":"2024-05-10T09:58:51.717888+0000","last_clean":"2024-05-10T09:58:51.717888+0000","last_became_active":"2024-05-10T09:57:09.658756+0000","last_became_peered":"2024-05-10T09:57:09.658756+0000","last_unstale":"2024-05-10T09:58:51.717888+0000","last_undegraded":"2024-05-10T09:58:51.717888+0000","last_fullsized":"2024-05-10T09:58:51.717888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:51.717671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:51.717671+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.717671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:11:44.320620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"110'30","reported_seq":221,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.619079+0000","last_change":"2024-05-10T09:58:52.619156+0000","last_active":"2024-05-10T09:58:52.619079+0000","last_peered":"2024-05-10T09:58:52.619079+0000","last_clean":"2024-05-10T09:58:52.619079+0000","last_became_active":"2024-05-10T09:54:45.682137+0000","last_became_peered":"2024-05-10T09:54:45.682137+0000","last_unstale":"2024-05-10T09:58:52.619079+0000","last_undegraded":"2024-05-10T09:58:52.619079+0000","last_fullsized":"2024-05-10T09:58:52.619079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'30","last_scrub_stamp":"2024-05-10T09:58:52.618888+0000","last_deep_scrub":"110'30","last_deep_scrub_stamp":"2024-05-10T09:58:52.618888+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.618888+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:53:38.962363+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.041935+0000","last_change":"2024-05-10T09:58:22.041957+0000","last_active":"2024-05-10T09:58:22.041935+0000","last_peered":"2024-05-10T09:58:22.041935+0000","last_clean":"2024-05-10T09:58:22.041935+0000","last_became_active":"2024-05-10T09:54:47.702653+0000","last_became_peered":"2024-05-10T09:54:47.702653+0000","last_unstale":"2024-05-10T09:58:22.041935+0000","last_undegraded":"2024-05-10T09:58:22.041935+0000","last_fullsized":"2024-05-10T09:58:22.041935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.041837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.041837+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.041837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:38:24.798814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.749521+0000","last_change":"2024-05-10T09:58:49.749607+0000","last_active":"2024-05-10T09:58:49.749521+0000","last_peered":"2024-05-10T09:58:49.749521+0000","last_clean":"2024-05-10T09:58:49.749521+0000","last_became_active":"2024-05-10T09:54:49.730252+0000","last_became_peered":"2024-05-10T09:54:49.730252+0000","last_unstale":"2024-05-10T09:58:49.749521+0000","last_undegraded":"2024-05-10T09:58:49.749521+0000","last_fullsized":"2024-05-10T09:58:49.749521+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-05-10T09:58:49.749315+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-05-10T09:58:49.749315+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.749315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:47:33.374777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"75'6","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:51.944727+0000","last_change":"2024-05-10T09:58:51.944788+0000","last_active":"2024-05-10T09:58:51.944727+0000","last_peered":"2024-05-10T09:58:51.944727+0000","last_clean":"2024-05-10T09:58:51.944727+0000","last_became_active":"2024-05-10T09:57:09.648979+0000","last_became_peered":"2024-05-10T09:57:09.648979+0000","last_unstale":"2024-05-10T09:58:51.944727+0000","last_undegraded":"2024-05-10T09:58:51.944727+0000","last_fullsized":"2024-05-10T09:58:51.944727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-05-10T09:58:51.944530+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-05-10T09:58:51.944530+0000","last_clean_scrub_stamp":"2024-05-10T09:58:51.944530+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:30:10.954153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"110'16","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:58.656965+0000","last_change":"2024-05-10T09:58:58.657032+0000","last_active":"2024-05-10T09:58:58.656965+0000","last_peered":"2024-05-10T09:58:58.656965+0000","last_clean":"2024-05-10T09:58:58.656965+0000","last_became_active":"2024-05-10T09:57:09.650558+0000","last_became_peered":"2024-05-10T09:57:09.650558+0000","last_unstale":"2024-05-10T09:58:58.656965+0000","last_undegraded":"2024-05-10T09:58:58.656965+0000","last_fullsized":"2024-05-10T09:58:58.656965+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:58.656764+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:58.656764+0000","last_clean_scrub_stamp":"2024-05-10T09:58:58.656764+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:09:31.442117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":22534,"num_write":26,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:38.422349+0000","last_change":"2024-05-10T09:58:38.422404+0000","last_active":"2024-05-10T09:58:38.422349+0000","last_peered":"2024-05-10T09:58:38.422349+0000","last_clean":"2024-05-10T09:58:38.422349+0000","last_became_active":"2024-05-10T09:54:43.673074+0000","last_became_peered":"2024-05-10T09:54:43.673074+0000","last_unstale":"2024-05-10T09:58:38.422349+0000","last_undegraded":"2024-05-10T09:58:38.422349+0000","last_fullsized":"2024-05-10T09:58:38.422349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:38.422156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:38.422156+0000","last_clean_scrub_stamp":"2024-05-10T09:58:38.422156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:10.491394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"110'21","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.147381+0000","last_change":"2024-05-10T09:58:37.147550+0000","last_active":"2024-05-10T09:58:37.147381+0000","last_peered":"2024-05-10T09:58:37.147381+0000","last_clean":"2024-05-10T09:58:37.147381+0000","last_became_active":"2024-05-10T09:54:45.681802+0000","last_became_peered":"2024-05-10T09:54:45.681802+0000","last_unstale":"2024-05-10T09:58:37.147381+0000","last_undegraded":"2024-05-10T09:58:37.147381+0000","last_fullsized":"2024-05-10T09:58:37.147381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'21","last_scrub_stamp":"2024-05-10T09:58:37.147106+0000","last_deep_scrub":"110'21","last_deep_scrub_stamp":"2024-05-10T09:58:37.147106+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.147106+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:42.243492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.454339+0000","last_change":"2024-05-10T09:58:24.454466+0000","last_active":"2024-05-10T09:58:24.454339+0000","last_peered":"2024-05-10T09:58:24.454339+0000","last_clean":"2024-05-10T09:58:24.454339+0000","last_became_active":"2024-05-10T09:54:47.704205+0000","last_became_peered":"2024-05-10T09:54:47.704205+0000","last_unstale":"2024-05-10T09:58:24.454339+0000","last_undegraded":"2024-05-10T09:58:24.454339+0000","last_fullsized":"2024-05-10T09:58:24.454339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.454065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.454065+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.454065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:56:15.614108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:20.607649+0000","last_change":"2024-05-10T09:58:20.607669+0000","last_active":"2024-05-10T09:58:20.607649+0000","last_peered":"2024-05-10T09:58:20.607649+0000","last_clean":"2024-05-10T09:58:20.607649+0000","last_became_active":"2024-05-10T09:54:49.720636+0000","last_became_peered":"2024-05-10T09:54:49.720636+0000","last_unstale":"2024-05-10T09:58:20.607649+0000","last_undegraded":"2024-05-10T09:58:20.607649+0000","last_fullsized":"2024-05-10T09:58:20.607649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:20.607571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:20.607571+0000","last_clean_scrub_stamp":"2024-05-10T09:58:20.607571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:27:33.762000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:46.573966+0000","last_change":"2024-05-10T09:58:46.574025+0000","last_active":"2024-05-10T09:58:46.573966+0000","last_peered":"2024-05-10T09:58:46.573966+0000","last_clean":"2024-05-10T09:58:46.573966+0000","last_became_active":"2024-05-10T09:54:41.652999+0000","last_became_peered":"2024-05-10T09:54:41.652999+0000","last_unstale":"2024-05-10T09:58:46.573966+0000","last_undegraded":"2024-05-10T09:58:46.573966+0000","last_fullsized":"2024-05-10T09:58:46.573966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:46.573730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:46.573730+0000","last_clean_scrub_stamp":"2024-05-10T09:58:46.573730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:10:09.903308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"110'12","reported_seq":211,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:52.662352+0000","last_change":"2024-05-10T09:58:52.662514+0000","last_active":"2024-05-10T09:58:52.662352+0000","last_peered":"2024-05-10T09:58:52.662352+0000","last_clean":"2024-05-10T09:58:52.662352+0000","last_became_active":"2024-05-10T09:54:39.642973+0000","last_became_peered":"2024-05-10T09:54:39.642973+0000","last_unstale":"2024-05-10T09:58:52.662352+0000","last_undegraded":"2024-05-10T09:58:52.662352+0000","last_fullsized":"2024-05-10T09:58:52.662352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:52.662123+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:52.662123+0000","last_clean_scrub_stamp":"2024-05-10T09:58:52.662123+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:58:58.046277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":22,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":165,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.105522+0000","last_change":"2024-05-10T09:58:37.105575+0000","last_active":"2024-05-10T09:58:37.105522+0000","last_peered":"2024-05-10T09:58:37.105522+0000","last_clean":"2024-05-10T09:58:37.105522+0000","last_became_active":"2024-05-10T09:57:09.642061+0000","last_became_peered":"2024-05-10T09:57:09.642061+0000","last_unstale":"2024-05-10T09:58:37.105522+0000","last_undegraded":"2024-05-10T09:58:37.105522+0000","last_fullsized":"2024-05-10T09:58:37.105522+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.105327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.105327+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.105327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:57:10.396266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"110'14","reported_seq":202,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:55.575243+0000","last_change":"2024-05-10T09:58:55.575404+0000","last_active":"2024-05-10T09:58:55.575243+0000","last_peered":"2024-05-10T09:58:55.575243+0000","last_clean":"2024-05-10T09:58:55.575243+0000","last_became_active":"2024-05-10T09:54:45.686723+0000","last_became_peered":"2024-05-10T09:54:45.686723+0000","last_unstale":"2024-05-10T09:58:55.575243+0000","last_undegraded":"2024-05-10T09:58:55.575243+0000","last_fullsized":"2024-05-10T09:58:55.575243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'14","last_scrub_stamp":"2024-05-10T09:58:55.575001+0000","last_deep_scrub":"110'14","last_deep_scrub_stamp":"2024-05-10T09:58:55.575001+0000","last_clean_scrub_stamp":"2024-05-10T09:58:55.575001+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:11:09.194524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.091628+0000","last_change":"2024-05-10T09:58:32.091683+0000","last_active":"2024-05-10T09:58:32.091628+0000","last_peered":"2024-05-10T09:58:32.091628+0000","last_clean":"2024-05-10T09:58:32.091628+0000","last_became_active":"2024-05-10T09:57:09.657071+0000","last_became_peered":"2024-05-10T09:57:09.657071+0000","last_unstale":"2024-05-10T09:58:32.091628+0000","last_undegraded":"2024-05-10T09:58:32.091628+0000","last_fullsized":"2024-05-10T09:58:32.091628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:32.091410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:32.091410+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.091410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:01:06.375141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":172,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:22.686251+0000","last_change":"2024-05-10T09:58:22.686310+0000","last_active":"2024-05-10T09:58:22.686251+0000","last_peered":"2024-05-10T09:58:22.686251+0000","last_clean":"2024-05-10T09:58:22.686251+0000","last_became_active":"2024-05-10T09:54:49.724689+0000","last_became_peered":"2024-05-10T09:54:49.724689+0000","last_unstale":"2024-05-10T09:58:22.686251+0000","last_undegraded":"2024-05-10T09:58:22.686251+0000","last_fullsized":"2024-05-10T09:58:22.686251+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:22.686046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:22.686046+0000","last_clean_scrub_stamp":"2024-05-10T09:58:22.686046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:24.576447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.071568+0000","last_change":"2024-05-10T09:58:42.071627+0000","last_active":"2024-05-10T09:58:42.071568+0000","last_peered":"2024-05-10T09:58:42.071568+0000","last_clean":"2024-05-10T09:58:42.071568+0000","last_became_active":"2024-05-10T09:57:09.640395+0000","last_became_peered":"2024-05-10T09:57:09.640395+0000","last_unstale":"2024-05-10T09:58:42.071568+0000","last_undegraded":"2024-05-10T09:58:42.071568+0000","last_fullsized":"2024-05-10T09:58:42.071568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:42.071324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:42.071324+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.071324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:17:10.041225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"110'22","reported_seq":228,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.132576+0000","last_change":"2024-05-10T09:58:50.132576+0000","last_active":"2024-05-10T09:58:50.132576+0000","last_peered":"2024-05-10T09:58:50.132576+0000","last_clean":"2024-05-10T09:58:50.132576+0000","last_became_active":"2024-05-10T09:54:39.664972+0000","last_became_peered":"2024-05-10T09:54:39.664972+0000","last_unstale":"2024-05-10T09:58:50.132576+0000","last_undegraded":"2024-05-10T09:58:50.132576+0000","last_fullsized":"2024-05-10T09:58:50.132576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:50.132281+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:50.132281+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.132281+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:05:12.617242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"110'2","reported_seq":184,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:21.683364+0000","last_change":"2024-05-10T09:58:21.683429+0000","last_active":"2024-05-10T09:58:21.683364+0000","last_peered":"2024-05-10T09:58:21.683364+0000","last_clean":"2024-05-10T09:58:21.683364+0000","last_became_active":"2024-05-10T09:54:43.667977+0000","last_became_peered":"2024-05-10T09:54:43.667977+0000","last_unstale":"2024-05-10T09:58:21.683364+0000","last_undegraded":"2024-05-10T09:58:21.683364+0000","last_fullsized":"2024-05-10T09:58:21.683364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'2","last_scrub_stamp":"2024-05-10T09:58:21.683174+0000","last_deep_scrub":"110'2","last_deep_scrub_stamp":"2024-05-10T09:58:21.683174+0000","last_clean_scrub_stamp":"2024-05-10T09:58:21.683174+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:56:30.907539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"110'22","reported_seq":128,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:54.985833+0000","last_change":"2024-05-10T09:58:54.986013+0000","last_active":"2024-05-10T09:58:54.985833+0000","last_peered":"2024-05-10T09:58:54.985833+0000","last_clean":"2024-05-10T09:58:54.985833+0000","last_became_active":"2024-05-10T09:57:09.656110+0000","last_became_peered":"2024-05-10T09:57:09.656110+0000","last_unstale":"2024-05-10T09:58:54.985833+0000","last_undegraded":"2024-05-10T09:58:54.985833+0000","last_fullsized":"2024-05-10T09:58:54.985833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:54.985599+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:54.985599+0000","last_clean_scrub_stamp":"2024-05-10T09:58:54.985599+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:58:40.562929+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":49,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":5712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:26.042614+0000","last_change":"2024-05-10T09:58:26.042680+0000","last_active":"2024-05-10T09:58:26.042614+0000","last_peered":"2024-05-10T09:58:26.042614+0000","last_clean":"2024-05-10T09:58:26.042614+0000","last_became_active":"2024-05-10T09:54:47.692044+0000","last_became_peered":"2024-05-10T09:54:47.692044+0000","last_unstale":"2024-05-10T09:58:26.042614+0000","last_undegraded":"2024-05-10T09:58:26.042614+0000","last_fullsized":"2024-05-10T09:58:26.042614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:26.042401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:26.042401+0000","last_clean_scrub_stamp":"2024-05-10T09:58:26.042401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:18:57.235776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":81,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:31.069925+0000","last_change":"2024-05-10T09:58:31.069979+0000","last_active":"2024-05-10T09:58:31.069925+0000","last_peered":"2024-05-10T09:58:31.069925+0000","last_clean":"2024-05-10T09:58:31.069925+0000","last_became_active":"2024-05-10T09:57:09.643092+0000","last_became_peered":"2024-05-10T09:57:09.643092+0000","last_unstale":"2024-05-10T09:58:31.069925+0000","last_undegraded":"2024-05-10T09:58:31.069925+0000","last_fullsized":"2024-05-10T09:58:31.069925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:31.069713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:31.069713+0000","last_clean_scrub_stamp":"2024-05-10T09:58:31.069713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:19:05.240073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.703976+0000","last_change":"2024-05-10T09:58:25.703976+0000","last_active":"2024-05-10T09:58:25.703976+0000","last_peered":"2024-05-10T09:58:25.703976+0000","last_clean":"2024-05-10T09:58:25.703976+0000","last_became_active":"2024-05-10T09:54:41.675671+0000","last_became_peered":"2024-05-10T09:54:41.675671+0000","last_unstale":"2024-05-10T09:58:25.703976+0000","last_undegraded":"2024-05-10T09:58:25.703976+0000","last_fullsized":"2024-05-10T09:58:25.703976+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.703686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.703686+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.703686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:49:42.256271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"110'16","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.593721+0000","last_change":"2024-05-10T09:58:34.593721+0000","last_active":"2024-05-10T09:58:34.593721+0000","last_peered":"2024-05-10T09:58:34.593721+0000","last_clean":"2024-05-10T09:58:34.593721+0000","last_became_active":"2024-05-10T09:54:39.633619+0000","last_became_peered":"2024-05-10T09:54:39.633619+0000","last_unstale":"2024-05-10T09:58:34.593721+0000","last_undegraded":"2024-05-10T09:58:34.593721+0000","last_fullsized":"2024-05-10T09:58:34.593721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:34.593437+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:34.593437+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.593437+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:19:05.786811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24588,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.533048+0000","last_change":"2024-05-10T09:58:41.533048+0000","last_active":"2024-05-10T09:58:41.533048+0000","last_peered":"2024-05-10T09:58:41.533048+0000","last_clean":"2024-05-10T09:58:41.533048+0000","last_became_active":"2024-05-10T09:54:41.665095+0000","last_became_peered":"2024-05-10T09:54:41.665095+0000","last_unstale":"2024-05-10T09:58:41.533048+0000","last_undegraded":"2024-05-10T09:58:41.533048+0000","last_fullsized":"2024-05-10T09:58:41.533048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:41.532788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:41.532788+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.532788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:50:36.865661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"110'22","reported_seq":234,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.496484+0000","last_change":"2024-05-10T09:58:34.496484+0000","last_active":"2024-05-10T09:58:34.496484+0000","last_peered":"2024-05-10T09:58:34.496484+0000","last_clean":"2024-05-10T09:58:34.496484+0000","last_became_active":"2024-05-10T09:55:19.370214+0000","last_became_peered":"2024-05-10T09:55:19.370214+0000","last_unstale":"2024-05-10T09:58:34.496484+0000","last_undegraded":"2024-05-10T09:58:34.496484+0000","last_fullsized":"2024-05-10T09:58:34.496484+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:34.496200+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:34.496200+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.496200+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:11:47.885674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"89'34","reported_seq":223,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:28.476375+0000","last_change":"2024-05-10T09:58:28.476375+0000","last_active":"2024-05-10T09:58:28.476375+0000","last_peered":"2024-05-10T09:58:28.476375+0000","last_clean":"2024-05-10T09:58:28.476375+0000","last_became_active":"2024-05-10T09:54:41.673173+0000","last_became_peered":"2024-05-10T09:54:41.673173+0000","last_unstale":"2024-05-10T09:58:28.476375+0000","last_undegraded":"2024-05-10T09:58:28.476375+0000","last_fullsized":"2024-05-10T09:58:28.476375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"89'34","last_scrub_stamp":"2024-05-10T09:58:28.476111+0000","last_deep_scrub":"89'34","last_deep_scrub_stamp":"2024-05-10T09:58:28.476111+0000","last_clean_scrub_stamp":"2024-05-10T09:58:28.476111+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:45:17.045359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"110'12","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:50.578951+0000","last_change":"2024-05-10T09:58:50.579124+0000","last_active":"2024-05-10T09:58:50.578951+0000","last_peered":"2024-05-10T09:58:50.578951+0000","last_clean":"2024-05-10T09:58:50.578951+0000","last_became_active":"2024-05-10T09:54:39.660056+0000","last_became_peered":"2024-05-10T09:54:39.660056+0000","last_unstale":"2024-05-10T09:58:50.578951+0000","last_undegraded":"2024-05-10T09:58:50.578951+0000","last_fullsized":"2024-05-10T09:58:50.578951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'12","last_scrub_stamp":"2024-05-10T09:58:50.578711+0000","last_deep_scrub":"110'12","last_deep_scrub_stamp":"2024-05-10T09:58:50.578711+0000","last_clean_scrub_stamp":"2024-05-10T09:58:50.578711+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:45:40.994433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.720873+0000","last_change":"2024-05-10T09:58:27.720873+0000","last_active":"2024-05-10T09:58:27.720873+0000","last_peered":"2024-05-10T09:58:27.720873+0000","last_clean":"2024-05-10T09:58:27.720873+0000","last_became_active":"2024-05-10T09:54:41.675250+0000","last_became_peered":"2024-05-10T09:54:41.675250+0000","last_unstale":"2024-05-10T09:58:27.720873+0000","last_undegraded":"2024-05-10T09:58:27.720873+0000","last_fullsized":"2024-05-10T09:58:27.720873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.720599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.720599+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.720599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:05.163347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"110'38","reported_seq":251,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:43.170829+0000","last_change":"2024-05-10T09:58:43.170829+0000","last_active":"2024-05-10T09:58:43.170829+0000","last_peered":"2024-05-10T09:58:43.170829+0000","last_clean":"2024-05-10T09:58:43.170829+0000","last_became_active":"2024-05-10T09:54:39.625350+0000","last_became_peered":"2024-05-10T09:54:39.625350+0000","last_unstale":"2024-05-10T09:58:43.170829+0000","last_undegraded":"2024-05-10T09:58:43.170829+0000","last_fullsized":"2024-05-10T09:58:43.170829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'38","last_scrub_stamp":"2024-05-10T09:58:43.170697+0000","last_deep_scrub":"110'38","last_deep_scrub_stamp":"2024-05-10T09:58:43.170697+0000","last_clean_scrub_stamp":"2024-05-10T09:58:43.170697+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:13:14.671834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":71692,"num_write":58,"num_write_kb":71680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"75'12","reported_seq":206,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.638091+0000","last_change":"2024-05-10T09:58:42.638091+0000","last_active":"2024-05-10T09:58:42.638091+0000","last_peered":"2024-05-10T09:58:42.638091+0000","last_clean":"2024-05-10T09:58:42.638091+0000","last_became_active":"2024-05-10T09:54:41.661353+0000","last_became_peered":"2024-05-10T09:54:41.661353+0000","last_unstale":"2024-05-10T09:58:42.638091+0000","last_undegraded":"2024-05-10T09:58:42.638091+0000","last_fullsized":"2024-05-10T09:58:42.638091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'12","last_scrub_stamp":"2024-05-10T09:58:42.637726+0000","last_deep_scrub":"75'12","last_deep_scrub_stamp":"2024-05-10T09:58:42.637726+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.637726+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:02:01.472964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"110'8","reported_seq":219,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:59:01.639612+0000","last_change":"2024-05-10T09:59:01.639759+0000","last_active":"2024-05-10T09:59:01.639612+0000","last_peered":"2024-05-10T09:59:01.639612+0000","last_clean":"2024-05-10T09:59:01.639612+0000","last_became_active":"2024-05-10T09:57:09.661466+0000","last_became_peered":"2024-05-10T09:57:09.661466+0000","last_unstale":"2024-05-10T09:59:01.639612+0000","last_undegraded":"2024-05-10T09:59:01.639612+0000","last_fullsized":"2024-05-10T09:59:01.639612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'8","last_scrub_stamp":"2024-05-10T09:59:01.639347+0000","last_deep_scrub":"110'8","last_deep_scrub_stamp":"2024-05-10T09:59:01.639347+0000","last_clean_scrub_stamp":"2024-05-10T09:59:01.639347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:54:06.943248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14342,"num_write":18,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":6291456,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":167,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.029008+0000","last_change":"2024-05-10T09:58:24.029008+0000","last_active":"2024-05-10T09:58:24.029008+0000","last_peered":"2024-05-10T09:58:24.029008+0000","last_clean":"2024-05-10T09:58:24.029008+0000","last_became_active":"2024-05-10T09:57:09.635284+0000","last_became_peered":"2024-05-10T09:57:09.635284+0000","last_unstale":"2024-05-10T09:58:24.029008+0000","last_undegraded":"2024-05-10T09:58:24.029008+0000","last_fullsized":"2024-05-10T09:58:24.029008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:24.028735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:24.028735+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.028735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:30:00.155236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"110'16","reported_seq":215,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.639083+0000","last_change":"2024-05-10T09:58:37.639083+0000","last_active":"2024-05-10T09:58:37.639083+0000","last_peered":"2024-05-10T09:58:37.639083+0000","last_clean":"2024-05-10T09:58:37.639083+0000","last_became_active":"2024-05-10T09:54:39.632042+0000","last_became_peered":"2024-05-10T09:54:39.632042+0000","last_unstale":"2024-05-10T09:58:37.639083+0000","last_undegraded":"2024-05-10T09:58:37.639083+0000","last_fullsized":"2024-05-10T09:58:37.639083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:37.638729+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:37.638729+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.638729+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:35:44.710395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":30720,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":154,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.476011+0000","last_change":"2024-05-10T09:58:33.476072+0000","last_active":"2024-05-10T09:58:33.476011+0000","last_peered":"2024-05-10T09:58:33.476011+0000","last_clean":"2024-05-10T09:58:33.476011+0000","last_became_active":"2024-05-10T09:55:19.368174+0000","last_became_peered":"2024-05-10T09:55:19.368174+0000","last_unstale":"2024-05-10T09:58:33.476011+0000","last_undegraded":"2024-05-10T09:58:33.476011+0000","last_fullsized":"2024-05-10T09:58:33.476011+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.475811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.475811+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.475811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:22:31.453235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"110'10","reported_seq":208,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:32.572560+0000","last_change":"2024-05-10T09:58:32.572560+0000","last_active":"2024-05-10T09:58:32.572560+0000","last_peered":"2024-05-10T09:58:32.572560+0000","last_clean":"2024-05-10T09:58:32.572560+0000","last_became_active":"2024-05-10T09:54:39.632632+0000","last_became_peered":"2024-05-10T09:54:39.632632+0000","last_unstale":"2024-05-10T09:58:32.572560+0000","last_undegraded":"2024-05-10T09:58:32.572560+0000","last_fullsized":"2024-05-10T09:58:32.572560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'10","last_scrub_stamp":"2024-05-10T09:58:32.572302+0000","last_deep_scrub":"110'10","last_deep_scrub_stamp":"2024-05-10T09:58:32.572302+0000","last_clean_scrub_stamp":"2024-05-10T09:58:32.572302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:31:30.894984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.587318+0000","last_change":"2024-05-10T09:58:37.587318+0000","last_active":"2024-05-10T09:58:37.587318+0000","last_peered":"2024-05-10T09:58:37.587318+0000","last_clean":"2024-05-10T09:58:37.587318+0000","last_became_active":"2024-05-10T09:54:41.656346+0000","last_became_peered":"2024-05-10T09:54:41.656346+0000","last_unstale":"2024-05-10T09:58:37.587318+0000","last_undegraded":"2024-05-10T09:58:37.587318+0000","last_fullsized":"2024-05-10T09:58:37.587318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.587062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.587062+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.587062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:58:10.819139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"110'20","reported_seq":249,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:59.638284+0000","last_change":"2024-05-10T09:58:59.638284+0000","last_active":"2024-05-10T09:58:59.638284+0000","last_peered":"2024-05-10T09:58:59.638284+0000","last_clean":"2024-05-10T09:58:59.638284+0000","last_became_active":"2024-05-10T09:57:09.632112+0000","last_became_peered":"2024-05-10T09:57:09.632112+0000","last_unstale":"2024-05-10T09:58:59.638284+0000","last_undegraded":"2024-05-10T09:58:59.638284+0000","last_fullsized":"2024-05-10T09:58:59.638284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:59.638025+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:59.638025+0000","last_clean_scrub_stamp":"2024-05-10T09:58:59.638025+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:45:15.106007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36870,"num_write":30,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:42.123041+0000","last_change":"2024-05-10T09:58:42.123110+0000","last_active":"2024-05-10T09:58:42.123041+0000","last_peered":"2024-05-10T09:58:42.123041+0000","last_clean":"2024-05-10T09:58:42.123041+0000","last_became_active":"2024-05-10T09:54:41.656051+0000","last_became_peered":"2024-05-10T09:54:41.656051+0000","last_unstale":"2024-05-10T09:58:42.123041+0000","last_undegraded":"2024-05-10T09:58:42.123041+0000","last_fullsized":"2024-05-10T09:58:42.123041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:42.122829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:42.122829+0000","last_clean_scrub_stamp":"2024-05-10T09:58:42.122829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:47:50.219194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"110'18","reported_seq":218,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:47.535577+0000","last_change":"2024-05-10T09:58:47.535577+0000","last_active":"2024-05-10T09:58:47.535577+0000","last_peered":"2024-05-10T09:58:47.535577+0000","last_clean":"2024-05-10T09:58:47.535577+0000","last_became_active":"2024-05-10T09:54:39.653208+0000","last_became_peered":"2024-05-10T09:54:39.653208+0000","last_unstale":"2024-05-10T09:58:47.535577+0000","last_undegraded":"2024-05-10T09:58:47.535577+0000","last_fullsized":"2024-05-10T09:58:47.535577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:47.535285+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:47.535285+0000","last_clean_scrub_stamp":"2024-05-10T09:58:47.535285+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T19:39:17.013192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":36870,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:25.993944+0000","last_change":"2024-05-10T09:58:25.994051+0000","last_active":"2024-05-10T09:58:25.993944+0000","last_peered":"2024-05-10T09:58:25.993944+0000","last_clean":"2024-05-10T09:58:25.993944+0000","last_became_active":"2024-05-10T09:57:09.654783+0000","last_became_peered":"2024-05-10T09:57:09.654783+0000","last_unstale":"2024-05-10T09:58:25.993944+0000","last_undegraded":"2024-05-10T09:58:25.993944+0000","last_fullsized":"2024-05-10T09:58:25.993944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:25.993717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:25.993717+0000","last_clean_scrub_stamp":"2024-05-10T09:58:25.993717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:33:27.219541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"110'24","reported_seq":261,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:59:00.669774+0000","last_change":"2024-05-10T09:59:00.669774+0000","last_active":"2024-05-10T09:59:00.669774+0000","last_peered":"2024-05-10T09:59:00.669774+0000","last_clean":"2024-05-10T09:59:00.669774+0000","last_became_active":"2024-05-10T09:57:09.660854+0000","last_became_peered":"2024-05-10T09:57:09.660854+0000","last_unstale":"2024-05-10T09:59:00.669774+0000","last_undegraded":"2024-05-10T09:59:00.669774+0000","last_fullsized":"2024-05-10T09:59:00.669774+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'24","last_scrub_stamp":"2024-05-10T09:59:00.669496+0000","last_deep_scrub":"110'24","last_deep_scrub_stamp":"2024-05-10T09:59:00.669496+0000","last_clean_scrub_stamp":"2024-05-10T09:59:00.669496+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:23:28.592156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":45080,"num_write":64,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.496620+0000","last_change":"2024-05-10T09:58:27.496620+0000","last_active":"2024-05-10T09:58:27.496620+0000","last_peered":"2024-05-10T09:58:27.496620+0000","last_clean":"2024-05-10T09:58:27.496620+0000","last_became_active":"2024-05-10T09:54:41.667895+0000","last_became_peered":"2024-05-10T09:54:41.667895+0000","last_unstale":"2024-05-10T09:58:27.496620+0000","last_undegraded":"2024-05-10T09:58:27.496620+0000","last_fullsized":"2024-05-10T09:58:27.496620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:27.496364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:27.496364+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.496364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:42.146854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"110'16","reported_seq":216,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:41.439256+0000","last_change":"2024-05-10T09:58:41.439256+0000","last_active":"2024-05-10T09:58:41.439256+0000","last_peered":"2024-05-10T09:58:41.439256+0000","last_clean":"2024-05-10T09:58:41.439256+0000","last_became_active":"2024-05-10T09:54:39.664712+0000","last_became_peered":"2024-05-10T09:54:39.664712+0000","last_unstale":"2024-05-10T09:58:41.439256+0000","last_undegraded":"2024-05-10T09:58:41.439256+0000","last_fullsized":"2024-05-10T09:58:41.439256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:41.438979+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:41.438979+0000","last_clean_scrub_stamp":"2024-05-10T09:58:41.438979+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:59.818896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32780,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":166,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:34.088448+0000","last_change":"2024-05-10T09:58:34.088518+0000","last_active":"2024-05-10T09:58:34.088448+0000","last_peered":"2024-05-10T09:58:34.088448+0000","last_clean":"2024-05-10T09:58:34.088448+0000","last_became_active":"2024-05-10T09:57:09.656366+0000","last_became_peered":"2024-05-10T09:57:09.656366+0000","last_unstale":"2024-05-10T09:58:34.088448+0000","last_undegraded":"2024-05-10T09:58:34.088448+0000","last_fullsized":"2024-05-10T09:58:34.088448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:34.088162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:34.088162+0000","last_clean_scrub_stamp":"2024-05-10T09:58:34.088162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:12:44.874236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"110'16","reported_seq":217,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.167115+0000","last_change":"2024-05-10T09:58:48.167115+0000","last_active":"2024-05-10T09:58:48.167115+0000","last_peered":"2024-05-10T09:58:48.167115+0000","last_clean":"2024-05-10T09:58:48.167115+0000","last_became_active":"2024-05-10T09:54:39.638317+0000","last_became_peered":"2024-05-10T09:54:39.638317+0000","last_unstale":"2024-05-10T09:58:48.167115+0000","last_undegraded":"2024-05-10T09:58:48.167115+0000","last_fullsized":"2024-05-10T09:58:48.167115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:48.166818+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:48.166818+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.166818+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:19.554420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:37.788309+0000","last_change":"2024-05-10T09:58:37.788309+0000","last_active":"2024-05-10T09:58:37.788309+0000","last_peered":"2024-05-10T09:58:37.788309+0000","last_clean":"2024-05-10T09:58:37.788309+0000","last_became_active":"2024-05-10T09:54:41.664039+0000","last_became_peered":"2024-05-10T09:54:41.664039+0000","last_unstale":"2024-05-10T09:58:37.788309+0000","last_undegraded":"2024-05-10T09:58:37.788309+0000","last_fullsized":"2024-05-10T09:58:37.788309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:37.788055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:37.788055+0000","last_clean_scrub_stamp":"2024-05-10T09:58:37.788055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:44:19.954023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"110'22","reported_seq":254,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:45.494296+0000","last_change":"2024-05-10T09:58:45.494296+0000","last_active":"2024-05-10T09:58:45.494296+0000","last_peered":"2024-05-10T09:58:45.494296+0000","last_clean":"2024-05-10T09:58:45.494296+0000","last_became_active":"2024-05-10T09:57:09.665972+0000","last_became_peered":"2024-05-10T09:57:09.665972+0000","last_unstale":"2024-05-10T09:58:45.494296+0000","last_undegraded":"2024-05-10T09:58:45.494296+0000","last_fullsized":"2024-05-10T09:58:45.494296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:45.494047+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:45.494047+0000","last_clean_scrub_stamp":"2024-05-10T09:58:45.494047+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:44:50.590433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":36880,"num_write":52,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"75'10","reported_seq":201,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:27.025701+0000","last_change":"2024-05-10T09:58:27.025701+0000","last_active":"2024-05-10T09:58:27.025701+0000","last_peered":"2024-05-10T09:58:27.025701+0000","last_clean":"2024-05-10T09:58:27.025701+0000","last_became_active":"2024-05-10T09:54:41.680496+0000","last_became_peered":"2024-05-10T09:54:41.680496+0000","last_unstale":"2024-05-10T09:58:27.025701+0000","last_undegraded":"2024-05-10T09:58:27.025701+0000","last_fullsized":"2024-05-10T09:58:27.025701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'10","last_scrub_stamp":"2024-05-10T09:58:27.025433+0000","last_deep_scrub":"75'10","last_deep_scrub_stamp":"2024-05-10T09:58:27.025433+0000","last_clean_scrub_stamp":"2024-05-10T09:58:27.025433+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:36:13.163122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"110'20","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.685446+0000","last_change":"2024-05-10T09:58:44.685446+0000","last_active":"2024-05-10T09:58:44.685446+0000","last_peered":"2024-05-10T09:58:44.685446+0000","last_clean":"2024-05-10T09:58:44.685446+0000","last_became_active":"2024-05-10T09:54:39.648979+0000","last_became_peered":"2024-05-10T09:54:39.648979+0000","last_unstale":"2024-05-10T09:58:44.685446+0000","last_undegraded":"2024-05-10T09:58:44.685446+0000","last_fullsized":"2024-05-10T09:58:44.685446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'20","last_scrub_stamp":"2024-05-10T09:58:44.685186+0000","last_deep_scrub":"110'20","last_deep_scrub_stamp":"2024-05-10T09:58:44.685186+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.685186+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T20:56:54.649061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":34834,"num_write":50,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":188,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:44.580951+0000","last_change":"2024-05-10T09:58:44.580951+0000","last_active":"2024-05-10T09:58:44.580951+0000","last_peered":"2024-05-10T09:58:44.580951+0000","last_clean":"2024-05-10T09:58:44.580951+0000","last_became_active":"2024-05-10T09:54:41.656164+0000","last_became_peered":"2024-05-10T09:54:41.656164+0000","last_unstale":"2024-05-10T09:58:44.580951+0000","last_undegraded":"2024-05-10T09:58:44.580951+0000","last_fullsized":"2024-05-10T09:58:44.580951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:44.580684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:44.580684+0000","last_clean_scrub_stamp":"2024-05-10T09:58:44.580684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:26.783285+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"110'18","reported_seq":220,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:24.501561+0000","last_change":"2024-05-10T09:58:24.501561+0000","last_active":"2024-05-10T09:58:24.501561+0000","last_peered":"2024-05-10T09:58:24.501561+0000","last_clean":"2024-05-10T09:58:24.501561+0000","last_became_active":"2024-05-10T09:54:39.643024+0000","last_became_peered":"2024-05-10T09:54:39.643024+0000","last_unstale":"2024-05-10T09:58:24.501561+0000","last_undegraded":"2024-05-10T09:58:24.501561+0000","last_fullsized":"2024-05-10T09:58:24.501561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'18","last_scrub_stamp":"2024-05-10T09:58:24.501285+0000","last_deep_scrub":"110'18","last_deep_scrub_stamp":"2024-05-10T09:58:24.501285+0000","last_clean_scrub_stamp":"2024-05-10T09:58:24.501285+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:56:14.059384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":36864,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:35.753173+0000","last_change":"2024-05-10T09:58:35.753173+0000","last_active":"2024-05-10T09:58:35.753173+0000","last_peered":"2024-05-10T09:58:35.753173+0000","last_clean":"2024-05-10T09:58:35.753173+0000","last_became_active":"2024-05-10T09:54:41.664165+0000","last_became_peered":"2024-05-10T09:54:41.664165+0000","last_unstale":"2024-05-10T09:58:35.753173+0000","last_undegraded":"2024-05-10T09:58:35.753173+0000","last_fullsized":"2024-05-10T09:58:35.753173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:35.752877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:35.752877+0000","last_clean_scrub_stamp":"2024-05-10T09:58:35.752877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:38:36.113270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"110'22","reported_seq":226,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:48.578097+0000","last_change":"2024-05-10T09:58:48.578097+0000","last_active":"2024-05-10T09:58:48.578097+0000","last_peered":"2024-05-10T09:58:48.578097+0000","last_clean":"2024-05-10T09:58:48.578097+0000","last_became_active":"2024-05-10T09:54:39.659851+0000","last_became_peered":"2024-05-10T09:54:39.659851+0000","last_unstale":"2024-05-10T09:58:48.578097+0000","last_undegraded":"2024-05-10T09:58:48.578097+0000","last_fullsized":"2024-05-10T09:58:48.578097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'22","last_scrub_stamp":"2024-05-10T09:58:48.577773+0000","last_deep_scrub":"110'22","last_deep_scrub_stamp":"2024-05-10T09:58:48.577773+0000","last_clean_scrub_stamp":"2024-05-10T09:58:48.577773+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T21:04:43.845703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":36882,"num_write":52,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"110'16","reported_seq":214,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.551105+0000","last_change":"2024-05-10T09:58:49.551105+0000","last_active":"2024-05-10T09:58:49.551105+0000","last_peered":"2024-05-10T09:58:49.551105+0000","last_clean":"2024-05-10T09:58:49.551105+0000","last_became_active":"2024-05-10T09:54:39.660701+0000","last_became_peered":"2024-05-10T09:54:39.660701+0000","last_unstale":"2024-05-10T09:58:49.551105+0000","last_undegraded":"2024-05-10T09:58:49.551105+0000","last_fullsized":"2024-05-10T09:58:49.551105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:49.550848+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:49.550848+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.550848+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:53:20.938450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":187,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:40.125433+0000","last_change":"2024-05-10T09:58:40.125488+0000","last_active":"2024-05-10T09:58:40.125433+0000","last_peered":"2024-05-10T09:58:40.125433+0000","last_clean":"2024-05-10T09:58:40.125433+0000","last_became_active":"2024-05-10T09:54:41.656193+0000","last_became_peered":"2024-05-10T09:54:41.656193+0000","last_unstale":"2024-05-10T09:58:40.125433+0000","last_undegraded":"2024-05-10T09:58:40.125433+0000","last_fullsized":"2024-05-10T09:58:40.125433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:40.125229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:40.125229+0000","last_clean_scrub_stamp":"2024-05-10T09:58:40.125229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:45:58.505146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"110'16","reported_seq":241,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:49.431201+0000","last_change":"2024-05-10T09:58:49.431201+0000","last_active":"2024-05-10T09:58:49.431201+0000","last_peered":"2024-05-10T09:58:49.431201+0000","last_clean":"2024-05-10T09:58:49.431201+0000","last_became_active":"2024-05-10T09:57:09.663956+0000","last_became_peered":"2024-05-10T09:57:09.663956+0000","last_unstale":"2024-05-10T09:58:49.431201+0000","last_undegraded":"2024-05-10T09:58:49.431201+0000","last_fullsized":"2024-05-10T09:58:49.431201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'16","last_scrub_stamp":"2024-05-10T09:58:49.430903+0000","last_deep_scrub":"110'16","last_deep_scrub_stamp":"2024-05-10T09:58:49.430903+0000","last_clean_scrub_stamp":"2024-05-10T09:58:49.430903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T18:03:42.449981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":24582,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":185,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-05-10T09:58:33.378615+0000","last_change":"2024-05-10T09:58:33.378667+0000","last_active":"2024-05-10T09:58:33.378615+0000","last_peered":"2024-05-10T09:58:33.378615+0000","last_clean":"2024-05-10T09:58:33.378615+0000","last_became_active":"2024-05-10T09:54:41.665472+0000","last_became_peered":"2024-05-10T09:54:41.665472+0000","last_unstale":"2024-05-10T09:58:33.378615+0000","last_undegraded":"2024-05-10T09:58:33.378615+0000","last_fullsized":"2024-05-10T09:58:33.378615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T09:58:33.378427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T09:58:33.378427+0000","last_clean_scrub_stamp":"2024-05-10T09:58:33.378427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:00:07.970531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1213,"num_read_kb":1594,"num_write":779,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":11424,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":858,"ondisk_log_size":858,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":38,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1522,"num_read_kb":2003600,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":478150656,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1949696,"data_stored":1353311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1339392,"data_stored":763712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509505,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1376256,"data_stored":763111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":83,"seq":356482285596,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1292,"kb_used_omap":5,"kb_used_meta":31738,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1323008,"data_stored":762774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5987,"internal_metadata":32499869},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509503,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36652,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1347584,"data_stored":762679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1318912,"data_stored":761845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509504,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37224,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1933312,"data_stored":1353153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":36174281},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542208,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40812,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331028,"statfs":{"total":96636764160,"available":96594972672,"internally_reserved":0,"allocated":1347584,"data_stored":762533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4392,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T09:59:24.028 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-10T09:59:24.398 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-10T09:59:24.399 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-10T09:59:24.399 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-10T09:59:24.399 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:24.483 INFO:tasks.ceph.osd.0:Stopped 2024-05-10T09:59:24.484 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-10T09:59:24.484 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:24.577 INFO:tasks.ceph.osd.1:Stopped 2024-05-10T09:59:24.577 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-10T09:59:24.577 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:24.674 INFO:tasks.ceph.osd.2:Stopped 2024-05-10T09:59:24.674 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-10T09:59:24.675 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:24.768 INFO:tasks.ceph.osd.3:Stopped 2024-05-10T09:59:24.768 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T09:59:24.768 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:24.851 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T09:59:24.852 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T09:59:24.852 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:24.940 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T09:59:24.940 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-10T09:59:24.940 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:25.031 INFO:tasks.ceph.osd.6:Stopped 2024-05-10T09:59:25.032 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-10T09:59:25.032 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:29.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-10T09:59:31.133 INFO:tasks.ceph.osd.7:Stopped 2024-05-10T09:59:31.134 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-10T09:59:31.134 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-10T09:59:31.134 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:31.162 INFO:tasks.ceph.mgr.y:Stopped 2024-05-10T09:59:31.162 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-10T09:59:31.162 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:31.192 INFO:tasks.ceph.mgr.x:Stopped 2024-05-10T09:59:31.192 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-10T09:59:31.192 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-10T09:59:31.193 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:31.220 INFO:tasks.ceph.mon.a:Stopped 2024-05-10T09:59:31.220 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-10T09:59:31.220 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:31.282 INFO:tasks.ceph.mon.c:Stopped 2024-05-10T09:59:31.283 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-10T09:59:31.283 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T09:59:31.302 INFO:tasks.ceph.mon.b:Stopped 2024-05-10T09:59:31.303 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-10T09:59:31.303 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-10T09:59:31.341 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:59:31.341 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-10T09:59:31.654 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:59:31.654 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-10T09:59:31.876 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:59:31.876 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-10T09:59:32.059 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:59:32.059 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-10T09:59:32.243 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:59:32.243 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-10T09:59:32.533 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:59:32.533 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-10T09:59:32.752 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:59:32.752 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-10T09:59:32.951 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:59:32.951 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-10T09:59:33.105 INFO:tasks.ceph:Archiving mon data... 2024-05-10T09:59:33.106 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/data/mon.a.tgz 2024-05-10T09:59:33.107 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-05-10T09:59:33.113 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.I2edCFtBSD 2024-05-10T09:59:33.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.I2edCFtBSD 2024-05-10T09:59:33.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.I2edCFtBSD 2024-05-10T09:59:33.355 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.I2edCFtBSD is 556KB 2024-05-10T09:59:33.422 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.I2edCFtBSD 2024-05-10T09:59:33.428 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/data/mon.c.tgz 2024-05-10T09:59:33.428 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-05-10T09:59:33.475 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.SdVjyalkxN 2024-05-10T09:59:33.476 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.SdVjyalkxN 2024-05-10T09:59:33.696 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.SdVjyalkxN 2024-05-10T09:59:33.759 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.SdVjyalkxN is 717KB 2024-05-10T09:59:33.826 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.SdVjyalkxN 2024-05-10T09:59:33.832 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/data/mon.b.tgz 2024-05-10T09:59:33.832 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-05-10T09:59:33.838 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.0zhCjPSqr5 2024-05-10T09:59:33.838 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0zhCjPSqr5 2024-05-10T09:59:34.051 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.0zhCjPSqr5 2024-05-10T09:59:34.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-10T09:59:34.123 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.0zhCjPSqr5 is 717KB 2024-05-10T09:59:34.187 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.0zhCjPSqr5 2024-05-10T09:59:34.191 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-10T09:59:34.191 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T09:59:34.194 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T09:59:34.252 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T09:59:34.287 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-10T09:59:34.287 INFO:tasks.ceph:Archiving crash dumps... 2024-05-10T09:59:34.289 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/remote/smithi042/crash 2024-05-10T09:59:34.289 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T09:59:34.308 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/remote/smithi181/crash 2024-05-10T09:59:34.309 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T09:59:34.337 INFO:tasks.ceph:Compressing logs... 2024-05-10T09:59:34.337 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T09:59:34.352 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-10T09:59:34.375 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32961.log 2024-05-10T09:59:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29979.log 2024-05-10T09:59:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32961.log.gz 2024-05-10T09:59:34.376 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40410.log 2024-05-10T09:59:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29979.log.gz 2024-05-10T09:59:34.377 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31352.log 2024-05-10T09:59:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-10T09:59:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40410.log: /var/log/ceph/ceph-client.admin.31352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31352.log.gz 2024-05-10T09:59:34.378 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34123.log 2024-05-10T09:59:34.378 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40410.log.gz 2024-05-10T09:59:34.379 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33255.log 2024-05-10T09:59:34.379 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.34123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34123.log.gz 2024-05-10T09:59:34.379 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39440.log 2024-05-10T09:59:34.380 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33255.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-10T09:59:34.380 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33255.log.gz 2024-05-10T09:59:34.381 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40126.log 2024-05-10T09:59:34.381 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39440.log.gz 2024-05-10T09:59:34.381 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31754.log 2024-05-10T09:59:34.383 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40126.log: 91.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40126.log.gz 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29770.log 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31754.log: /var/log/ceph/ceph-client.admin.31681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39349.log 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz -- replaced with /var/log/ceph/ceph-client.admin.31754.log.gz 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29770.log.gzgzip 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30160.log 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25219.log 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39349.log.gz 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42098.log 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30160.log.gz 2024-05-10T09:59:34.384 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25219.log.gzgzip 2024-05-10T09:59:34.385 INFO:teuthology.orchestra.run.smithi042.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29952.log 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39601.log 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42098.log.gz 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31980.log 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29952.log.gz 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38287.log 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39601.log.gz 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31980.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31980.log.gz 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29771.log 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38287.log.gz 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38173.log 2024-05-10T09:59:34.393 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32680.log 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29771.log.gz 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37510.log 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38173.log.gz 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34461.log 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32680.log.gz 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29958.log 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37510.log.gz 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41709.log 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34461.log.gz 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41995.log 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29958.log.gz 2024-05-10T09:59:34.394 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30183.log 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41709.log.gz 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39866.log 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41995.log.gz 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33482.log 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30183.log.gz 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.39866.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39866.log.gz 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33482.log.gz 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41501.log 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30444.log 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33143.log 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41501.log.gz 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39762.log 2024-05-10T09:59:34.395 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30444.log.gz 2024-05-10T09:59:34.396 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40022.log 2024-05-10T09:59:34.396 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33143.log.gz 2024-05-10T09:59:34.396 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38503.log 2024-05-10T09:59:34.396 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39762.log.gz 2024-05-10T09:59:34.396 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39788.log 2024-05-10T09:59:34.396 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40022.log.gz 2024-05-10T09:59:34.407 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40617.log 2024-05-10T09:59:34.407 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38503.log.gz 2024-05-10T09:59:34.407 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41917.log 2024-05-10T09:59:34.407 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39788.log.gz 2024-05-10T09:59:34.407 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40617.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.40617.log.gz -- 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr: /var/log/ceph/ceph-client.admin.36187.log 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29666.log 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41917.log.gz 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39892.log 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36187.log.gz 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40610.log 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29666.log.gz 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29759.log 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39892.log.gz 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31225.log 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40610.log.gz 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29759.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29759.log.gz -5 2024-05-10T09:59:34.408 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.0.40882.log 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32545.log 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31225.log.gz 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5/var/log/ceph/ceph-client.0.40882.log: --verbose -- /var/log/ceph/ceph-client.admin.32327.log 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40882.log.gz 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36099.log 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32545.log.gz 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34431.log 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32327.log.gz 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36099.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36099.log.gz 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34431.log.gz 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40201.log 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37921.log 2024-05-10T09:59:34.409 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41605.log 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40201.log.gz 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37921.log.gz 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35578.log 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41605.log: -- /var/log/ceph/ceph-client.admin.33184.log 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41605.log.gz 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35578.log.gz 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32727.log 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40152.log 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33184.log.gz 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32727.log.gz 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40854.log 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.40152.log: -- /var/log/ceph/ceph-client.admin.40602.log 2024-05-10T09:59:34.410 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40152.log.gz 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40854.log.gz 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40198.log 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.40602.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38586.log 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40602.log.gz 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40198.log.gz 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38586.log: /var/log/ceph/ceph-client.admin.41813.log 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38586.log.gz 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32986.log 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41813.log.gz 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40398.log 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33403.log 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32986.log.gz 2024-05-10T09:59:34.411 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31347.log 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40398.log.gz 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39500.log 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33403.log.gz 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39918.log 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31347.log.gz 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42048.log 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39500.log.gz 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39918.log.gz 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42048.log.gz 2024-05-10T09:59:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42021.log 2024-05-10T09:59:34.428 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25190.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25046.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25070.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.25190.log: 0.0%/var/log/ceph/ceph-client.admin.25046.log: -- replaced with /var/log/ceph/ceph-client.admin.25190.log.gz 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25046.log.gz 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.25070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25118.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25070.log.gz 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25094.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.25118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25118.log.gz 2024-05-10T09:59:34.429 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.25094.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25094.log.gz 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25214.log 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25166.log 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.25214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25142.log 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25214.log.gz 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.25166.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25166.log.gz 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.25142.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25142.log.gz 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T09:59:34.430 INFO:teuthology.orchestra.run.smithi181.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T09:59:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2024-05-10T09:59:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-05-10T09:59:34.441 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34176.log 2024-05-10T09:59:34.441 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42021.log.gz 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39627.log 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40048.log 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34176.log.gz 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39627.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.39627.log.gz --verbose 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr: -- /var/log/ceph/ceph-client.admin.31452.log 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40048.log.gz 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32117.log 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38756.log 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31452.log.gz 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33300.log 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32117.log.gz 2024-05-10T09:59:34.442 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30368.log 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38756.log.gz 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33300.log.gz 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41579.log 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34982.log 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30368.log.gz 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40607.log 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41579.log.gz 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39970.log 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34982.log.gz 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40607.log.gz 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35763.log 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41891.log 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39970.log.gz 2024-05-10T09:59:34.443 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35763.log.gz 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41891.log.gz 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39840.log 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39679.log 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29769.log 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39840.log.gz 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32846.log 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39679.log.gz 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29769.log.gz 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33638.log 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32846.log.gz 2024-05-10T09:59:34.444 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41761.log 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33638.log.gz 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31598.log 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41761.log.gz 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30494.log 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36015.log 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31598.log.gz 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29589.log 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30494.log.gz 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37974.log 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36015.log.gz 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41683.log 2024-05-10T09:59:34.445 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29589.log.gz 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38451.log 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37974.log.gz 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33674.log 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41683.log.gz 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42074.log 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38451.log.gz 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31779.log 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33674.log.gz 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.42074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39436.log 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42074.log.gz 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38499.log 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31779.log.gz 2024-05-10T09:59:34.446 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40100.log 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39436.log.gz 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38499.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.38499.log.gz /var/log/ceph/ceph.tmp-client.admin.20185.log 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39944.log 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40100.log.gz 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph.tmp-client.admin.20185.log: /var/log/ceph/ceph-client.admin.34641.log 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20185.log.gz 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37750.log 0.0% 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39944.log.gz 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41475.log 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34641.log.gz 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29692.log 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37750.log.gz 2024-05-10T09:59:34.447 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39382.log 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41475.log.gz 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40203.log 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29692.log.gz 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39736.log 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39382.log.gz 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33982.log 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40203.log.gz 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.39736.log: /var/log/ceph/ceph-client.admin.33440.log 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39736.log.gz 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40594.log 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33982.log.gz 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31307.log 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33440.log.gz 2024-05-10T09:59:34.448 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40194.log 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40594.log.gz 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31307.log.gz 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40204.log 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40194.log.gz 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38240.log 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38413.log 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40204.log.gz 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24961.log 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38240.log.gz 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34028.log 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38413.log.gz 2024-05-10T09:59:34.449 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.24961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24961.log.gz 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40409.log 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29640.log 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34028.log.gz 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25109.log 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40409.log.gz 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32203.log 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29640.log.gz 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41553.log 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.25109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25109.log.gz 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41839.log 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32203.log.gz 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40414.log 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41553.log.gz 2024-05-10T09:59:34.450 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40609.log 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41839.log.gz 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40414.log.gz 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38733.log 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35621.log 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40609.log.gz 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29964.log 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38733.log.gz 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31853.log 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35621.log.gz 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29964.log.gz 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33326.log 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31853.log.gz 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33597.log 2024-05-10T09:59:34.451 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40191.log 2024-05-10T09:59:34.452 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33326.log.gz 2024-05-10T09:59:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41865.log 2024-05-10T09:59:34.452 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33597.log.gz 2024-05-10T09:59:34.452 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40191.log.gz 2024-05-10T09:59:34.468 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40802.log 2024-05-10T09:59:34.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30164.log 2024-05-10T09:59:34.468 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41865.log.gz 2024-05-10T09:59:34.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40828.log 2024-05-10T09:59:34.468 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40802.log.gz 2024-05-10T09:59:34.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35922.log 2024-05-10T09:59:34.468 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30164.log.gz 2024-05-10T09:59:34.468 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40828.log.gz 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30394.log 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35922.log.gz 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40624.log 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30470.log 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30394.log.gz 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40624.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.40624.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30470.log.gz 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31351.log 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38159.log 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31351.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30420.log 2024-05-10T09:59:34.469 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31351.log.gz 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38159.log.gz 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33056.log 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30420.log.gz 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31560.log 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33056.log.gz 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36267.log 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gz 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38690.log 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31560.log.gz 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36267.log.gz 2024-05-10T09:59:34.470 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39996.log 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29963.log 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38690.log.gz 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40408.log 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39996.log.gz 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29614.log 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29963.log: /var/log/ceph/ceph-client.admin.40408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29963.log.gz 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40408.log.gz 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41969.log 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29614.log.gz 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38640.log 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41969.log.gz 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35961.log 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2024-05-10T09:59:34.471 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37673.log 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38640.log.gz 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33527.log 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35961.log: /var/log/ceph/ceph-client.admin.37673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35651.log 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35961.log.gz 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37673.log.gz 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33527.log.gz 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32198.log 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35651.log.gz 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29772.log 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39814.log 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32198.log: /var/log/ceph/ceph-client.admin.29772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32198.log.gz 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29772.log.gz 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31251.log 2024-05-10T09:59:34.472 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39574.log 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39814.log.gz 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31251.log.gz 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31487.log 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39574.log.gz 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38087.log 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34560.log 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31487.log: /var/log/ceph/ceph-client.admin.38087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31487.log.gz 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38087.log.gz 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34373.log 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32430.log 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34560.log: /var/log/ceph/ceph-client.admin.34373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34560.log.gz 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34373.log.gz 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31199.log 2024-05-10T09:59:34.473 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36226.log 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32430.log: /var/log/ceph/ceph-client.admin.31199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32430.log.gz 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31199.log.gz 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29980.log 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37746.log 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36226.log: /var/log/ceph/ceph-client.admin.29980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36226.log.gz 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29980.log.gz 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37746.log: /var/log/ceph/ceph-client.admin.32389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37746.log.gz 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gz 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34723.log 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41787.log 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.34723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34723.log.gz 2024-05-10T09:59:34.474 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41735.log 2024-05-10T09:59:34.475 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41787.log.gz 2024-05-10T09:59:34.484 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-10T09:59:34.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41735.log: 0.0% 94.3% -- replaced with /var/log/ceph/ceph-client.admin.41735.log.gz 2024-05-10T09:59:34.484 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-10T09:59:34.484 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34093.log 2024-05-10T09:59:34.484 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41527.log 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34093.log.gz 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40386.log 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41527.log.gz 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33784.log 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36903.log 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33784.log.gz 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38450.log 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37877.log 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.36903.log: /var/log/ceph/ceph-client.admin.38450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36903.log.gz 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38450.log.gz 2024-05-10T09:59:34.485 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30173.log 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40618.log 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37877.log.gz 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30173.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32779.log 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40618.log.gz 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39653.log 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32896.log 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32779.log.gz 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39653.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40205.log 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39653.log.gz 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32896.log.gz 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39536.log 2024-05-10T09:59:34.486 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32035.log 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40205.log.gz 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39536.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34724.log 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32035.log.gz 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32092.log 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29718.log 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34724.log: /var/log/ceph/ceph-client.admin.32092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34724.log.gz 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32092.log.gz 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33941.log 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35739.log 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29718.log: /var/log/ceph/ceph-client.admin.33941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29718.log.gz 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33941.log.gz 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31524.log 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39710.log 2024-05-10T09:59:34.487 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31524.log: 0.0%/var/log/ceph/ceph-client.admin.35739.log: -- replaced with /var/log/ceph/ceph-client.admin.31524.log.gz 2024-05-10T09:59:34.488 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35739.log.gz 2024-05-10T09:59:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37631.log 2024-05-10T09:59:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29978.log 2024-05-10T09:59:34.488 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.39710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39710.log.gz 2024-05-10T09:59:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37631.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41631.log 2024-05-10T09:59:34.494 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.494 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29978.log.gz 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41943.log 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29757.log 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.41631.log: /var/log/ceph/ceph-client.admin.41943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41631.log.gz 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41943.log.gz 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40074.log 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34901.log 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29757.log.gz 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40074.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29768.log 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34901.log.gz 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30178.log 2024-05-10T09:59:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29768.log.gz 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32753.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.31849.log 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30178.log.gz 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40206.log 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34517.log 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31849.log.gz 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40206.log.gz 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32783.log 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34517.log.gz 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29527.log 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29968.log 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32783.log: /var/log/ceph/ceph-client.admin.29527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32783.log.gz 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29527.log.gz 2024-05-10T09:59:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2024-05-10T09:59:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35822.log 2024-05-10T09:59:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29968.log: /var/log/ceph/ceph-client.admin.33845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29968.log.gz 2024-05-10T09:59:34.497 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2024-05-10T09:59:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30520.log 2024-05-10T09:59:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34617.log 2024-05-10T09:59:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35822.log: 0.0%/var/log/ceph/ceph-client.admin.30520.log: -- replaced with /var/log/ceph/ceph-client.admin.35822.log.gz 2024-05-10T09:59:34.502 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30520.log.gz 2024-05-10T09:59:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34279.log 2024-05-10T09:59:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33064.log 2024-05-10T09:59:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34617.log: /var/log/ceph/ceph-client.admin.34279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34617.log.gz 2024-05-10T09:59:34.502 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34279.log.gz 2024-05-10T09:59:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34800.log 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33846.log 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33064.log.gz 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.34800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34800.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37558.log 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33846.log.gz 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33759.log 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31639.log 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37558.log.gz 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.33759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33759.log.gz 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38056.log 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31639.log.gz 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30206.log 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30184.log 2024-05-10T09:59:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38056.log.gz 2024-05-10T09:59:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30206.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32468.log 2024-05-10T09:59:34.504 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30184.log.gz 2024-05-10T09:59:34.507 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40406.log 2024-05-10T09:59:34.507 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38636.log 2024-05-10T09:59:34.507 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32468.log.gz 2024-05-10T09:59:34.507 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.40406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40406.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35874.log 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38636.log.gz 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38342.log 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30182.log 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.35874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35874.log.gz 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.38342.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32570.log 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38342.log.gz 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30182.log.gz 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32274.log 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31277.log 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32570.log.gz 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.32274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32274.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29763.log 2024-05-10T09:59:34.508 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:34.510 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.31277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31277.log.gz 2024-05-10T09:59:34.510 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40393.log 2024-05-10T09:59:34.510 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29763.log: 0.0%/var/log/ceph/ceph-client.admin.40393.log: -- replaced with /var/log/ceph/ceph-client.admin.29763.log.gz 2024-05-10T09:59:34.510 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40393.log.gz 2024-05-10T09:59:34.512 INFO:teuthology.orchestra.run.smithi181.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-10T09:59:34.593 INFO:teuthology.orchestra.run.smithi181.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-10T09:59:34.645 INFO:teuthology.orchestra.run.smithi042.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-10T09:59:34.726 INFO:teuthology.orchestra.run.smithi042.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-10T09:59:34.970 INFO:teuthology.orchestra.run.smithi042.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-10T09:59:34.983 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-10T09:59:35.058 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-10T09:59:35.061 INFO:teuthology.orchestra.run.smithi181.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-10T09:59:35.062 INFO:teuthology.orchestra.run.smithi181.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-10T09:59:35.064 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-05-10T09:59:35.064 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m0.679s 2024-05-10T09:59:35.064 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m2.694s 2024-05-10T09:59:35.064 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.112s 2024-05-10T09:59:35.100 INFO:teuthology.orchestra.run.smithi042.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-10T09:59:35.120 INFO:teuthology.orchestra.run.smithi042.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-10T09:59:35.201 INFO:teuthology.orchestra.run.smithi042.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-10T09:59:35.203 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-10T09:59:35.203 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m0.848s 2024-05-10T09:59:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m3.343s 2024-05-10T09:59:35.204 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.230s 2024-05-10T09:59:35.204 INFO:tasks.ceph:Archiving logs... 2024-05-10T09:59:35.204 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/remote/smithi042/log 2024-05-10T09:59:35.205 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T09:59:35.818 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/remote/smithi181/log 2024-05-10T09:59:35.819 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T09:59:36.161 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T09:59:36.169 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T09:59:36.170 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T09:59:36.172 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T09:59:36.245 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T09:59:36.253 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T09:59:36.254 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T09:59:36.256 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T09:59:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: remote refid st t when poll reach delay offset jitter 2024-05-10T09:59:36.266 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================== 2024-05-10T09:59:36.266 INFO:teuthology.orchestra.run.smithi042.stdout:*hv01.front.sepi 67.205.162.81 3 u 22 64 377 0.110 +0.277 1.426 2024-05-10T09:59:36.266 INFO:teuthology.orchestra.run.smithi042.stdout:+hv02.front.sepi 63.231.80.2 3 u 13 64 377 0.083 +1.037 0.863 2024-05-10T09:59:36.266 INFO:teuthology.orchestra.run.smithi042.stdout:+hv03.front.sepi 74.6.168.72 3 u 19 64 377 0.075 -1.970 1.374 2024-05-10T09:59:36.266 INFO:teuthology.orchestra.run.smithi042.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:59:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: remote refid st t when poll reach delay offset jitter 2024-05-10T09:59:36.270 INFO:teuthology.orchestra.run.smithi181.stdout:============================================================================== 2024-05-10T09:59:36.270 INFO:teuthology.orchestra.run.smithi181.stdout:+hv01.front.sepi 67.205.162.81 3 u 19 64 377 0.056 -2.120 0.920 2024-05-10T09:59:36.270 INFO:teuthology.orchestra.run.smithi181.stdout:+hv02.front.sepi 63.231.80.2 3 u 20 64 377 0.069 +0.495 0.713 2024-05-10T09:59:36.270 INFO:teuthology.orchestra.run.smithi181.stdout:*hv03.front.sepi 74.6.168.72 3 u 20 64 377 0.078 -2.269 1.106 2024-05-10T09:59:36.270 INFO:teuthology.orchestra.run.smithi181.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-10T09:59:36.271 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T09:59:36.280 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T09:59:36.281 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T09:59:36.289 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T09:59:36.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T09:59:36.305 INFO:teuthology.task.internal:Duration was 913.261857 seconds 2024-05-10T09:59:36.306 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T09:59:36.314 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T09:59:36.314 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T09:59:36.316 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T09:59:36.354 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T09:59:36.354 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-05-10T09:59:36.354 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T09:59:36.405 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-05-10T09:59:36.405 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T09:59:36.415 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T09:59:36.415 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T09:59:36.448 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T09:59:36.481 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T09:59:36.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T09:59:36.520 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T09:59:36.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T09:59:36.604 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T09:59:36.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T09:59:36.616 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T09:59:36.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T09:59:36.638 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T09:59:36.660 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T09:59:36.670 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-05-10T09:59:36.682 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-05-10T09:59:36.755 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T09:59:36.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:59:36.760 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T09:59:36.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T09:59:36.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T09:59:36.810 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T09:59:36.811 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/remote/smithi042 2024-05-10T09:59:36.811 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T09:59:36.833 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/soumyakoduri-2024-05-10_06:25:19-rgw-wip-skoduri-lc-notify-distro-default-smithi/7700864/remote/smithi181 2024-05-10T09:59:36.833 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T09:59:36.864 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T09:59:36.864 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T09:59:36.872 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T09:59:36.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T09:59:36.920 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T09:59:36.920 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T09:59:36.930 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T09:59:36.930 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T09:59:36.932 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T09:59:36.936 INFO:teuthology.orchestra.run.smithi042.stdout: 658632 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 09:59 /home/ubuntu/cephtest 2024-05-10T09:59:36.957 INFO:teuthology.orchestra.run.smithi181.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 09:59 /home/ubuntu/cephtest 2024-05-10T09:59:36.958 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T09:59:36.969 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T09:59:36.997 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} duration: 913.2618567943573 flavor: default owner: scheduled_soumyakoduri@teuthology success: true 2024-05-10T09:59:36.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T09:59:37.074 INFO:teuthology.run:pass